Module Name: Motion Picture Engineering (optional)
ECTS weighting: 10 Credits
Contact Hours: 11 X 2-3 hour lectures; 11 X 3 hour labs
Module Coordinator: Prof. Anil Kokaram
Motion Pictures in the form of Digital Video accounts for more than 70% of all internet traffic today. R&D in this area has inspired new industries in digital media creation, online video streaming and video media sharing. Industrial Light and Magic, The Foundry, YouTube, Netflix, Vimeo, Skype, Sky Digital are just a few of the well known large companies that now successfully operate in this space.
Motion Picture Engineering prepared the student for a career in these industries including post-production tool development and video streaming. The first part (before the reading) week introduces the underlying ideas in motion estimation, object segmentation and statistical video processing in general. The second part after the reading week will investigate modern compression standards such as H.264, VP8 and VP9. The module also considers aspects of Deep Learning as they apply to Video. The module incorporates a bi-weekly seminar program with guest lectures from domain experts e.g. Netflix and Google.
- Objective Video Quality Measurement – state of the art objective quality metrics such as VQM and SSIM
- Motion Estimation – state of the art frameworks and implementations
- Optimisation – introduction to well-known optimisation strategies for image/video processing applications such as image/video segmentation and motion estimation. These include, Graph Cuts, ICM, Belief Propagation
- Deep Learning in Video – Recent topics in Deep Learning for motion estimation
At the end of the module, students will be able to
- Design tools in a commercial video processing platform,
- Design visual algorithms for solving video-centric problems involving motion and texture
- Assess critically, methodologies for subjective image/video quality assessment.
- Assess critically the state of the art in motion estimation and video segmentation.
- Assess critically the relative performance of competing video compression standards.
- Analyse the performance of tools within video compression standards
Recommended Reading List
- Markov Random Fields for Vision and Image Processing. Edited by A. Blake, P. Kohli and C. Rother, MIT Press, 2011. ISBN: 978-0-262-01577-6
- The Essential Guide to Video Processing. A. Bovik, Academic Press, 2009. ISBN: 978-0-12-374456-2
Methods of Assessment
Assessment for 5C1 will be 100% based on Continuous Assessment. Assessment will be a mixture of algorithm design assignments and in-class tests. The students on the course will be guided through adapting assignments to complement their chosen project if possible.
The module is mostly lab-based containing a mixture of tutorials and conventional lab sessions where students will be able to seek assistance on their development assignments. There will be approximately 20 lecture hours which will be run twice a week from the start of the semester. The guideline for a 10 ECTS module is for 250 hours of student effort including class hours.