Understanding MPEG-I Coding Standardization in Immersive VR/AR Applications

Gauthier Lafruit, Daniele Bonatto, Christian Tulvan, Marius Preda, Lu Yu

After decennia of developing leading-edge 2D video compression technologies, the Moving Picture Expert Group (MPEG) is currently working on the new era of coding for immersive applications, referred to as MPEG-I, where “I” refers to the “Immersive” aspects. It ranges from 360° video with head-mounted displays to free navigation in 3D space with head-mounted and 3D light field displays. Two families of coding approaches, covering typical industrial workflows, are currently considered for standardization—MultiView + Depth (MVD) Video Coding and Point Cloud Coding—both supporting high-quality rendering at bitrates of up to a couple of hundreds of megabits per second. This paper provides a technical/historical overview of the acquisition, coding, and rendering technologies considered in the MPEG-I standardization activities.

Print ISSN
Electronic ISSN
2160-2492
Published
2019-11
Content type
Original Research
Keywords
3/6 Degrees of Freedom (3/6-DoF), depth image-based rendering (DIBR), Moving Picture Expert Group immersive (MPEG-I) video compression, point cloud coding (PCC)
DOI
10.5594/JMI.2019.2941362