MPEG-I Standards for Volumetric Video and a Real-Time Implementation

Céline Guede, Patrick Fontaine, Julien Mulard, Bertrand Leroy, Cyril Quinquis, Rémy Gendrot, Srinivas Gudumasu, Valérie Allié, Bart Kroon, Bart Sonneveldt, Ronald Schimanofsky

This paper presents a real-time implementation of a platform jointly developed by InterDigital and Philips that showcases use cases leveraging the MPEG volumetric (MPEG-I V3C) and 2D video standards Versatile Video Coding [VVC], High Efficiency Video Coding [HEVC]. We will detail how our platform enables interoperability within existing and emerging extended reality (XR) ecosystems, including the acquisition, streaming, and real-time interactive playback of volumetric video on current and future client devices for use in applications like telelearning, free-viewpoint sports replays, and 3D telepresence in connected ecosystems like the metaverse. MPEG's Visual Volumetric Video-based Coding (V3C) standard is an extensive framework for coding volumetric video, from dynamic point clouds (V-PCC) to multiview plus depth and multiplane image representations (MIV). It offers a single bitstream structure with a uniform bridge to systems-level standards. The V3C carriage standard defines how volumetric content can be stored, transported, and delivered to the end user. It repurposes existing 2D video hardware decoding capabilities and graphic processing units (GPUs) to decode and render volumetric video.

Print ISSN
Electronic ISSN
2160-2492
Published
2024-07
Content type
Original Research
Keywords
qoe (quality of experience), immersive video, playback-side context, image depth and parallax
DOI
10.5594/JMI.2024/IXTK5404