Solving the Challenge of Volumetric Video Production and Streaming: An End-to-End Perspective of Technologies and Device Ecosystem Capabilities and Performance
Volumetric models and assets are great elements for content creators to use in the development of appealing immersive experiences. We can think about live sporting events where the entire scene is captured as volumetric elements and streamed to the mobile devices of thousands of consumers. However, distribution to consumers of high-quality immersive experiences using volumetric assets has been challenged by several factors including visual fidelity, bandwidth, latency, and device processing power. Content creators have been constrained from expressing the full potential intended for their original experience. In this article, you will learn about methods to stream volumetric video assets from an end-to-end perspective including an overview of production systems and suitable volumetric compression profiles (using point cloud compression) that can be used to render on any display for a wider reach: virtual reality (VR) headsets, augmented reality (AR) glasses, and flat screens. An ecosystem overview with device capabilities and performance is presented, and an analysis of content and end-user security functionality is further included. Finally, this article explores the evolution and opportunities of volumetric video streaming using 5G cloud/edge infrastructure to process and distribute volumetric content to any device, minimizing device processor power consumption, minimizing overall delay, and providing the best possible user experience.
- Print ISSN
- 1545-0279
- Electronic ISSN
- 2160-2492
- Published
- 2023-06
- Content type
- Original Research
- Keywords
- 5G cloud, augmented reality (AR), eXtended reality (XR), mesh, point cloud, production systems and workflows, video compression, virtual reality (VR), volumetric video
- DOI
- 10.5594/JMI.2023.3269750