Advanced Volumetric Video Format for Enhancing Photo-Realistic Lighting Reproduction
We are developing a photo-realistic volumetric capture system called Japan Broadcasting Corp. (NHK) Meta Studio. Meta Studio can acquire various material and light-field parameters to enable photo-realistic relighting. Captured data from Meta Studio comprise a multi-dimensional extended point cloud for each frame and is considerable in size. Hence, we adopt a hierarchical format that consists of base and enchancement layers. The base layer is designed for compatibility with the existing format and rendering for a simple relighting method. The enhancement layer includes other components and the advanced rendering shader program, which enables us to fully utilize our advanced photo-realistic rendering method; however, full real-time rendering is still under development. In preparation for full real-time rendering, we have developed an efficient rendering system for the base layer. Although full processing is not complete yet, real-time rendering will allow wide use of Meta Studio's volumetric data.
- Print ISSN
- 1545-0279
- Electronic ISSN
- 2160-2492
- Published
- 2024-05
- Content type
- Original Research
- Keywords
- volumetric videos, rendering, shading, virtual video production, immersive
- DOI
- 10.5594/JMI.2024/ZRBF6236