Interactive Steaming of Panoramas and VR Worlds

Virtual reality (VR) has recently become a hot topic in the media industry. VR systems enable the user to navigate in real or virtual worlds. The dimensions of these worlds may range from 180° cylinders up to complete 360° spheres. Such systems require cameras that are able to capture these worlds and transmission systems, which enable users to view these worlds on their VR devices. Fraunhofer Heinrich-Hertz-Institute (HHI) has developed an interactive streaming system, which provides the highest quality and does not limit the image resolution either on the production or on the end device side. It consists of one or several omnidirectional cameras that can be placed in scenes such as sport stadiums, theaters, and fairs. In HHI’s OmniCam360, there are 10 micro-HD cameras, delivering a 360° panorama of $10.000\times1.920$ pixels. As the data rate of such video is by far too high to be transmitted to an end device, three solutions to stream the content to end devices have been developed. A user can then interactively navigate in the panorama.

Print ISSN

1545-0279

Electronic ISSN

2160-2492

Published

2017-01

Content type

Original Research

Keywords

Panoramic Video, Virtual Reality, Omni-Directional Cameras, Real-Time Stitching, Streaming of Panoramic Video, Interactive Rendering, Region of Interest, Tiling, Compressed Domain Tile Stitching

DOI

10.5594/JMI.2016.2640058