Editing and Managing Multi-Channel Video — A Light Field Approach

Shailendra Mathur, Stephen McNeill

A strong trend in the media industry is acquisition of higher data resolutions and broader ranges in color, spatial and temporal domains. The data can be in the form of multiple views over these domains. Media may be captured from multiple devices, a single device with high resolution/range capabilities or, a synthetic source such as a CGI scene. Video productions are evolving from working with one view at a time to capturing as much information as possible i.e., “super-sample the world!” and extracting only the views needed for mastering. The role of traditional story telling tools becomes challenging. Well known editorial and data management techniques have to be applied to multiple media samples of the same scene for different ranges and resolutions in the temporal, color and spatial domains. This paper presents concepts from the area of Light Fields to propose an editorial and data management system to work with these multi-view sources. A proposed data model and run-time system shows how media from various views can be grouped in a way that they appear as a single light field source to the editing and data management functions. By defining the interrelationship between the multiple sources with metadata and output view requirements, transformations can be applied on various input view samples to create novel output views of the scene. The use of range information is shown to be important as it extends common editing and data management techniques to the multi-view case.

Published
2011-10
Content type
Original Research
Keywords
Multi-channel editing, data management, light field, multi-view, output context, spatial, temporal, color, high dynamic range, resolutions, range, reference coordinate, synchronization, registration, alignment, relational meta-data, consolidate, transcode, optimized delete, log, stereo, 3D, S3D, multi-channel video, quality matching, group ID, channel ID
DOI
10.5594/M001073
ISBN
978-1-61482-940-9