Enhancements to Media Transport in ICVFX Using SMPTE 2110
This paper proposes an enhancement to clustered rendering for In-Camera Visual Effects (ICVFX) using SMPTE 2110, a standard for professional media over managed IP networks. We demonstrate how SMPTE 2110 enables the multicasting of multiple camera views at varying resolutions, each rendered by dedicated nodes and then received by cluster nodes for warping and composition. This approach improves rendering efficiency, scalability, and performance. We also describe techniques to minimize multicast latency, resulting in no added frame delay. Additionally, we show how SMPTE 2110 and IEEE-1588 Precision Time Protocol (PTP) with SMPTE ST 2059 synchronize video output across render nodes, driving LED walls with low latency and a unified media transport strategy. The implementation is available in Unreal Engine source code.1
- Print ISSN
- 1545-0279
- Electronic ISSN
- 2160-2492
- Published
- 2024-10
- Content type
- Original Research
- Keywords
- virtual production, icvfx, visual effects, led wall, multicast, inner frustum, framelock
- DOI
- 10.5594/JMI.2024/SJIL4746