Enhancements to Media Transport in ICVFX Using SMPTE 2110

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 133, No. 6, pp. 60–71
Abstract: This paper proposes an enhancement to clustered rendering for In-Camera Visual Effects (ICVFX) using SMPTE 2110, a standard for professional media over managed IP networks. We demonstrate how SMPTE 2110 enables the multicasting of multiple camera views at varying resolutions, each rendered by dedicated nodes and then received by cluster nodes for warping and composition. This approach improves rendering efficiency, scalability, and performance. We also describe techniques to minimize multicast latency, resulting in no added frame delay. Additionally, we show how SMPTE 2110 and IEEE-1588 Precision Time Protocol (PTP) with SMPTE ST 2059 synchronize video output across render nodes, driving LED walls with low latency and a unified media transport strategy. The implementation is available in Unreal Engine source code. 1
Publication Date: 2024-10-01
DOI: 10.5594/JMI.2024/SJIL4746
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2024/SJIL4746
Author(s): Alejandro Arango
Simon Therriault
Andriy Yamashev
Keyword(s): Virtual Production, ICVFX, Visual Effects, LED Wall, Multicast, Inner Frustum, Framelock
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

Epic Games. “Unreal Engine, Version 5.3” GitHub repository. [Online]. Available: https://www.unrealengine.com/en-US/ue-on-github. EXTERNAL
Epic Games, In-Camera VFX. [Online]. Available: https://docs.unrealengine.com/en-US/in-camera-vfx-in-unreal-engine/. EXTERNAL
Disguise, “The Key to Superior Content Rendering.” [Online]. Available: https://www.disguise.one/media/9151/disguise-the-key-to-superior-content-rendering-whitepaper.pdf. EXTERNAL
A. Sigitov, T. Roth, and A. Hinkenjann, “Enabling global illumination rendering on large, high-resolution displays,” 2015 IEEE 8th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS), Arles, France, 2015, doi:10.1109/SEARIS.2015.7854097. EXTERNAL
NVIDIA Quadro Sync. [Online]. Available: https://www.nvidia.com/en-us/de-sign-visualization/solutions/quadro-sync/. EXTERNAL
AMD, FirePro S400 Synchronization Module. [Online]. Available: https://www.amd.com/system/files/documents/ati-firepro-s400-data-sheet.pdf. EXTERNAL
Epic Games, “Threaded Rendering.” [Online]. Available: https://docs.unrealengine.com/en-US/threaded-rendering-in-unreal-engine/. EXTERNAL
Unity Technologies, “Optimizing Graphics in Unity, Chapter 4 Multithreaded Rendering & Graphics Jobs.” [Online]. Available: https://learn.unity.com/tutorial/optimizing-graphics-in-unity. EXTERNAL
Request for Comments (RFC) 3550, “RTP: A Transport Protocol for Real-Time Applications”. EXTERNAL
Institute of Electrical and Electronics Engineers (IEEE) -1588, “Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Contro Systems”. EXTERNAL
NVIDIA, “Frame lock.” [Online]. Available: https://www.nvidia.com/en-us/drivers/10–10794/. EXTERNAL
Cisco, “Understanding Jitter in Packet Voice Networks.” [Online]. Available: https://www.cisco.com/c/en/us/support/docs/voice/voice-quality/18902-jitter-pack-et-voice.html. EXTERNAL
NVIDIA BlueField Data Processing Units. [Online]. Available: https://www.nvidia.com/en-us/networking/products/data-processing-unit/. EXTERNAL
NVIDIA RTX 6000 Ada Generation Graphics Card. [Online]. Available: https://www.nvidia.com/en-us/design-visualization/rtx-6000/. EXTERNAL
Megapixel HELIOS. [Online]. Available: https://megapixelvr.com/helios/. EXTERNAL
Epic Games, “City Sample.” [Online]. Available: https://docs.unrealengine.com/5.2/en-US/city-sample-project-unreal-engine-demonstration/. EXTERNAL
Epic Games, “Electric Dreams Environment.” [Online]. Available: https://docs.unrealengine.com/5.2/en-US/electric-dreams-environment-in-unreal-engine/. EXTERNAL
Epic Games, “Temporal Super Resolution.” [Online]. Available https://docs.unrealengine.com/5.2/en-US/temporal-super-resolution-in-unreal-engine/. EXTERNAL
Phabrix QxL. [Online]. Available: https://www.phabrix.com/products/qxl/. EXTERNAL
SMPTE ST 12-1 [Active, Stabilized]
SMPTE ST 2059-1 [Active]
SMPTE ST 2059-2 [Active]
SMPTE ST 2110-10 [Active]
SMPTE ST 2110-20 [Active]
SMPTE ST 2110-21 [Active]
SMPTE ST 2110-22 [Active]
SMPTE ST 2110-40 [Active]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2024-SJIL4746.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Alejandro Arango, Simon Therriault, and Andriy Yamashev; Enhancements to Media Transport in ICVFX Using SMPTE 2110, MIJ 2024, Volume 133, Number 6 (pp. 60 to 71); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/SJIL4746

Snippet:

Alejandro Arango, Simon Therriault, and Andriy Yamashev; Enhancements to Media Transport in ICVFX Using SMPTE 2110, MIJ 2024, Volume 133, Number 6 (pp. 60 to 71); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/SJIL4746

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Alejandro Arango, Simon Therriault, and Andriy Yamashev; <cite>Enhancements to Media Transport in ICVFX Using SMPTE 2110</cite>, MIJ 2024, Volume 133, Number 6 (pp. 60 to 71); SMPTE, 2024. Available at <a href="https://doi.org/10.5594/JMI.2024/SJIL4746" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2024/SJIL4746</a></span>

SMPTE's HTML Pub

Preview:

Alejandro Arango, Simon Therriault, and Andriy Yamashev; Enhancements to Media Transport in ICVFX Using SMPTE 2110, MIJ 2024, Volume 133, Number 6 (pp. 60 to 71); SMPTE, 2024
doi: 10.5594/JMI.2024/SJIL4746
url: https://doi.org/10.5594/JMI.2024/SJIL4746

Snippet:

<li>
Alejandro Arango, Simon Therriault, and Andriy Yamashev; <cite id="bib-10-5594-jmi-2024-sjil4746">Enhancements to Media Transport in ICVFX Using SMPTE 2110</cite>, MIJ 2024, Volume 133, Number 6 (pp. 60 to 71); SMPTE, 2024
<span class="doi">10.5594/JMI.2024/SJIL4746</span>
</li>