Enhancements to Media Transport in ICVFX using SMPTE 2110

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2023, No. 10, pp. 20–22
Abstract: In this paper, we propose an enhancement to clustered rendering for In-Camera Visual Effects (ICVFX) that leverages the quality, low latency, and timing guarantees in SMPTE 2110, a standard for professional media over managed IP networks. — We show how SMPTE 2110 can be used to multicast multiple camera views of variable or overscanned resolutions, each rendered by dedicated camera render nodes, and received by the collection of render nodes in the cluster that warp and compose it on top of the rendered out-of-camera pixels, resulting in a more efficient, scalable, and higher performing rendering cluster. Since the pixels are now transported between render and composer nodes, we describe techniques to mitigate, and in some cases completely hide, the time required to multicast the pixels over the network, resulting in no added frame latency. — We also demonstrate that the final pixels can then be output via SMPTE 2110 to synchronously drive each section of the LED wall, which results in low latency, simplified and more flexible hardware setup that also unifies the media transport strategy in an ICVFX stage. We show how SMPTE ST 2110 and IEEE-1588 Precision Time Protocol (PTP) with SMPTE ST 2059 enable the ability to synchronize the video output of the multiple render nodes that drive an LED wall, ensuring temporal coherence and spatial alignment of the virtual scene. We explain the clustered media output genlock and framelock algorithm and demonstrate the benefits of our approach with a proof-of-concept implementation and some experimental results. — Find our implementation in the Unreal Engine source code: https://www.unrealengine.com/en-US/ue-on-github
Publication Date: 2023-10-16
DOI: 10.5594/M001996
ISBN: Print: 978-1-61482-964-5
Link: https://doi.org/10.5594/M001996
Author(s): Alejandro ArangoEpic Games
Simon TherriaultEpic Games
Andrey YamashevEpic Games
Keyword(s): Virtual Production, ICVFX, Visual Effects, LED Wall, Multicast, Inner Frustum, Framelock, PTP, IEEE-1588, ST 2110, ST 2059
Copyright: © 2023 Society of Motion Picture and Television Engineers, Inc.

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001996.json

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Alejandro Arango, Simon Therriault, and Andrey Yamashev; Enhancements to Media Transport in ICVFX using SMPTE 2110, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M001996

Snippet:

Alejandro Arango, Simon Therriault, and Andrey Yamashev; Enhancements to Media Transport in ICVFX using SMPTE 2110, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M001996

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Alejandro Arango, Simon Therriault, and Andrey Yamashev; <cite>Enhancements to Media Transport in ICVFX using SMPTE 2110</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M001996" target="_blank" rel="noopener">https://doi.org/10.5594/M001996</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Alejandro Arango, Simon Therriault, and Andrey Yamashev; <cite id="bib-10-5594-m001996">Enhancements to Media Transport in ICVFX using SMPTE 2110</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
<span class="doi">10.5594/M001996</span>
</li>