Live VR end-to-end workflows: real-life deployments and advances in VR and network technology

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2020, No. 11, pp. 1–24
Abstract: Live VR sports events are gaining traction among viewers since immersive services add a closer experience than watching on a TV providing even better point of views than being at the event. The content acquisition of the Live VR feed is captured using additional cameras dedicated for this purpose (in addition to the traditional cameras). In the venue, there might be several locations where the VR content is captured. The director may choose which Live VR feeds are distributed to home delivery, either by producing one single VR feed, or by giving the choice to the end user to select which one to watch, or a by offering a combination of a produced feed and individual cameras. — In this paper, we describe and analyze the live VR workflows from an end-to-end perspective such as production, contribution, distribution and consumption aspects and describe how this can be complementary to the traditional broadcast services with a 4K like experience. We also describe how the recent advances in VR technology can improve VR experience in an optimal bandwidth using view port dependent technologies (for instance using MPEG OMAF format) and how VR production techniques (such as volumetric) provide advance tools for capturing footage from many angles for producing live free-point of view consumption and volumetric replays. This paper also presents Live VR service deployments using those technologies and it will describe the technical challenges from an end-to-end perspective on how to achieve high quality (VR360 8K equivalent) considering aspects such as bit rate, latency, CDN configurations and device capabilities. Finally, we also address how any high speed broadband infrastructure like 5G, Fiber of DOCSIS 3.1 infrastructure and new 5G devices with their built in 8K capabilities can simplify the Live workflow, and how it can accelerate the 8K VR deployments.
Publication Date: 2020-11-10
DOI: 10.5594/M001910
Link: https://doi.org/10.5594/M001910
Author(s): Mauricio AracenaVRIF President, Virtual Reality Industry Forum / Ericsson AB
Thierry FautierVP Video Strategy, Harmonic, Virtual Reality Industry Forum / Harmonic Inc.
Ozgur OymanVRIF Guidelines WG Chair, Virtual Reality Industry Forum / Intel Corporation
Keyword(s): Live VR, 360° Video, Volumetric Video, VR Workflows, 8K, 5G, OMAF
Copyright: © 2020 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

ISO.23090-2 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23090-2, “Information Technology—Coded Representation of Immersive Media (MPEG-I)—Part 2: Omnidirectional Media Format (OMAF).” EXTERNAL
ISO.23090-5 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23090-5, “Visual Volumetric Video-Based Coding (V3C) and Video-Based Point Cloud Compression (V-PCC).” EXTERNAL
ISO.23090-10 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23090-10, “Carriage of Visual Volumetric Video-Based Coding Data.” EXTERNAL
K. Kammachi-Sreedhar, I. Curcio, A. Hourunranta and M. Lepistö, "Immersive Media Experience with MPEG OMAF Multi-Viewpoints and Overlays,," ACM Multimedia Systems Conference, 8-11 June 2020, Istanbul, Turkey. EXTERNAL
T. Fautier. and E. Mazieres, "8K Experiment at Roland Garros 2019," France TV Labs, May 2019, https://www.francetelevisions.fr/lab/projets/8K-Experiment-at-Roland-Garros-2019. EXTERNAL
Harmonic, "DASH CMAF LLC to Play Pivotal Role in Enabling Low Latency Video Streaming," December 2018, https://info.harmonicinc.com/white-paper/dash-cmaf-role-in-enabling-low-latency-video-streaming/. EXTERNAL
EBU, "5G for the Distribution of Audiovisual Media Content and Services," Tech Report 054, June, 2020. https://tech.ebu.ch/publications/tr054. EXTERNAL
M. M. Hannuksela and Y.-K. Wang, "An overview of Omnidirectional MediA Format (OMAF)," submitted to Proceedings of the IEEE. EXTERNAL
"DASH Industry Forum Guidelines," https://dashif.org/guidelines/. EXTERNAL
Virtual Reality Industry Forum (VRIF), "VRIF Guidelines 2.2," June 2020, https://www.vr-if.org/wp-content/uploads/VRIF_Guidelines-2.2.pdf. EXTERNAL
I. Curcio, K. Kammachi-Sreedhar and S. Mate, "Multi-Viewpoint and Overlays in the MPEG OMAF Standard," ITU Journal: ICT Discoveries, Vol. 3(1), 18 May 2020. EXTERNAL
Virtual Reality Industry Forum (VRIF), "VRIF Guidelines," available at: https://www.vr-if.org/guidelines. EXTERNAL
Harmonic, "EyeQ: Achieving Superior Viewing Experience," March 2016, https://info.harmonicinc.com/technical-guide/achieving-superior-viewing-experience/. EXTERNAL
T. Fautier, Harmonic, "8K Is Making Progress Bit by Bit," November 2019 https://www.harmonicinc.com/insights/blog/8k-making-progress. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001910.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Mauricio Aracena, Thierry Fautier, and Ozgur Oyman; Live VR end-to-end workflows: real-life deployments and advances in VR and network technology, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at https://doi.org/10.5594/M001910

Snippet:

Mauricio Aracena, Thierry Fautier, and Ozgur Oyman; Live VR end-to-end workflows: real-life deployments and advances in VR and network technology, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at https://doi.org/10.5594/M001910

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Mauricio Aracena, Thierry Fautier, and Ozgur Oyman; <cite>Live VR end-to-end workflows: real-life deployments and advances in VR and network technology</cite>, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/M001910" target="_blank" rel="noopener">https://doi.org/10.5594/M001910</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Mauricio Aracena, Thierry Fautier, and Ozgur Oyman; <cite id="bib-10-5594-m001910">Live VR end-to-end workflows: real-life deployments and advances in VR and network technology</cite>, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020
<span class="doi">10.5594/M001910</span>
</li>