Solving the Challenge of Volumetric Video Production and Streaming: An End-to-end Perspective of Technologies and Device Ecosystem Capabilities and Performance

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2022, No. 10, pp. 1–24
Abstract: Volumetric models and assets are great elements for content creators to use in the development of appealing immersive experiences. We can think about live sport events with the entire scene captured as volumetric elements and streamed to the mobile devices of thousands of consumers. However, distribution to consumers of high-quality immersive experiences using volumetric assets has been challenged by a number of factors including visual fidelity, bandwidth, latency, and device processing power. Content creators have been constrained from expressing the full potential intended for their original experience. In this paper you will learn about methods to stream volumetric video assets from an end-to-end perspective including an overview of production systems and suitable volumetric compression profiles (using point cloud compression) that can be used to render on any display for a wider reach: VR headsets, AR glasses, and flat screens. An ecosystem overview with device capabilities and performance is presented, and further included an analysis of content and end-user security functionality. Finally, this paper explores the evolution and opportunities of volumetric video streaming using 5G Cloud/Edge infrastructure to process and distribute volumetric content to any device, minimizing device processor power consumption, minimizing overall delay, and providing the best possible user experience.
Publication Date: 2022-10-24
DOI: 10.5594/M001980
ISBN: Print: 978-1-61482-963-8
Link: https://doi.org/10.5594/M001980
Author(s): Mauricio AracenaVRIF President, Virtual Reality Industry Forum (VRIF)/ Ericsson AB
Mick ODohertyTechnology Partner Manager, Irdeto
Oliver SchreerHead of Immersive Media & Communication Group, Fraunhofer Heinrich Hertz Institute (HHI)
Sebastian SchwarzResearch Leader, Nokia Technologies
Copyright: © 2022 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

"ISO/IEC 23090-5:2021 Information technology — Coded representation of immersive media — Part 5: Visual volumetric video-based coding (V3C) and video-based point cloud compression (V-PCC)". EXTERNAL
Fraunhofer HHI, "Volumetric video capture and production," Tdoc S4-190368, 3GPP TSG-SA4 103rd meeting, Newport Beach, CA, USA, April 2019. EXTERNAL
Virtual Reality Industry Forum (VRIF): Volumetric Video Guidelines. https://www.vr-if.org/guidelines/. EXTERNAL
F. Alriksson, D. Kang, C. Philips, J. Pradas, A Zaidi. "Ericsson Technology Review: Extended Reality and 5G," [Online]. Available: https://www.ericsson.com/4a492d/assets/local/reports-papers/ericsson-technology-review/docs/2021/xr-and-5g-extended-reality-at-scale-with-time-critical-communication.pdf. EXTERNAL
"ISO/IEC 23090-10 Information technology — Coded representation of immersive media — Part 10: Carriage of visual volumetric video-based coding data". EXTERNAL
"ISO/IEC 23009-1:2019, Information technology — Dynamic adaptive streaming over HTTP (DASH) — Part 1: Media presentation description and segment formats". EXTERNAL
S. Schwarz, M. Pesonen. "Real-Time decoding and AR payback of the emerging MPEG Video-Bases Point Cloud Compression Standard," [Online]. Available: https://www.ibc.org/real-time-decoding-and-ar-playback-of-the-emerging-mpeg-video-based-point-cloud-compression-standard/5062.article. EXTERNAL
"ISO/IEC 23008-2:2020 Information technology — High efficiency coding and media delivery in heterogeneous environments — Part 2: High efficiency video coding". EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001980.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Mauricio Aracena, Mick ODoherty, Oliver Schreer, and Sebastian Schwarz; Solving the Challenge of Volumetric Video Production and Streaming: An End-to-end Perspective of Technologies and Device Ecosystem Capabilities and Performance, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at https://doi.org/10.5594/M001980

Snippet:

Mauricio Aracena, Mick ODoherty, Oliver Schreer, and Sebastian Schwarz; Solving the Challenge of Volumetric Video Production and Streaming: An End-to-end Perspective of Technologies and Device Ecosystem Capabilities and Performance, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at https://doi.org/10.5594/M001980

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Mauricio Aracena, Mick ODoherty, Oliver Schreer, and Sebastian Schwarz; <cite>Solving the Challenge of Volumetric Video Production and Streaming: An End-to-end Perspective of Technologies and Device Ecosystem Capabilities and Performance</cite>, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at <a href="https://doi.org/10.5594/M001980" target="_blank" rel="noopener">https://doi.org/10.5594/M001980</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Mauricio Aracena, Mick ODoherty, Oliver Schreer, and Sebastian Schwarz; <cite id="bib-10-5594-m001980">Solving the Challenge of Volumetric Video Production and Streaming: An End-to-end Perspective of Technologies and Device Ecosystem Capabilities and Performance</cite>, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8
<span class="doi">10.5594/M001980</span>
</li>