The Evolution of Delivering Immersive Media Over 5G/Cloud

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 133, No. 3, pp. 35–46
Abstract: Aspects of the 5G ecosystem, now deployed in 3GPP releases 17/18/19, include split processing and edge computing resources. These can be enlisted to offload the manipulation and rendering of immersive datasets, thereby reducing the burden on the mobile device. Instead, the mobile device receives only the rendered video for one or both eyes, ready-made for display by the headset. Key design criteria for 5G connectivity to near-edge compute resources have been established based, in large part, on augmented and mixed reality use cases that rely on network slicing and quality of service (QoS) management, impose limits on bidirectional communication latencies, and establish minimum requirements for the compute resources themselves. Additionally, the 5G system is becoming “XR aware” with a specific feature for XR offloading. These features provide the proper network requirements and additional intelligence to consider device power and capacity considerations critical to scaling the deployment of XR services. This paper describes the evolution of XR applications from merely delivering media over 5G to how to utilize 5G cloud/edge infrastructure best to process and distribute advanced immersive experiences and content to lightweight, wireless, head-mounted displays. Critical use cases impose precise network requirements, and how those are met in 5G is examined. Lastly, potential relationships within the stakeholder ecosystem are presented, all to guide content providers (developers and service providers) through the paradigm shift from device-centric to network-centric XR services.
Publication Date: 2024-05-01
DOI: 10.5594/JMI.2024/DHPI3162
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2024/DHPI3162
Author(s): Mauricio Aracena
Bill Redmann
Du Ho Kang
Louay Bassbouss
Sebastian Schwarz
Keyword(s): 5G, Virtual Reality, Augmented Reality, Mixed Reality, VR, AR, MR, Immersive Audio
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

S. Schmidt, “Assessing the Quality of Experience of Cloud Gaming Services,” Springer International Publishing, 2022. EXTERNAL
M. Aracena, M. O'Doherty, O. Schreer, S. Schwarz, “Solving the Challenge of Volumetric Video Production and Streaming: An End-to-end Perspective of Technologies and Device Ecosystem Capabilities and Performance,” presented at the SMPTE 2022 Media Technology Summit, Hollywood, CA, Oct. 2022. EXTERNAL
S. Dhelim, T. Kechadi, L. Chen, N. Aung, H. Ning, L. Atzori, “Edge-enabled Metaverse: The Convergence of Metaverse and Mobile Edge Computing,” 2022, arXiv preprint arXiv:2205.02764. EXTERNAL
“ETSI TR 126 928 V16.0.0 (2020–11)-5G; Extended Reality (XR) in 5G (3GPP TR 26.928 version 16.0.0 Release 16)”. EXTERNAL
Internations Organization for Standardization/International Electrotechnical Commision (ISO/IEC) “ISO/IEC 23090–5:2021(en) Information technology-Coded representation of immersive media - Part 5: Visual volumetric video-based coding (V3C) and video-based point cloud compression (V-PCC)”. EXTERNAL
F. Alriksson, D. Kang, C. Phillips, J. Pradas, A. Zaidi, “XR and 5G: Extended reality at scale with 5G networks - Ericsson,” [Online]. Available: https://www.ericsson.com/en/reports-and-papers/ericsson-technology-review/articles/xr-and-5g-extend-ed-reality-at-scale-with-time-critical-communication. EXTERNAL
The 3rd Generation Partnership Program (3GPP), “3GPP ETSI TR 38.838 Study on XR (Extended Reality) evaluations for NR,” [Online]. Available: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specification-Id=3736. EXTERNAL
The 3rd Generation Partnership Program (3GPP), “3GPP ETSI TR 38.835 Study on XR enhancements for NR,” [Online]. Available: https://portal.3gpp.org/desktop-modules/Specifications/SpecificationDetails.aspx?specificationld=4048. EXTERNAL
The 3rd Generation Partnership Program (3GPP), “3GPP ETSI RP 230786 Updated WID on XR Enhancements for NR,” [Online]. Available: https://www.3gpp.org/ftp/TSG_RAN/TSG_RAN/TSGR_99/Docs/RP-230786.zip. EXTERNAL
“Enable innovation with open network exposure,” Ericsson. [Online]. Available: https://www.ericsson.com/en/core-network/network-exposure. EXTERNAL
“CAMARA: Telco Global API Alliance,” GSMA. [Online]. Available: https://www.gsma.com/futurenetworks/ip_services/understanding-5g/camara-telco-glob-al-api-alliance/. EXTERNAL
F. Alriksson, D. Kang, C. Philips, J. Pradas, A Zaidi, “Technology Review: Extended Reality and 5G,” Ericsson [Online]. Available: https://www.ericsson.com/4a492d/assets/local/reports-papers/ericsson-technology-review/docs/2021/xr-and-5g-ex-tended-reality-at-scale-with-time-critical-communication.pdf. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2024-DHPI3162.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Mauricio Aracena, Bill Redmann, Du Ho Kang, Louay Bassbouss, and Sebastian Schwarz; The Evolution of Delivering Immersive Media Over 5G/Cloud, MIJ 2024, Volume 133, Number 3 (pp. 35 to 46); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/DHPI3162

Snippet:

Mauricio Aracena, Bill Redmann, Du Ho Kang, Louay Bassbouss, and Sebastian Schwarz; The Evolution of Delivering Immersive Media Over 5G/Cloud, MIJ 2024, Volume 133, Number 3 (pp. 35 to 46); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/DHPI3162

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Mauricio Aracena, Bill Redmann, Du Ho Kang, Louay Bassbouss, and Sebastian Schwarz; <cite>The Evolution of Delivering Immersive Media Over 5G/Cloud</cite>, MIJ 2024, Volume 133, Number 3 (pp. 35 to 46); SMPTE, 2024. Available at <a href="https://doi.org/10.5594/JMI.2024/DHPI3162" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2024/DHPI3162</a></span>

SMPTE's HTML Pub

Preview:

Mauricio Aracena, Bill Redmann, Du Ho Kang, Louay Bassbouss, and Sebastian Schwarz; The Evolution of Delivering Immersive Media Over 5G/Cloud, MIJ 2024, Volume 133, Number 3 (pp. 35 to 46); SMPTE, 2024
doi: 10.5594/JMI.2024/DHPI3162
url: https://doi.org/10.5594/JMI.2024/DHPI3162

Snippet:

<li>
Mauricio Aracena, Bill Redmann, Du Ho Kang, Louay Bassbouss, and Sebastian Schwarz; <cite id="bib-10-5594-jmi-2024-dhpi3162">The Evolution of Delivering Immersive Media Over 5G/Cloud</cite>, MIJ 2024, Volume 133, Number 3 (pp. 35 to 46); SMPTE, 2024
<span class="doi">10.5594/JMI.2024/DHPI3162</span>
</li>