Optimized pixel streaming for ultra-low latency cloud gaming and VR/XR applications.

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2023, No. 10, pp. 14–15
Abstract: Until recently, top-notch gaming and XR/VR experiences required costly hardware with powerful GPUs. Today's cloud-based solutions aim to make these experiences more accessible by rendering the experience in the cloud and then “pixel streaming” - i.e., with one video encoding per each user - the point of view, but doing so hinges on delivering high-quality, ultra-low latency video, so compression efficiency is a core component of these applications. — While traditional codecs like H.264 and HEVC are currently used, they have limitations in cloud gaming and VR/XR scenarios. Newer codecs like AV1 and VVC offer better compression but are computationally heavy and produce lower gains vs HEVC in real-time ultra-low-latency applications. Enter MPEG-5 Part 2 LCEVC, a low-complexity enhancement that improves compression up to 30% when used with existing codecs like HEVC, AV1 or VVC, without adding computational burden and with coding tools that maintain their efficiency also in low-latency scenarios. Compatible with existing devices and codecs like HEVC, AV1, and VVC, LCEVC enables scalable, high-quality pixel streaming within the bandwidth limits necessary for widespread deployment. — This paper provides data on LCEVC's performance in conjunction with HEVC, specifically focusing on its application in ultra-low latency streaming for cloud gaming and VR/XR, where quality and responsiveness are key.
Publication Date: 2023-10-16
DOI: 10.5594/M002023
ISBN: Print: 978-1-61482-964-5
Link: https://doi.org/10.5594/M002023
Author(s): Guido MeardiV-Nova Limited
Kevin MockfordV-Nova Limited
Keyword(s): Cloud Gaming, VR, Extended Reality, MPEG-5 LCEVC, AV1, VVC, HEVC, H.264
Copyright: © 2023 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

ISO.23094-2 — ISO/IEC 23094-2 information technology – General video coding – Part 2: “Low complexity enhancement video coding,” 2021-10 EXTERNAL
https://www.uploadvr.com/pico-4-vs-quest-2-specs-features/ EXTERNAL
Blog, Netflix Technology (2016-06-06). "Toward A Practical Perceptual Video Quality Metric". https://netflixtechblog.com/toward-a-practical-perceptual-video-quality-metric-653f208b9652 EXTERNAL
ITU Rec. P.910 Annex A https://www.itu.int/rec/T-REC-P.910/en EXTERNAL
https://developer.nvidia.com/video-codec-sdk EXTERNAL
Bjontegaard Delta-Rate Metric - Max Sharabayko Blog https://maxsharabayko.github.io/blog/posts/bd-rate/ EXTERNAL
Alliance for Open Media AV1 video codec, https://aomedia.org/av1/specification/ EXTERNAL
ITU-T REC H.264 [Active]
ITU-T REC H.265 [Active]
T-REC-H.266 — “Versatile video coding,” ITU-T Recommendation H.266 (04/22) [Online]. Availabe: https://www.itu.int/ITU-T/recommendations/rec.aspx?rec=14948&lang=en. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M002023.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Guido Meardi and Kevin Mockford; Optimized pixel streaming for ultra-low latency cloud gaming and VR/XR applications., SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002023

Snippet:

Guido Meardi and Kevin Mockford; Optimized pixel streaming for ultra-low latency cloud gaming and VR/XR applications., SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at https://doi.org/10.5594/M002023

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Guido Meardi and Kevin Mockford; <cite>Optimized pixel streaming for ultra-low latency cloud gaming and VR/XR applications.</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5. Available at <a href="https://doi.org/10.5594/M002023" target="_blank" rel="noopener">https://doi.org/10.5594/M002023</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Guido Meardi and Kevin Mockford; <cite id="bib-10-5594-m002023">Optimized pixel streaming for ultra-low latency cloud gaming and VR/XR applications.</cite>, SMPTE Meetings and Conferences ( October 2023); SMPTE, 2023, ISBN: 978-1-61482-964-5
<span class="doi">10.5594/M002023</span>
</li>