State-of-the-Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 127, No. 7, pp. 1–10
Abstract: Virtual reality (VR) 360 video applications typically require bandwidths of at least 15–20 Mbits/s while providing limited video quality. This is because users only observe a small part of the VR panorama at any time: about 12%–15%. But, the full panorama needs to be provided to users on a continuous basis. This paper summarizes the state of the art in VR streaming, detailing how tiled VR streaming technology can reduce bandwidth requirements by an order of magnitude while improving the video quality. This is achieved by dividing a VR panorama into tiles and streaming only those tiles that users actually look at while wearing head-mounted displays (HMDs). This solution is based on HEVC tiling features as well as the DASH extension. A major challenge for any viewport-dependent VR streaming technology is motion-to-photon delay. Using a combination of selective tile transfer, a low-resolution base layer, smart packaging, and very low-latency protocols, tiled VR streaming can offer extremely low motion-to-photon delay even when streaming from existing content delivery networks. This paper will conclude by showing the tradeoffs between quality and bitrate when tiling from 4K or 8K sources to produce HD and UHD experiences, respectively, on HMDs, based on field trials and realistic use cases.
Publication Date: 2018-08-01
DOI: 10.5594/JMI.2018.2842598
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2018.2842598
Author(s): Thierry Fautier
Keyword(s): Streaming, Tiling, Viewport Dependent Streaming, Virtual Reality, 360° Video
Copyright: © 2018 SMPTE

Bibliographic Reference(s)

ISO 14496-10:2014 [Withdrawn]
ISO/IEC 23008-2 [Active]
ISO.23009-1.2014 — ISO/IEC 23009-1:2014, Information Technology-Dynamic Adaptive Streaming Over HTTP (DASH)-Part 1: Media Presentation Description and Segment Formats. EXTERNAL
N. Duboz, “Medialab France Television,” [Online]. Available: https://www.francetelevisions.fr/lab/projets/le-journal-de-20h-en-360 EXTERNAL
E. Kuzyakov and D Pio, “Next-Generation Video Encoding Techniques for 360 Video and VR.” [Online]. Available: https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/ EXTERNAL
Wikipedia, “Vestibulo–Ocular Reflex.” [Online]. Available: https://en.wikipedia.org/wiki/Vestibulo%E2%80%93ocular_reflex EXTERNAL
[Online]. Available: https://www.chromium.org/quic EXTERNAL
E. Kuzyakov and D. Pio, “Under the Hood: Building 360 Video,” Oct. 2015. [Online]. Available: https://code.facebook.com/posts/1638767863078802/under-the-hood-building-360-video/ EXTERNAL
T. Fautier, “VP Video Strategy Harmonic,” [Online]. Available: https://www.harmonicinc.com/news-events/press-releases/read/harmonic-blue-man-group-team-offer-stunning-native-uhd-360-degree-vr-experience-2017-nab-show/ EXTERNAL
Wikipedia, “Screen-Door Effect.” [Online]. Available: https://en.wikipedia.org/wiki/Screen-door_effect EXTERNAL
G. Munster et al., “Next Mega Tech Theme Is Virtual Reality,” Piper Jaffray Investment Research, May 2015. EXTERNAL
D. Belson, “Akamai’s State of the Internet, Q3 2016 Report.” [Online]. Available: https://content.akamai.com/PG7659-q3-2016-state-of-the-internet-connectivity-report.html EXTERNAL
IETF RFC 7540 [Superseded*]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2018.2842598.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Thierry Fautier; State-of-the-Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2842598

Snippet:

Thierry Fautier; State-of-the-Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2842598

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Thierry Fautier; <cite>State-of-the-Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality</cite>, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018. Available at <a href="https://doi.org/10.5594/JMI.2018.2842598" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2018.2842598</a></span>

SMPTE's HTML Pub

Preview:

Thierry Fautier; State-of-the-Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018
doi: 10.5594/JMI.2018.2842598
url: https://doi.org/10.5594/JMI.2018.2842598

Snippet:

<li>
Thierry Fautier; <cite id="bib-10-5594-jmi-2018-2842598">State-of-the-Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality</cite>, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 7, August 2018); SMPTE, 2018
<span class="doi">10.5594/JMI.2018.2842598</span>
</li>