State of the Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2017, No. 10, pp. 1–13
Abstract: VR 360 video applications typically require bandwidths of at least 15 Mb/s to 20 Mb/s while providing limited video quality. This is because users only observe a small part of the VR panorama at any time; about 12 to 15 percent. But, the full panorama needs to be provided to users on a continuous basis. — This paper summarizes the state-of-the-art in VR streaming, detailing how Tiled VR streaming technology can reduce bandwidth requirements by an order of magnitude while improving video quality. This is achieved by dividing a VR panorama into “tiles” and streaming only those tiles that users actually look at while wearing head-mounted displays (HMDs). This solution is based on HEVC tiling features as well as the DASH extension. — A major challenge for any viewport dependent VR streaming technology is motion-to-photon delay. Using a combination of selective tile transfer, a low-resolution base layer, smart packaging, and very low-latency protocols, Tiled VR streaming can offer extremely low motion-to-photon delay even when streaming from existing CDNs. This paper will conclude by showing the trade-offs between quality and bitrate when tiling from 4K or 8K sources to produce HD and UHD experiences respectively on HMDs, based on field trials and realistic use cases.
Publication Date: 2017-10-23
DOI: 10.5594/M001760
ISBN: Print: 978-1-61482-959-1
Link: https://doi.org/10.5594/M001760
Author(s): Thierry FautierHarmonic, San Jose California, USA
Keyword(s): 360° Video, Virtual Reality, Streaming, Viewport Dependent Streaming, Tile-based
Copyright: © 2017 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

IEC.14496-10.2014 — ISO/IEC JTC1 SC29 WG11 (MPEG), SO/IEC 14496-10:2014 Information technology -- Coding of audio-visual objects -- Part 10: Advanced Video Coding, EXTERNAL
ISO/IEC 23008-2 [Active]
ISO.23009-1.2014 — ISO/IEC 23009-1:2014, Information Technology-Dynamic Adaptive Streaming Over HTTP (DASH)-Part 1: Media Presentation Description and Segment Formats. EXTERNAL
Wikipedia, “Vestibulo–ocular reflex” https://en.wikipedia.org/wiki/Vestibulo%E2%80%93ocular_reflex. EXTERNAL
Kuzyakov E, Pio D “Next-generation video encoding techniques for 360 video and VR”, https://code.facebook.com/posts/1126354007399553/next-generation-video-encoding-techniques-for-360-video-and-vr/ EXTERNAL
https://www.chromium.org/quic EXTERNAL
Munster G, Jakel T, Clinton D, Murphy E, “Next mega tech theme is virtual reality”, Piper Jaffray Investment Research, May 2015. EXTERNAL
Wikipedia, “Screen-door effect”, https://en.wikipedia.org/wiki/Screen-door_effect. EXTERNAL
Belson D, “Akamai’s state of the Internet, Q3 2016 report”, https://content.akamai.com/PG7659-q3-2016-state-of-the-internet-connectivity-report.html. EXTERNAL
Kuzyakov E, Pio D, “Under the hood: Building 360 video”, https://code.facebook.com/posts/1638767863078802/under-the-hood-building-360-video/, October 2015. EXTERNAL
IETF RFC 7540 [Superseded*]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001760.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Thierry Fautier; State of the Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1. Available at https://doi.org/10.5594/M001760

Snippet:

Thierry Fautier; State of the Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1. Available at https://doi.org/10.5594/M001760

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Thierry Fautier; <cite>State of the Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality</cite>, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1. Available at <a href="https://doi.org/10.5594/M001760" target="_blank" rel="noopener">https://doi.org/10.5594/M001760</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Thierry Fautier; <cite id="bib-10-5594-m001760">State of the Art Virtual Reality Streaming: Solutions for Reducing Bandwidth and Improving Video Quality</cite>, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1
<span class="doi">10.5594/M001760</span>
</li>