Optimizing Mass-Scale Multi-Screen Video Delivery

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 129, No. 3, pp. 26–38
Abstract: We discuss the design of a mass-scale streaming video delivery system, targeting devices with different decoding, playback, and network capabilities. This system incorporates several advanced tools: dynamic packaging, dynamic devices detection, dynamic manifest generation, rules engine, analytics engine, and context-aware encoding (CAE). We explain how this system is implemented using the current cloud computing and content delivery network platforms and how it is tuned to achieve optimal end-to-end performance, delivering the best possible user experience with minimized transcoding, bandwidth, and storage costs.
Publication Date: 2020-04-01
DOI: 10.5594/JMI.2020.2973561
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2020.2973561
Author(s): Yuriy Reznik
bio
Yuriy Reznik is a technology fellow and head of research at Brightcove. Previously, he worked at RealNetworks, InterDigital, and Qualcomm, and contributed to a number of well-known standards (ITU-T H.264/MPEG-4 AVC, ITU-T H.265/MPEG HEVC, MPEG DASH, etc.) as well as products in the domains of internet streaming and wireless multimedia. He received his PhD degree in computer science from Kiev University, Kiev, Ukraine, and was also a visiting scholar at Stanford University, Stanford, CA. He has co-authored more than 100 academic articles and co-invented more than 60 granted U.S. patents related to his studies and work.
Xiangbo Li
bio
Xiangbo Bill Li is a research engineer at Brightcove. He is working on streaming performance analysis, advanced analytics, and end-to-end optimizations. He holds a PhD degree in computer science from the University of Louisiana at Lafayette, Lafayette, LA. He is a coauthor of 12 academic articles and several U.S. patent applications.
Karl Lillevold
bio
Karl Lillevold is a distinguished engineer at Brightcove. He is leading the work on context-aware encoding and other advanced video compression technologies in Brightcove products. Previously, he worked at Telenor Research, Intel, and RealNetworks, and contributed to several generations of video coding standards (MPEG-2 H.263, H.26L/H.264/AVC), as well as to the family of RealVideo codecs used in pioneering products for internet streaming. He holds an MS degree in electrical engineering from the Norwegian Institute of Technology, Trondheim.
Robert Peck
bio
Robert Peck is an engineering manager at the Brightcove Arizona office, working on the Brightcove Dynamic Delivery platform focusing on its Service Side Ad Insertion capabilities. Prior to joining Brightcove, he worked at Limelight Networks on their content delivery network configuration application programming interface. He graduated from Arizona State University, Tempe, AZ with a BSc degree in computer science.
Thom Shutt
bio
Thom Shutt is an engineering manager at Brightcove, U.K., working on the Dynamic Delivery and Delivery Rules projects. Shutt has previously worked as a video engineer for the British Broadasting Corp., building out the next generation of their “iPlayer” platform.
Peter Howard
bio
Peter Howard is a solutions engineer for Brightcove, ANZ. He supports a variety of customers, with a particular focus on over-the-top (OTT) delivery, both ad-supported and subscription-based, across live and premium video-on-demand (VOD). He works to identify solutions that can scale, while finding the best fit for business and user needs.
Keyword(s): Adaptive Bitrate Streaming, Cloud-based Video Processing, Context-aware Encoding, End-to-end Optimizations, OTT
Copyright: © 2020 SMPTE

Bibliographic Reference(s)

ISO/IEC 13818-1:2019 [Withdrawn]
ISO/IEC 14496-10 [Active]
ISO.14496-12.2015 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 14496-12:2015, “Information Technology—Coding of Audio–Visual Objects—Part 12: ISO Base Media File Format,” 2015. EXTERNAL
ISO.23000-19.2018 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23000-19:2018, “Information Technology—Coding of Audio–Visual Objects— Part 19: Common Media Application Format (CMAF) for Segmented Media,” Jan. 2018. EXTERNAL
ISO/IEC 23008-2 [Active]
ISO.23009-1.2012 — ISO/IEC 23009-1:2012, Information Technology-Dynamic Adaptive Streaming Over HTTP (DASH)-Part 1: Media Presentation Description and Segment Formats. EXTERNAL
G. J. Conklin, G. S. Greenbaum, K. O. Lillevold, A. F. Lippman, and Y. A. Reznik, “Video Coding for Streaming Media Delivery on the Internet,” IEEE Trans. Circuits Syst. Video Technol., 11(3):269–281, Mar. 2001. EXTERNAL
Y. A. Reznik, X. Li, K. O. Lillevold, A. Jagannath, and J. Greer, “Optimal Design of Multi-codec Profiles for ABR Streaming,” in Proc. IEEE Int. Conf. Multimedia Expo (ICME’2019), Shanghai, China, 8–12, pp. 348–353, Jul. 2019. EXTERNAL
R. Pantos and W. May, “HTTP Live Streaming, RFC 8216,” Aug. 2017. [Online]. Available: https://tools.ietf.org/html/rfc8216 EXTERNAL
Z. Wang, A. Bovik, H. Sheikh, and E. Simoncelli, “Image Quality Assessment: From Error Visibility to Structural Similarity,” IEEE Trans. Image Process., 13(4):600–612, Apr. 2004. EXTERNAL
Y. A. Reznik, K. O. Lillevold, A. Jagannath, J. Greer, and J. Corley, “Optimal Design of Encoding Profiles for ABR Streaming,” Proc. 23rd Packet Video Workshop (PV’2018), Amsterdam, The Netherlands, pp. 43–47, Jun. 2018. EXTERNAL
“PlayReady.” [Online]. Available: https://www.microsoft.com/playready/overview/ EXTERNAL
“Microsoft Smooth Streaming.” [Online]. Available: https://www.iis.net/downloads/microsoft/smooth-streaming EXTERNAL
Ultra HD Forum, “Ultra HD Forum Phase B Guidelines,” Apr. 2018. [Online]. Available: https://ultrahdforum.org/wp-content/uploads/Ultra-HD-Forum-Phase-B-Guidelines-v1.0.pdf EXTERNAL
Apple Inc., “HLS Authoring Specification for Apple Devices,” Sep. 2018. [Online]. Available: https://developer.apple.com/documentation/http_live_streaming/hls_authoring_specification_for_apple_devices EXTERNAL
C. Chen, Y. Lin, S. Benting, and A. Kokaram, “Optimized Transcoding for Large Scale Adaptive Streaming Using Playback Statistics,” Proc. 25th IEEE Int. Conf. Image Processing (ICIP), Athens, pp. 3269–3273, Oct. 2018. EXTERNAL
A. Aaron, Z. Li, M. Manohara, J. De Cock, and D. Ronca, “Per-Title Encode Optimization,” 15 Dec. 2015. [Online]. Available: https://medium.com/netflix-techblog/per-title-encode-optimization-7e99442b62a2 EXTERNAL
Worldwide Web Consortium (W3C), “Media Source Extensions.” [Online]. Available: https://www.w3.org/TR/media-source/ EXTERNAL
“Widevine.” [Online]. Available: https://www.widevine.com/solutions/widevine-drm EXTERNAL
“FairPlay Streaming.” [Online]. Available: https://developer.apple.com/streaming/fps/ EXTERNAL
Worldwide Web Consortium (W3C), “Encrypted Media Extensions.” [Online]. Available: https://www.w3.org/TR/encrypted-media/ EXTERNAL
D. Wu, Y. T. Hou, W. Zhu, Y.-Q. Zhang, and J. M. Peha, “Streaming Video Over the Internet: Approaches and Directions,” IEEE Trans. Circuits Syst. Video Technol., 11(3):282–300, Mar. 2001. EXTERNAL
J. Ozer, “Encoding for Multiple Devices,” Streaming Media Magazine, Mar. 2013. [Online]. Available: http://www.streamingmedia.com/Articles/ReadArticle.aspx?ArticleID=88179&fb_comment_id=220580544752826_937649 EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2020.2973561.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Yuriy Reznik, Xiangbo Li, Karl Lillevold, Robert Peck, Thom Shutt, and Peter Howard; Optimizing Mass-Scale Multi-Screen Video Delivery, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 3, April 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.2973561

Snippet:

Yuriy Reznik, Xiangbo Li, Karl Lillevold, Robert Peck, Thom Shutt, and Peter Howard; Optimizing Mass-Scale Multi-Screen Video Delivery, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 3, April 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.2973561

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Yuriy Reznik, Xiangbo Li, Karl Lillevold, Robert Peck, Thom Shutt, and Peter Howard; <cite>Optimizing Mass-Scale Multi-Screen Video Delivery</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 3, April 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/JMI.2020.2973561" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2020.2973561</a></span>

SMPTE's HTML Pub

Preview:

Yuriy Reznik, Xiangbo Li, Karl Lillevold, Robert Peck, Thom Shutt, and Peter Howard; Optimizing Mass-Scale Multi-Screen Video Delivery, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 3, April 2020); SMPTE, 2020
doi: 10.5594/JMI.2020.2973561
url: https://doi.org/10.5594/JMI.2020.2973561

Snippet:

<li>
Yuriy Reznik, Xiangbo Li, Karl Lillevold, Robert Peck, Thom Shutt, and Peter Howard; <cite id="bib-10-5594-jmi-2020-2973561">Optimizing Mass-Scale Multi-Screen Video Delivery</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 3, April 2020); SMPTE, 2020
<span class="doi">10.5594/JMI.2020.2973561</span>
</li>

Referenced By

Performance of Low-Latency DASH and HLS Streaming in Mobile Networks [Active]
Toward Efficient Multicodec Streaming [Active]
Towards Efficient Multi-Codec Streaming [Active]
Improving Context-Aware Encoding by Adaptation to “True Resolution” of the Content [Active]
Simplifying Multi-CDN Delivery with HLS / DASH Content Steering [Active]