Transitioning Broadcast to Cloud
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 130, No. 9, pp. 18–32
- Abstract
- We analyze the differences between on-premise broadcast and cloud-based online video delivery workflows and identify means needed for bridging the gaps between them. Specifically, we note differences in the ingest protocols, media formats, signal-processing chains, codec constraints, metadata, transport formats, delays, and means for implementing operations such as ad-splicing, redundancy, and synchronization. To bridge the gaps, we suggest specific improvements in cloud ingest, signal processing, and transcoding stacks. Cloud playout is also identified as a critically needed technology for convergence. Finally, based on all such considerations, we offer sketches of several possible hybrid architectures, with varying degrees of offloading of processing in the cloud, which are likely to emerge in the future.
- Publication Date
- 2021-10-01
- DOI
10.5594/JMI.2021.3106162- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2021.3106162
- Author(s)
- Yuriy Reznik
bio
Yuriy Reznik is a technology fellow and the vice president of research at Brightcove, Inc., Boston, MA. Previously, he held engineering and management positions at InterDigital, San Diego, CA, from 2011 to 2016, Qualcomm, San Diego, from 2005 to 2011, and RealNetworks, Seattle, WA, from 1998 to 2005. In 2008, he was a visiting scholar at Stanford University, Stanford, CA. Since 2001, he has also been involved in the work of the ITU-T SG16 and MPEG standards committees and has made contributions to several multimedia coding and delivery standards, including ITU-T H.264/MPEG-4 AVC, MPEG-4 ALS, ITU-T G.718, ITU-T H.265/MPEG HEVC, and MPEG-DASH. Several technologies, standards, and products that he has helped to develop (RealAudio/RealVideo, ITU-T H.264/MPEG-4 AVC, Zencoder, and Brightcove CAE) have been recognized by the NATAS Technology & Engineering Emmy Awards. He holds a PhD degree in computer science from Kyiv University, Kyiv, Ukraine. He is a senior member of IEEE and SPIE and a member of the ACM, AES, and SMPTE. He is a co-author of over 120 conference and journal papers and co-inventor of over 70 granted US patents.Jordi Cenzanobio
Jordi Cenzano is an engineer specializing in broadcast and online media. He is currently working on the live ingest pipeline optimization at Facebook. He previously worked as a director of engineering at Brightcove, Inc., Boston, MA, and was a principal architect of Brightcove Live streaming workflow. For over 20 years, he has been working in the media space, starting on the broadcast side, and moving to the online media. He holds an MS degree in information and communication technologies and a BS degree in telecommunications from Universitat Politécnica de Catalunya, Catalunya, Spain, in 2013 and 1997, respectively.Bo Zhangbio
Bo Zhang is a video systems engineer at the Brightcove Research team. He works on researching video delivery and playback technologies and building high-quality, smooth, scalable, and low-latency video streaming software. He has published several research papers in the domains of video streaming and wireless communications. He has a PhD degree from George Mason University, Fairfax, VA, an MS degree from the University of Cincinnati, Cincinnati, OH, and a BS degree from Huazhong University of Science and Technology, Wuhan, China, all in computer science. He was the recipient of the best paper award from ACM MSWiM 2011. - Keyword(s)
- Broadcast, Cloud-based Video Streaming, Cloud Playout, Internet Media Streaming, OTT, Video Coding
- Copyright
- © 2021 SMPTE
Bibliographic Reference(s)
- Saving Bits—The Impact of MCTF Enhanced Noise Reduction [Active]
- Statistical Multiplexing of Multiple MPEG-2 Video Programs in a Single Channel [Active]
- Cloud Technology Drives Superior Video Encoding [Active]
- CTA.5001 — Consumer Technology Association (CTA) 5001, “Web Application Video Ecosystem—Content Specification,” CTA WAVE, Apr. 2018. [Online]. Available: https://cdn.cta.tech/cta/media/media/resources/standards/pdfs/cta-5001-final_v2_pdf.pdf EXTERNAL
- ETSI TS 101 154 V1.9.1 [Superseded]
- ETSI.TS-102-796 — European Telecommunications Standards Institute (ETSI), TS 102 796, “Hybrid Broadcast Broadband TV—Version 1.4.1,” Aug. 2016. EXTERNAL
- ETSI.TS-103-285 — ETSI TS 103 285 v1.2.1, “Digital Video Broadcasting (DVB); MPEG-DASH Profile for Transport of ISO BMFF Based DVB Services Over IP Based Networks,” Feb. 2020. [Online]. Available: https://www.etsi.org/deliver/etsi_ts/103200_103299/103285/01.03.01_60/ts_103285v010301p.pdf EXTERNAL
- IEC 61966-2-1:1999 [Active, Amended]
- ISO/IEC 13818-1:2019 [Withdrawn]
- ISO 13818-2:2013 [Active]
- ISO/IEC 14496-10 [Active]
- ISO.14496-12.2015 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 14496-12:2015, “Information Technology—Coding of Audio–Visual Objects—Part 12: ISO Base Media File Format,” 2015. EXTERNAL
- ISO.23000-19.2018 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 23000-19:2018, “Information Technology—Coding of Audio–Visual Objects— Part 19: Common Media Application Format (CMAF) for Segmented Media,” Jan. 2018. EXTERNAL
- ISO/IEC 23008-2 [Active]
- ISO.23009-1.2014 — ISO/IEC 23009-1:2014, Information Technology-Dynamic Adaptive Streaming Over HTTP (DASH)-Part 1: Media Presentation Description and Segment Formats. EXTERNAL
- OC-SP-EP-I01-130118, “Encoder Boundary Point Specification,” Cable Television Laboratories, Inc., Jan. 2013. EXTERNAL
- A. Luther and A. Inglis, Video Engineering, 3rd ed., McGraw-Hill: New York, 1999, 549p. EXTERNAL
- Frost & Sullivan, “Analysis of the Global Online Video Platforms Market,” Frost & Sullivan, Jun. 2014. [Online]. Available: https://store.frost.com/analysis-of-the-global-online-video-platforms-market.html. See also: [Online]. Available: https://www.eweek.com/small-business/online-video-platform-market-to-top-800-million-by-2019 ■ This includes implementation of the statmux capability, generation, and insertion of all related program and system information, possible addition of datacast service capability, and so on. This architecture is indeed an extreme example, where pretty much all data- and processing-intensive operations are migrated to the cloud. It is most technically challenging to implement, but is also most promising, as it enables the best utilization of the cloud and all the benefits it brings. Conclusion In this paper, we studied the differences between onpremise broadcast and cloud-based online video delivery workflows and identified the means needed to bridge the gaps between them. These include improvements in cloud ingest, signal processing stacks, transcoder capabilities, and most importantly, a broadcast-grade cloud playout system. To implement a cloud playout system, we have suggested an architecture employing intra-only mezzanine format and associated processing blocks that can be easily replicated and operated in a fault-tolerant fashion. We finally considered possible evolutions of broadcast and cloud-based video systems and suggested several possible hybrid architectures, with different degrees of offloading of processing in the cloud, which are likely to emerge in the future. EXTERNAL
- Advanced Television Systems Committee (ATSC) A/72 Part 2:2014, “AVC Video Transport Subsystem Characteristics,” ATSC, Feb. 18, 2014. EXTERNAL
- T. Stockhammer et al., “Dash in ATSC 3.0: Bridging the Gap Between OTT and Broadcast,” IET Conf. Proc., pp. 24–24, 2016. EXTERNAL
- ID3 Tagging System. [Online]. Available: http://www.id3.org/id3v2.3.0 EXTERNAL
- FairPlay Streaming. [Online]. Available: https://developer.apple.com/streaming/fps/ EXTERNAL
- D. Wu et al., “Streaming Video Over the Internet: Approaches and Directions,” IEEE Trans. Circuits Syst. Video Technol., 11(3):282–300, Mar. 2001. EXTERNAL
- American National Standards Institute/Society of Cable and Telecommunications Engineers (ANSI/SCTE) 35 2007, “Digital Program Insertion Cueing Message for Cable,” SCTE, 2007. EXTERNAL
- Advanced Television Systems Committee (ATSC) A/53 Part 4:2009, “ATSC Digital Television Standard: Part 4—MPEG-2 Video System Characteristics,” ATSC, Aug. 7, 2009. EXTERNAL
- Apple, “Protocol Extension for Low-Latency HLS (Preliminary Specification),” Apple Inc., Feb. 2020. [Online]. Available: https://developer.apple.com/documentation/http_live_streaming/protocol_extension_for_low-latency_hls_preliminary_specification EXTERNAL
- Advanced Television Systems Committee (ATSC) A/65B, “Program and System Information Protocol for Terrestrial Broadcast and Cable (PSIP),” ATSC, Mar. 18, 2003. EXTERNAL
- L. Boroczky, A. Y. Ngai, and E. F. Westermann, “Statistical Multiplexing Using MPEG-2 Video Encoders,” IBM J. Res. Dev., 43(4):511–520, Jul. 1999. EXTERNAL
- Haivision, “Secure Reliable Transport (SRT),” Sep. 2019. [Online]. Available: https://github.com/Haivision/srt EXTERNAL
- Microsoft Smooth Streaming. [Online]. Available: https://www.iis.net/downloads/microsoft/smooth-streaming EXTERNAL
- Worldwide Web Consortium (W3C) IMSC1, “TTML Profiles for Internet Media Subtitles and Captions 1.0,” W3C, Aug. 2015. [Online]. Available: https://dvcs.w3.org/hg/ttml/raw-file/tip/ttml-ww-pro-33 files/ttml-ww-profiles.html EXTERNAL
- OpenCableSpecifications(OC-SP-)MEZZANINE-C01-161026, “Mezzanine Encoding Specification,” Cable Television Laboratories, Inc., Oct. 26, 2016. EXTERNAL
- Advanced Television Systems Committee (ATSC) A/331:2020, “Signaling, Delivery, Synchronization, and Error Protection,” ATSC, Jan. 2020. EXTERNAL
- Y. Reznik et al., “Optimal Design of Encoding Profiles for ABR Streaming,” Proc. Packet Video Workshop, Amsterdam, The Netherlands, Jun. 12, 2018. EXTERNAL
- S. Pizzi and G. Jones, A Broadcast Engineering Tutorial for Non-Engineers, 4th ed., National Association Broadcasters (NAB), Focal Press, Taylor & Francis Group: New York and London, 2014, 354p. EXTERNAL
- SMPTE, 2016-1, “Standard for Television—Format for Active Format Description and Bar Data,” SMPTE, 2007. EXTERNAL
- Advanced Television Systems Committee (ATSC) A/72 Part 1:2015, “Video System Characteristics of AVC in the ATSC Digital Television System,” ATSC, May 19, 2015. EXTERNAL
- AOM AV1, “AV1 Bitstream & Decoding Process Specification, v1.0.0,” Alliance for Open Media, Jan. 2019. [Online]. Available: https://aomediacodec.github.io/av1-spec/av1-spec.pdf EXTERNAL
- T. Evens, “Co-Opetition of TV Broadcasters in Online Video Markets: A Winning Strategy?,” Int. J. Digital Television, 5(1):61– 74(14), Mar. 2014. EXTERNAL
- Dynamic Adaptive Streaming over HTTP-Industry Forum (DASH-IF), “DASH-IF Interoperability Points, v4.3,” Nov. 2018. [Online]. Available: https://dashif.org/docs/DASH-IF-IOP-v4.3.pdf EXTERNAL
- American National Standards Institute/Society of Cable and Telecommunications Engineers (ANSI/SCTE) 30 2017, “Digital Program Insertion Splicing API,” SCTE, 2017. EXTERNAL
- W. Law, “Ultra Low Latency with CMAF.” [Online]. Available: https://www.akamai.com/us/en/multimedia/documents/white-paper/low-latency-streaming-cmaf-whitepaper.pdf EXTERNAL
- Amazon Web Services (AWS) Elemental, “Video Processing and Delivery Moves to the Cloud,” e-book, 2018. [Online]. Available: https://www.elemental.com/resources/white-papers/e-book-video-processing-delivery-moves-cloud/ EXTERNAL
- Widevine. [Online]. Available: https://www.widevine.com/solutions/widevine-drm EXTERNAL
- Advanced Television Systems Committee (ATSC) A/54A, “Recommended Practice: Guide to the Use of the ATSC Digital Television Standard,” ATSC, Dec. 4, 2003. EXTERNAL
- Amazon Web Services (AWS) Direct Connect. [Online]. Available: https://aws.amazon.com/directconnect/ EXTERNAL
- Advanced Television Systems Committee (ATSC) A/53 Part 1: 2009, “ATSC Digital Television Standard: Part 1—Digital Television System,” ATSC, 7 Aug. 2009. EXTERNAL
- Zixi, LLC, “Streaming Video Over the Internet and Zixi,” May 2015. [Online]. Available: http://www.zixi.com/PDFs/Adaptive-Bit-Rate-Streaming-and-Final.aspx EXTERNAL
- Adobe Systems, “Real-Time Messaging Protocol (RTMP) Specification. Version 1.0,” Dec. 2012. [Online]. Available: https://www.adobe.com/devnet/rtmp.html EXTERNAL
- J.Ozer,“Encoding for Multiple Devices,”Streaming Media Magazine, Mar. 2013. [Online]. Available: http://www.streamingmedia.com/Articles/ReadArticle.aspx?ArticleID=88179&fb_comment_id=220580544752826_937649 EXTERNAL
- Consumer Electronics Association (CEA)-608-B, “Line 21 Data Services,” Consumer Electronics Association, Apr. 1, 4, 2008. EXTERNAL
- Apple,“HLSAuthoring Specification forApple Devices,”Jun.2019. [Online]. Available: https://developer.apple.com/documentation/http_live_streaming/hls_authoring_specification_for_apple_devices EXTERNAL
- American National Standards Institute/Society of Cable and Telecommunications Engineers (ANSI/SCTE) 43 2015, “Digital Video Systems Characteristics Standard for Cable Television,” SCTE, 2015. EXTERNAL
- Grass Valley KudosPro Converters. [Online]. Available: https://www.grassvalley.com/products/kudospro/ EXTERNAL
- Video Services Forum (VSF) TR-06-1, “Reliable Internet Stream Transport (RIST) Protocol Specification—Simple Profile,” Video Services Forum, Oct. 2018. [Online]. Available: http://vsf.tv/down-load/technical_recommendations/VSF_TR-06-1_2018_10_17.pdf EXTERNAL
- R. Vanam and Y. Reznik, "Frame Rate Up-Conversion Using Bi-Directional Optical Flows With Dual Regularization," Proc. 2020 IEEE Int. Conf. Image Processing (ICIP), 2020, pp. 558–562. EXTERNAL
- Open Cable Specifications (OC-SP)-CEP3.0-I05-151104, “Content Encoding Profiles 3.0 Specification,” Cable Television Laboratories, Inc., Nov. 4, 2015. EXTERNAL
- Teranex Standards Converters. [Online]. Available: https://www.blackmagicdesign.com/products/teranex EXTERNAL
- FFMPEG filter documentation. [Online]. Available: https://ffmpeg.org/ffmpeg-filters.html EXTERNAL
- Y. Reznik et al., “Optimizing Mass-Scale Multi-Screen Video Delivery,” Proc. 2019 NAB Broadcast Engineering and Information Technology Conference, Las Vegas, NV, Apr. 6–11, 2019. EXTERNAL
- B. J. Lechner et al., “The ATSC Transport Layer, Including Program and System Information (PSIP),” Proc. IEEE, 94(1):77– 101, Jan. 2006. EXTERNAL
- Worldwide Web Consortium (W3C) WebVTT, “The Web Video Text Tracks,” W3C, Mar. 2018. [Online]. Available: http://dev.w3.org/html5/webvtt/ EXTERNAL
- Consumer Electronics Association (CEA) CEB16, “Active Format Description (AFD) & Bar Data Recommended Practice,” CEA, Jul. 31, 2006. EXTERNAL
- Dynamic Adaptive Streaming over HTTP-Industry Forum (DASH-IF), “DASH-IF ATSC3.0 IOP,” Jun. 2012. [Online]. Available: https://dashif.org/docs/DASH-IF-IOP-for-ATSC3-0-v1.1.pdf EXTERNAL
- PlayReady. [Online]. Available: https://www.microsoft.com/playready/overview/ EXTERNAL
- Nielsen Holdings plc, “Total Audience Report,” Feb. 2020. [Online]. Available: https://www.nielsen.com/us/en/client-learning/tv/nielsen-total-audience-report-february-2020/. See also [Online]. Available: https://techcrunch.com/2020/02/11/nielsen-streaming-wars-total-audience-report/ EXTERNAL
- G. J. Conklin et al., “Video Coding for Streaming Media Delivery on the Internet,” IEEE Trans. Circuits Syst. Video Technol., 11(3):269–281, Mar. 2001. EXTERNAL
- American National Standards Institute/Society of Cable and Telecommunications Engineers (ANSI/SCTE) 172 2011, “Constraints on AVC Video Coding for Digital Program Insertion,” SCTE, 2011. EXTERNAL
- Azure ExpressRoute. [Online]. Available: https://azure.microsoft.com/en-us/services/expressroute/ EXTERNAL
- Consumer Electronics Association (CEA)-708-B, “Digital Television (DTV) Closed Captioning,” Consumer Electronics Association, Aug. 1, 2008. EXTERNAL
- Brightcove VideoCloud System. [Online]. Available: https://www.brightcove.com/en/online-video-platform. EXTERNAL
- Apple, “Incorporating Ads into a Playlist.” [Online]. Available: https://developer.apple.com/documentation/http_live_s t r e a m i n g /e x a mple _ pl ay l i s t s _ for _ ht t p_ l i ve _ s t r e a m i n g / incorporating_ads_into_a_playlist EXTERNAL
- G. A. Davidson et al., “ATSC Video and Audio Coding,” Proc. IEEE, 94(1):60–76, Jan. 2006. EXTERNAL
- American National Standards Institute/Society of Cable and Telecommunications Engineers (ANSI/SCTE) 128 2010-a, “AVC Video Systems and Transport Constraints for Cable Television,” SCTE, 2010. EXTERNAL
- European Broadcasting Union (EBU) Tech. 3213-E, “E.B.U. Standard for Chromaticity Tolerances for Studio Monitors,” EBU, 1975. EXTERNAL
- Sandvine, “The Global Internet Phenomena Report,” Sep. 2019. [Online]. Available: https://www.sandvine.com/hubfs/Sandvine_Redesign_2019/Downloads/Internet%20Phenomena/Internet%20Phenomena%20Report%20Q32019%2020190910.pdf EXTERNAL
- J. Ozer, “Encoding for Multiple-Screen Delivery,” Streaming Media East, 2013. [Online]. Available: https://www.streamingmediablog.com/wp-content/uploads/2013/07/2013SMEast-Workshop-Encoding.pdf EXTERNAL
- American National Standards Institute/Society of Cable and Telecommunications Engineers (ANSI/SCTE) 67 2010, “Recommended Practice for SCTE 35 Digital Program Insertion Cueing Message for Cable,” SCTE, 2010. EXTERNAL
- Worldwide Web Consortium (W3C)TTML1, “Timed Text Markup Language 1,” W3C, Nov. 2019. [Online]. Available: https://www.w3.org/TR/2018/REC-ttml1-20181108/ EXTERNAL
- ITU-R BT.601.7 [Active]
- ITU-R BT.709.6 [Active]
- IETF RFC 1889 [Superseded*]
- IETF RFC 8216 [Active*]
- SMPTE RP 145 [Active, Stabilized]
- SMPTE ST 170 [Active, Stabilized]
- SMPTE ST 259:2008 [Active, Stabilized]
- SMPTE ST 292-1:2018 [Active, Stabilized]
- SMPTE ST 2022-1:2007 [Active]
- SMPTE ST 2022-2:2007 [Active]
- SMPTE ST 2110-20:2017 [Superseded]
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2021.3106162.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Yuriy Reznik, Jordi Cenzano, and Bo Zhang; Transitioning Broadcast to Cloud, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3106162
Snippet:
Yuriy Reznik, Jordi Cenzano, and Bo Zhang; Transitioning Broadcast to Cloud, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3106162
HTML (ISO 690 compliant)
Preview:
Yuriy Reznik, Jordi Cenzano, and Bo Zhang; Transitioning Broadcast to Cloud, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3106162
Snippet:
<span class="citation">Yuriy Reznik, Jordi Cenzano, and Bo Zhang; <cite>Transitioning Broadcast to Cloud</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/JMI.2021.3106162" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2021.3106162</a></span>
SMPTE's HTML Pub
Preview:
Yuriy Reznik, Jordi Cenzano, and Bo Zhang; Transitioning Broadcast to Cloud, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021
doi: 10.5594/JMI.2021.3106162
url: https://doi.org/10.5594/JMI.2021.3106162
doi: 10.5594/JMI.2021.3106162
url: https://doi.org/10.5594/JMI.2021.3106162
Snippet:
<li> Yuriy Reznik, Jordi Cenzano, and Bo Zhang; <cite id="bib-10-5594-jmi-2021-3106162">Transitioning Broadcast to Cloud</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021 <span class="doi">10.5594/JMI.2021.3106162</span> </li>