Uncompressed Video in the Public Cloud: Are We There Yet?
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 132, No. 2, pp. 26–31
- Abstract
- Broadcasters are beginning to use the public cloud for live production, but unlike ground-based production, most of the media processing in the cloud operates on compressed media. One public cloud offers a solution for uncompressed transfer but that solution currently has some limitations that prevent widespread use between customers. We have had some success transporting uncompressed video on several clouds using a multiflow User Datagram Protocol (UDP) transport, which is described in this article. We also discuss the expected architecture of cloud services that process video, and some of the areas where standardization will be needed. There are many use cases for compressed media in the cloud, and many of them will remain for a long time. For the near future, due to business, technical, and standardization issues, we see uncompressed video transport relegated to an internal implementation detail of services that will continue to use standardized compressed formats for ingress and egress.
- Publication Date
- 2023-03-01
- DOI
10.5594/JMI.2023.3236001- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2023.3236001
- Author(s)
- Mike Coleman
bio
Mike Coleman has been in broadcasting since the early 1970s, first in an operational and on-air role, and then designing broadcast equipment and streaming software at companies including Tektronix, Omneon, Envivio, and Amazon Web Services (AWS) Elemental. In 2020, he and Jialu Wang left AWS to form Port 9 Labs, Portland, which does research and development work aimed at live media production in the public cloud.Jialu Wangbio
Jialu Wang is a co-founder and an engineer at Port 9 Labs, Portland, OR, focusing on live video production in public clouds. Before that, she was a software engineer at Amazon Web Services (AWS) Elemental, Portland, working on cloud video services. - Keyword(s)
- Cloud, Cloud-Native, Live Production, Network Testing
- Copyright
- © 2023 SMPTE
Bibliographic Reference(s)
- Optimizing Linear Media Processes for Cloud [Active]
- “AWS CDI SDK,” Jul. 17, 2022. Accessed: Aug. 12, 2022. [Online]. Available: https://github.com/aws/aws-cdi-sdk EXTERNAL
- J. Dean and L. A. Barroso, “The Tail at Scale,” Commun. ACM, 56 (2):74–80, 2013, doi: 10.1145/2408776.2408794. EXTERNAL
- “iperf3—iperf3 3.10.1 Documentation.” Accessed: Aug. 12, 2022. [Online]. Available: https://software.es.net/iperf/ EXTERNAL
- Amazon Web Services (AWS) “AWS Re:Invent 2017: Another Day, Another Billion Flows (NET405),” 2017. Accessed: Aug. 12, 2022. [Online]. Available: https://www.youtube.com/watch?v=8gc2DgBqo9U EXTERNAL
- “ethtool/ethtool.git—Ethernet Device Management Tool.” Accessed: Aug. 12, 2022. [Online]. Available: https://git.kernel.org/pub/scm/network/ethtool/ethtool.git/about/ EXTERNAL
- “GCCG Ground to Cloud, Cloud to Ground AG Update at VidTrans 2022,” 2022. Accessed: Dec. 2, 2022. [Online]. Available: https://www.youtube.com/watch?v=jYWSigZhQos EXTERNAL
- J. M. Hellerstein and P. Alvaro, “Keeping CALM: When Distributed Consistency is Easy,” Commun. ACM, 63 (9):72–81, 2020, doi: 10.1145/3369736. EXTERNAL
- Amazon Web Services (AWS) “Build Instructions for AWS CDI Plugin for OBS,” Jun. 16, 2022. Accessed: Aug. 12, 2022. [Online]. Available: https://github.com/aws/obs-cdi EXTERNAL
- “Using Uncompressed Video in the Cloud—Port 9 Blog.” Accessed: Dec. 13, 2022. [Online]. Available: https://blog.port9labs.com/2022/10/25/using-uncompressed-video-in-the-cloud/ EXTERNAL
- M. Mathis “Windowed Ping: An IP Layer Performance Diagnostic,” Comput. Netw. ISDN Syst.,” 27 (3):449–459, 1994, doi: 10.1016/0169-7552(94)90119-8. EXTERNAL
- N. Horman, “DropWatch,” Aug. 12, 2022. Accessed: Aug. 12, 2022. [Online]. Available: https://github.com/nhorman/dropwatch EXTERNAL
- “Cloud-Video-Tests,” Aug. 10, 2022. Accessed: Aug. 12, 2022. [Online]. Available: https://github.com/port9labs/cloud-video-tests EXTERNAL
- L. Shalev, H. Ayoub, N. Bshara, and E. Sabbag, “A Cloud-Optimized Transport Protocol for Elastic and Scalable HPC,” IEEE Micro., 40 (6):67–73, 2020, doi: 10.1109/MM.2020.3016891. EXTERNAL
- Amazon Web Services (AWS), “Elastic Fabric Adapter. Accessed: Aug. 12, 2022. [Online]. Available: https://aws.amazon.com/hpc/efa/ EXTERNAL
- “iputils/iputils,” Aug. 10, 2022. Accessed: Aug. 12, 2022. [Online]. Available: https://github.com/iputils/iputils EXTERNAL
- SMPTE ST 2110-20:2017 [Superseded]
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2023.3236001.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Mike Coleman and Jialu Wang; Uncompressed Video in the Public Cloud: Are We There Yet?, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 2, March 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3236001
Snippet:
Mike Coleman and Jialu Wang; Uncompressed Video in the Public Cloud: Are We There Yet?, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 2, March 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3236001
HTML (ISO 690 compliant)
Preview:
Mike Coleman and Jialu Wang; Uncompressed Video in the Public Cloud: Are We There Yet?, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 2, March 2023); SMPTE, 2023. Available at https://doi.org/10.5594/JMI.2023.3236001
Snippet:
<span class="citation">Mike Coleman and Jialu Wang; <cite>Uncompressed Video in the Public Cloud: Are We There Yet?</cite>, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 2, March 2023); SMPTE, 2023. Available at <a href="https://doi.org/10.5594/JMI.2023.3236001" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2023.3236001</a></span>
SMPTE's HTML Pub
Preview:
Mike Coleman and Jialu Wang; Uncompressed Video in the Public Cloud: Are We There Yet?, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 2, March 2023); SMPTE, 2023
doi: 10.5594/JMI.2023.3236001
url: https://doi.org/10.5594/JMI.2023.3236001
doi: 10.5594/JMI.2023.3236001
url: https://doi.org/10.5594/JMI.2023.3236001
Snippet:
<li> Mike Coleman and Jialu Wang; <cite id="bib-10-5594-jmi-2023-3236001">Uncompressed Video in the Public Cloud: Are We There Yet?</cite>, SMPTE Motion Imaging Journal ( Volume: 132, Issue: 2, March 2023); SMPTE, 2023 <span class="doi">10.5594/JMI.2023.3236001</span> </li>