SMPTE Meetings and Conferences ( October 2022)
[ACTIVE]
An Edge Processing Platform for Media Production
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Conference Paper
- Content Type
- Original Research
- Volume
- 2022, No. 10, pp. 1–18
- Abstract
- A hybrid, multicloud approach is needed to address the goals of broadcasters to commission and evolve scalable software-based broadcast systems composed of elements from diverse vendors, on Commercial Off-The-Shelf (COTS) hardware, avoiding lock-in at the facility and in the cloud. These software elements need to support common control, integration with enterprise management systems and a sufficient level of automation. — To that end, broadcast vendors' software needs to run everywhere; use standards and open specifications for control and transport interoperability; support fine-grained resource allocation; and leverage IT best practice, e.g., for monitoring, security, and orchestration. We propose an open-source container orchestration platform, virtualized infrastructure layers, and common software APIs for control interoperability, allowing the vendor to focus where their value and revenue is - the application and UX. — As a case study, we construct a scalable edge platform for transcoding, AI inference and other video and audio processing, that can reduce the cost, latency, and power footprint of cloud-based media production. — Multi-architecture, containerized, applications are deployed and managed with Kubernetes. This provides fine-grained allocation of hardware resources, including Graphics Processing Units (GPUs) and ST 2110-capable network interface controllers (NICs). Service discovery and connection management are achieved using the Networked Media Open Specifications (NMOS). The example video and audio processing pipelines are based on the GStreamer open-source multimedia framework, leveraging the high-performance capabilities of GPU and NIC. Prospective services include transcoding, video and/or audio clean-up, super resolution, automatic closed captioning, content moderation, object identification and compositing of chat or data feeds.
- Publication Date
- 2022-10-24
- DOI
10.5594/M001984- ISBN
- Print:
978-1-61482-963-8 - Link
- https://doi.org/10.5594/M001984
- Author(s)
- Thomas TrueNVIDIA, Santa Clara, CAGareth Sylvester-BradleyNVIDIA, Santa Clara, CA
- Keyword(s)
- Software-based Broadcast, Hybrid, Multicloud, Edge Computing, Virtualization, Containerization, Kubernetes, GPU, NIC, Data Processing Unit (DPU), ST 2110, NMOS
- Copyright
- © 2022 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- Foundations for New Media Nodes [Active]
- Tighter NIC/GPU Integration Yields Next Level Media Processing Performance [Active]
- IEEE.STD1588.2019 — Institute of Electrical and Electronics Engineers (IEEE), IEEE 1588:2019, “IEEE Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems.” EXTERNAL
- NVIDIA, “DeepStream Reference Application - deepstream-nmos app.” Accessed: Oct. 1, 2022. Available: https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_ref_app_nmos.html EXTERNAL
- GStreamer, “GStreamer Features.” Accessed: Oct. 1, 2022. Available: https://gstreamer.freedesktop.org/features/index.html EXTERNAL
- Kubernetes, “Command line tool (kubectl).” Accessed: Oct. 1, 2022. Available: https://kubernetes.io/docs/reference/kubectl/ EXTERNAL
- R. Hastie, “AMWA NMOS Registry.” Accessed: Oct. 1, 2022. Available: https://hub.docker.com/r/rhastie/nmos-cpp EXTERNAL
- SRT Alliance. Accessed: Oct. 1, 2022. Available: https://www.srtalliance.org/ EXTERNAL
- Kubespray. Accessed: Oct. 1, 2022. Available: https://kubespray.io/ EXTERNAL
- AMWA BCP-004-01 Receiver Capabilities Specification. Accessed: Oct. 1, 2022. Available: https://specs.amwa.tv/bcp-004-01/ EXTERNAL
- Kubernetes. Accessed: Oct. 1, 2022. Available: https://kubernetes.io/ EXTERNAL
- NVIDIA, “Rivermax SDK: Optimized networking SDK for Media and Data streaming applications.” Accessed: Oct. 1, 2022. Available: https://developer.nvidia.com/networking/rivermax EXTERNAL
- Google Cloud, “Kubernetes - Google Kubernetes Engine (GKE).” Accessed: Oct. 1, 2022. Available: https://cloud.google.com/kubernetes-engine/ EXTERNAL
- HyperTransport Consortium, “Meeting the I/O Bandwidth Challenge: How HyperTransport Technology Accelerates Performance in Key Applications.” Accessed: Oct. 1, 2022. Available: https://www.techonline.com/wp-content/uploads/2020/09/media-1035173-hypertransport_apps.pdf EXTERNAL
- NVIDIA, “Edge Computing.” Accessed: Oct. 1, 2022. Available: https://www.nvidia.com/en-us/autonomous-machines/ EXTERNAL
- NVIDIA, “CUDA Zone: Library of Resources.” Accessed: Oct. 1, 2022. Available: https://developer.nvidia.com/cuda-zone EXTERNAL
- Advanced Media Workflow Association (AMWA), March 2021, “Networked Media Systems – the Big Picture.” Accessed: Oct. 1, 2022. Available: https://static.amwa.tv/networked-media-systems-big-picture-2021-03-05.pdf EXTERNAL
- Video for Linux API version 2. Accessed: Oct. 1, 2022. Available: https://www.linuxtv.org/downloads/v4l-dvb-apis-new/userspace-api/v4l/v4l2.html EXTERNAL
- Intel, “Intel Xeon Process Scalable Family Technical Overview.” Accessed: Oct. 1, 2022. Available: https://www.intel.com/content/www/us/en/developer/articles/technical/xeon-processor-scalable-family-technical-overview.html EXTERNAL
- Ansible. Accessed: Oct. 1, 2022. Available: https://www.ansible.com/ EXTERNAL
- NVIDIA, “NVIDIA GPU Operator: Simplifying GPU Management in Kubernetes.” Accessed: Oct. 1, 2022. Available: https://developer.nvidia.com/blog/nvidia-gpu-operator-simplifying-gpu-management-in-kubernetes/ EXTERNAL
- AMWA IS-05 Connection Management Specification. Accessed: Oct. 1, 2022. Available: https://specs.amwa.tv/is-05/ EXTERNAL
- SMPTE, “SMPTE ST 2110 FAQ.” Accessed: Oct. 1, 2022. Available: https://www.smpte.org/smpte-st-2110-faq EXTERNAL
- Joint Task Force on Networked Media (JT-NM), TR-1001-1, “System Environment and Device Behaviors For SMPTE ST 2110 Media Nodes in Engineered Networks.” Accessed: Oct. 1, 2022. Available: https://www.jt-nm.org/tr-1001-1 EXTERNAL
- The Linux PTP Project. Accessed: Oct. 1, 2022. Available: https://www.linuxptp.org/ EXTERNAL
- NVIDIA, “Streamlining Kubernetes Networking in Scale-out GPU Clusters with the new NVIDIA Network Operator 1.0.” Accessed: Oct. 1, 2022. Available: https://developer.nvidia.com/blog/streamlining-kubernetes-networking-in-scale-out-gpu-clusters-with-the-new-nvidia-network-operator-1-0/ EXTERNAL
- Microsoft, “Introduction to Azure Kubernetes Service.” Accessed: Oct. 1, 2022. Available: https://learn.microsoft.com/en-us/azure/aks/intro-kubernetes EXTERNAL
- NVIDIA, “Cloud Native Technologies: Time-Slicing GPUs in Kubernetes.” Accessed: Oct. 1, 2022. Available: https://docs.nvidia.com/datacenter/cloud-native/gpu-operator/gpu-sharing.html EXTERNAL
- NVIDIA, “Gst-nvdsvideotemplate.” Accessed: Oct. 1, 2022. Available: https://docs.nvidia.com/metropolis/deepstream/dev-guide/text/DS_plugin_gst-nvdsvideotemplate.html EXTERNAL
- Amazon Web Services, “Managed Kubernetes Service – Amazon EKS.” Accessed: Oct. 1, 2022. Available: https://aws.amazon.com/eks/ EXTERNAL
- Helm, “The package manager for Kubernetes.” Accessed: Oct. 1, 2022. Available: https://helm.sh/ EXTERNAL
- AMWA, “NMOS Overview.” Accessed: Oct. 1, 2022. Available: https://www.amwa.tv/nmos-overview EXTERNAL
- NVIDIA, “DeepStream SDK.” Accessed: Oct. 1, 2022. Available: https://developer.nvidia.com/deepstream-sdk EXTERNAL
- Pebble, “Pebble Control Free.” Accessed: Oct. 1, 2022. Available: https://www.pebble.tv/control-free/ EXTERNAL
- AMWA IS-04 Discovery & Registration Specification. Accessed: Oct. 1, 2022. Available: https://specs.amwa.tv/is-04/ EXTERNAL
- Oracle, “Container Engine for Kubernetes.” Accessed: Oct. 1, 2022. Available: https://www.oracle.com/cloud/cloud-native/container-engine-kubernetes/ EXTERNAL
- SMPTE ST 2110-20:2017 [Superseded]
- SMPTE ST 2110-21:2017 [Superseded]
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001984.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Thomas True and Gareth Sylvester-Bradley; An Edge Processing Platform for Media Production, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at https://doi.org/10.5594/M001984
Snippet:
Thomas True and Gareth Sylvester-Bradley; An Edge Processing Platform for Media Production, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at https://doi.org/10.5594/M001984
HTML (ISO 690 compliant)
Preview:
Thomas True and Gareth Sylvester-Bradley; An Edge Processing Platform for Media Production, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at https://doi.org/10.5594/M001984
Snippet:
<span class="citation">Thomas True and Gareth Sylvester-Bradley; <cite>An Edge Processing Platform for Media Production</cite>, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8. Available at <a href="https://doi.org/10.5594/M001984" target="_blank" rel="noopener">https://doi.org/10.5594/M001984</a></span>
SMPTE's HTML Pub
Preview:
Thomas True and Gareth Sylvester-Bradley; An Edge Processing Platform for Media Production, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8
doi: 10.5594/M001984
url: https://doi.org/10.5594/M001984
doi: 10.5594/M001984
url: https://doi.org/10.5594/M001984
Snippet:
<li> Thomas True and Gareth Sylvester-Bradley; <cite id="bib-10-5594-m001984">An Edge Processing Platform for Media Production</cite>, SMPTE Meetings and Conferences ( October 2022); SMPTE, 2022, ISBN: 978-1-61482-963-8 <span class="doi">10.5594/M001984</span> </li>