Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 131, No. 4, pp. 45–49
- Abstract
- A solution is proposed on top of Kubernetes to dynamically allocate service resources without service interruption. It is the basis for optimizing a live video compression service. It is demonstrated that dynamic resource allocation can benefit a video compression application, either by reducing the resource consumption, hence costs, or by enhancing delivered video quality. By combining the proposed solution with an elastic encoder and machine learning (ML) for content complexity estimation, a content- and application-aware dynamic resource orchestrator for realtime video compression is designed. Preliminary experimental results using ATEME Titan Live Micro-Services¹encoders demonstrate substantial bitrate reductions on even the most demanding channel.
- Publication Date
- 2022-05-01
- DOI
10.5594/JMI.2022.3160832- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2022.3160832
- Author(s)
- Abdelmajid Moussaoui
bio
Abdelmajid Moussaoui received an engineering degree in multimedia networking from Telecom-Paris, Paris, France, in 2020. He is a research engineer in the Research and Innovation Department of Ateme, Vélizy, France. His current research areas are video encoding, codec orchestration in the cloud, and machine learning. He holds several pending patents related to the optimization of the orchestration of live video channels distribution in the cloud.Mickaël Rauletbio
Mickaël Raulet is the chief technology officer at Ateme, Vélizy, France, where he drives research and innovation with various collaborative research and development projects. He represents Ateme in several standardization bodies: Advanced Television Systems Committee (ATSC), Digital Video Broadcasting (DVB), 3rd Generation Partnership Project (3GPP), International Organization for Standardization / International Electrotechnical Commission (ISO/IEC), International Telecommunication Union (ITU), Moving Picture Experts Group (MPEG), Dynamic Adaptive Streaming over HTTP Industry Forum (DASH-IF), Common Media Application Format- Industry Forum (CMAF-IF), Streaming Video Alliance (SVA), and UHDForum. He is the author of numerous patents and more than 100 conference papers and journal scientific articles. In 2006, he received a PhD from INSA, Rennes, France, in electronic and signal processing, in collaboration with Mitsubishi Electric ITE, Rennes, France.Thomas Guionnetbio
Thomas Guionnet is a fellow research engineer at Ateme, Vélizy, France, where he currently leads the innovation team’s research on artificial intelligence applied to video compression. Beyond his work for Ateme, he has also contributed to the International Organization for Standardization / Moving Picture Experts Group (ISO/MPEG) - International Electrotechnical Commission Telecommunication Standardization Sector / Video Coding Experts Group (ITU-T/VCEG) - versatile video coding (VVC), HEVC, and high efficiency video coding- 3 dimensions (HEVC-3D) standardization process; he teaches video compression at the ESIR Engineering School, Rennes, France; and he has authored numerous publications including patents, international conference papers, and journal articles. Prior to joining Ateme, he spent 10 years at Envivio conducting research on real-time encoding, video-preprocessing, and video quality assessment. He holds a PhD from Rennes 1 University, Rennes. - Keyword(s)
- Artificial Intelligence, Cloud, Content-Adaptive Encoding, HEVC, Kubernetes, Machine Learning, Video Coding, Video Compression, Video Quality
- Copyright
- © 2022 SMPTE
Bibliographic Reference(s)
- N. Dragoni et al., Microservices: Yesterday, Today, and Tomorrow, June 2021. [Online]. Available: https://arxiv.org/abs/1606.04036 EXTERNAL
- The Linux Foundation, Kubernetes Device Plugin, June 2021. [Online]. Available: https://kubernetes.io/docs/concepts/extend-kubernetes/compute-storage-net/device-plugins/ EXTERNAL
- Docker Inc., Docker Swarm, Container’s Orchestrator, June 2021. [Online]. Available: https://docs.docker.com/engine/swarm/key-concepts/ EXTERNAL
- Y. Blau, “Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoff,” June 2021. [Online]. Available: https://doi.org/10.1002/0471219282.eot142 EXTERNAL
- G. Bjøntegaard, “Calculation of Average PSNR Differences Between RD-Curves,” Technical Report VCEG-M33, ITU-T SG16/Q6, Austin, TX, 2001. EXTERNAL
- Ateme, Ateme Virtualized Video Solution, 2021. [Online]. Available: https://www.ateme.com/wp-content/uploads/2021/02/Ateme-Virtualized-Video-Solution.pdf EXTERNAL
- P. Di Francesco, P. Lago, I. Malavolta, “Architecting With Microservices: A Systematic Mapping Study,” Journal of Systems and Software, 150:77–97, June 2021. [Online]. Available: https://doi.org/10.1016/j.jss.2019.01.001 EXTERNAL
- A. Verma et al., Large-Scale Cluster Management at Google With Borg, June 2021. [Online]. Available: https://arxiv.org/pdf/1901.07821.pdf EXTERNAL
- Linux Kernel Organization, NUMA, June 2021. [Online]. Available: https://www.kernel.org/doc/html/v4.18/vm/numa.html EXTERNAL
- N. R. Herbest, S. Kounev, and R. Reussner, “Elasticity in Cloud Computing: What It Is, and What It Is Not,” 10th Intl. Conf. Autonomic Computing, June 2021. [Online]. Available: https://www.usenix.org/conference/icac13/technical-sessions/presentation/herbst EXTERNAL
- The Linux Foundation, Kubernetes Platform Container’s Orchestrator, June 2021. [Online]. Available: https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/ EXTERNAL
- S. Hallyn, Linux Control Groups File System, June 2021. [Online]. Available: https://man7.org/linux/man-pages/man7/cgroups.7.html EXTERNAL
- MulticoreWare Inc., x265 HEVC Implementation, June 2021. [Online]. Available: https://x265.readthedocs.io EXTERNAL
- Docker Inc., Docker Software Containerization Platform, June 2021. [Online]. Available: https://docs.docker.com/get-started/overview/ EXTERNAL
- The Apache Software Foundation, Mesos a Distributed Systems Kernel, June 2021. [Online]. Available: http://mesos.apache.org/ EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2022.3160832.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3160832
Snippet:
Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3160832
HTML (ISO 690 compliant)
Preview:
Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3160832
Snippet:
<span class="citation">Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; <cite>Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster</cite>, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at <a href="https://doi.org/10.5594/JMI.2022.3160832" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2022.3160832</a></span>
SMPTE's HTML Pub
Preview:
Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022
doi: 10.5594/JMI.2022.3160832
url: https://doi.org/10.5594/JMI.2022.3160832
doi: 10.5594/JMI.2022.3160832
url: https://doi.org/10.5594/JMI.2022.3160832
Snippet:
<li> Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; <cite id="bib-10-5594-jmi-2022-3160832">Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster</cite>, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022 <span class="doi">10.5594/JMI.2022.3160832</span> </li>