Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2021, No. 11, pp. 1–8
Abstract: A solution is proposed on top of Kubernetes to dynamically allocate services resources without service interruption. It serves as the basis for optimizing a live video compression service. It is demonstrated that dynamic resource allocation can benefit to a video compression application, either by reducing the resource consumption, hence costs, or by enhancing delivered video quality. By combining the proposed solution with an elastic encoder and machine learning for content complexity estimation, a content and application aware dynamic resource orchestrator for real-time video compression is designed. Preliminary experimental results using ATEME Titan Live Microservices [8] encoders demonstrate substantial bitrate reductions on even the most demanding channel.
Publication Date: 2021-11-09
DOI: 10.5594/M001951
Link: https://doi.org/10.5594/M001951
Author(s): Abdelmajid MoussaouiATEME
Mickaël RauletATEME
Thomas GuionnetATEME
Keyword(s): Video Compression, Machine Learning, Artificial Intelligence, Cloud, Kubernetes, Video Coding, HEVC, Video Quality, Content-Adaptive Encoding
Copyright: © 2021 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

N. Dragoni et al, Microservices: yesterday, today, and tomorrow. https://arxiv.org/abs/1606.04036 EXTERNAL
The Linux Foundation , Kubernetes Platform Container’s Orchestrator. https://kubernetes.io/docs/concepts/overview/what-is-kubernetes/ EXTERNAL
Yochai Blau, Rethinking Lossy Compression: The Rate-Distortion-Perception Tradeoff https://doi.org/10.1002/0471219282.eot142. EXTERNAL
Docker Inc , Docker Software containerization platform. https://docs.docker.com/get-started/overview/ EXTERNAL
MulticoreWare Inc, https://x265.readthedocs.io , x265 HEVC implementation. EXTERNAL
Herbest et al, Elasticity in Cloud Computing: What It Is, and What It Is Not. https://www.usenix.org/conference/icac13/technical-sessions/presentation/herbst EXTERNAL
Francesco et al, Architecting with microservices: A systematic mapping study. https://doi.org/10.1016/j.jss.2019.01.001 EXTERNAL
ATEME , ATEME Virtualized Video Solution, https://www.ateme.com/wp-content/uploads/2021/02/ATEME-VIRTUALIZED-VIDEO-SOLUTION.pdf 2021. EXTERNAL
The Apache Software Foundation , Mesos A distributed systems kernel. http://mesos.apache.org/ EXTERNAL
The Linux Foundation , Kubernetes device plugin https://kubernetes.io/docs/concepts/extend-kubernetes/compute-storage-net/device-plugins/ EXTERNAL
Abhishek Verma et al, Large-scale cluster management at Google with Borg, https://arxiv.org/pdf/1901.07821.pdf EXTERNAL
Serge Hallyn, Linux Control Groups File System https://man7.org/linux/man-pages/man7/cgroups.7.html EXTERNAL
Linux Kernel Organization, NUMA https://www.kernel.org/doc/html/v4.18/vm/numa.html EXTERNAL
G. Bjøntegaard, Calculation of average PSNR differences between RD-curves, Technical Report VCEG-M33, ITU-T SG16/Q6, Austin, Texas, USA, 2001. EXTERNAL
Docker Inc., Docker Swarm, Container’s orchestrator. https://docs.docker.com/engine/swarm/key-concepts/ EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001951.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001951

Snippet:

Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001951

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; <cite>Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster</cite>, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/M001951" target="_blank" rel="noopener">https://doi.org/10.5594/M001951</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Abdelmajid Moussaoui, Mickaël Raulet, and Thomas Guionnet; <cite id="bib-10-5594-m001951">Dynamic Seamless Resource Allocation for Live Video Compression on a Kubernetes Cluster</cite>, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021
<span class="doi">10.5594/M001951</span>
</li>