Adaptive Streaming of Content-Aware-Encoded Videos in dash.js

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 131, No. 4, pp. 30–38
Abstract: In Hypertext Transfer Protocol (HTTP) adaptive streaming, the client makes rate adaptation decisions based on the measured network bandwidth and buffer fullness. This simplifies the adaptation logic; however, it often produces noticeable quality fluctuations during the streaming session. With content-aware encoding (CAE), one can improve the visual quality without increasing the total number of bits spent by carefully choosing where the bits are spent based on human perception. However, an adaptation logic that is unaware of the resulting variable-size segments may cause more stalls, defeating the purpose of improving viewer experience through CAE. This article explains the design steps of a size-aware rate adaptation (SARA) logic for one of the most popular Dynamic Adaptive Streaming over HTTP (DASH) clients, namely dash.js, and shows the improvements in rebuffering behavior and fetching top-resolution segments as a result of applying this logic.
Publication Date: 2022-05-01
DOI: 10.5594/JMI.2022.3160560
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2022.3160560
Author(s): Ali C. Begen
bio
Ali C. Begen is currently a computer science professor at Özyeğin University, Istanbul, Turkey, and a technical consultant in the Advanced Technology and Standards Group, Comcast. Previously, he was a research and development engineer at Cisco (U.S. and Canada). He received a PhD in electrical and computer engineering from the Georgia Institute of Technology, Atlanta, GA, in 2006. To date, he has received a number of academic and industry awards and has been granted over 30 U.S. patents. In 2020 and 2021, he was listed among the world’s most influential scientists in the subfield of networking and telecommunications. More details are available at https://ali.begen.net.
Mehmet N. Akcay
bio
Mehmet N. Akcay is currently working toward a PhD in computer science at Özyeğin University, Istanbul, Turkey. He received a BSc, in the field of computer engineering, from Istanbul Technical University, Istanbul, in 2005. He completed an MSc in computer engineering from Boğaziçi University, Istanbul, in 2008, and he has been working in the industry for more than ten years. His research interests are HTTP adaptive streaming, low-latency live streaming, and software verification using formal methods.
Abdelhak Bentaleb
bio
Abdelhak Bentaleb received a PhD in computer science from the National University of Singapore (NUS), Singapore, in 2019. He is currently a research fellow in the same department. He is a co-founder of Atlastream Inc., Singapore. He has received many prestigious awards including the SIGMM Award for Outstanding PhD Thesis Award, the DASH-IF Best PhD Dissertation Award, and the Dean’s Graduate Research Excellence Award AY2018/2019. His research interests include multimedia systems and communication, video streaming architectures, content delivery, distributed computing, computer networks and protocols, wireless communications, and mobile networks. Further information can be found at https://www.comp.nus.edu.sg/~bentaleb/.
Alex Giladi
bio
Alex Giladi is a Fellow at Comcast (US).
Keyword(s): Adaptive Bitrate Streaming, DASH, Content-Adaptive Encoding, Dashjs, Rate Adaptation
Copyright: © 2022 SMPTE

Bibliographic Reference(s)

QBR Metadata To Improve Streaming Efficiency and Quality [Active]
P. S. Agachi, et al., “2. Model Predictive Control” in Advanced Process Engineering Control: De Gruyter, Berlin, Boston, pp. 32–74, Dec. 2016, doi: 10.1515/9783110306637-003. EXTERNAL
RDK Central, “Advanced Adaptive Media Player,” Accessed: Mar. 8, 2022. [Online]. Available: https://devel-ope r.rd kcent r a l.com / v ide o/doc u ment at ion /component s / open-sourced_components/advanced_adaptive_media_player/ EXTERNAL
Y. Engel, S. Mannor, and R. Meir, “The Kernel Recursive Least-Squares Algorithm,” IEEE Trans. Signal Process., 52(8):2275–2285, Aug. 2004. EXTERNAL
A. Bentaleb et al., “A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP,” IEEE Commun. Surveys Tuts., 21(1):562–585, 1st Quart., 2019, doi: 10.1109/ EXTERNAL
DASH-IF. “DASH Reference Client,” Accessed: Mar. 8, 2022. [Online]. Available: https://reference.dashif.org/dash.js/ EXTERNAL
SARA - IBC’21 Demo Page. Accessed: Mar. 8, 2022. [Online]. Available: http://streaming.university/demo/ibc21-sara/ EXTERNAL
A. C. Begen, “Quality-Aware HTTP Adaptive Streaming,” Proc. Int. Broadcasting Convention Conf. (IBC), Amsterdam, The Netherlands, Sept. 2015, doi: 10.1049/ibc.2015.0004. EXTERNAL
Y. Qin, et al., “Quality-Aware Strategies for Optimizing ABR Video Streaming QoE and Reducing Data Usage,” Proc. ACM Multimedia Syst. Conf. (MMSys), pp.189–200, Jun. 2019. EXTERNAL
P. Juluri, V. Tamarapalli, and D. Medhi, “SARA: Segment Aware Rate Adaptation Algorithm for Dynamic Adaptive Streaming Over HTTP,” Proc. IEEE Int. Conf. Commun. Workshop (ICCW), pp.1765–1770, Jun. 2015. EXTERNAL
DASH-Streaming-Setup. Accessed: Mar. 8, 2022. [Online]. Available: https://github.com/fg-inet/DASH-streaming-setup EXTERNAL
A. Bentaleb, et al., “Catching the Moment With LoL+ in Twitch-Like Low-Latency Live Streaming Platforms,” IEEE Trans. Multimedia, pp. 99 (1–1), May 2021, doi: 10.1109/ EXTERNAL
Z. Li, et al., “Streaming Video Over HTTP With Consistent Quality,” Proc. ACM Multi. Systems Conf. (MMSys), Singapore, Mar. 2014, doi: 10.1145/2557642.2557658. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2022.3160560.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Ali C. Begen, Mehmet N. Akcay, Abdelhak Bentaleb, and Alex Giladi; Adaptive Streaming of Content-Aware-Encoded Videos in dash.js, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3160560

Snippet:

Ali C. Begen, Mehmet N. Akcay, Abdelhak Bentaleb, and Alex Giladi; Adaptive Streaming of Content-Aware-Encoded Videos in dash.js, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at https://doi.org/10.5594/JMI.2022.3160560

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Ali C. Begen, Mehmet N. Akcay, Abdelhak Bentaleb, and Alex Giladi; <cite>Adaptive Streaming of Content-Aware-Encoded Videos in dash.js</cite>, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022. Available at <a href="https://doi.org/10.5594/JMI.2022.3160560" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2022.3160560</a></span>

SMPTE's HTML Pub

Preview:

Ali C. Begen, Mehmet N. Akcay, Abdelhak Bentaleb, and Alex Giladi; Adaptive Streaming of Content-Aware-Encoded Videos in dash.js, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022
doi: 10.5594/JMI.2022.3160560
url: https://doi.org/10.5594/JMI.2022.3160560

Snippet:

<li>
Ali C. Begen, Mehmet N. Akcay, Abdelhak Bentaleb, and Alex Giladi; <cite id="bib-10-5594-jmi-2022-3160560">Adaptive Streaming of Content-Aware-Encoded Videos in dash.js</cite>, SMPTE Motion Imaging Journal ( Volume: 131, Issue: 4, May 2022); SMPTE, 2022
<span class="doi">10.5594/JMI.2022.3160560</span>
</li>