Performance of Low-Latency DASH/CMAF and Low-Latency HLS Streaming Systems

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2021, No. 11, pp. 1–18
Abstract: Reducing end-to-end streaming latency is critical to HTTP-based live video streaming. There are currently two technologies in this domain: Low-Latency HLS (LL-HLS) and Low-Latency DASH (LL-DASH). The latter is sometimes also referred to as Low-Latency CMAF (LL-CM.AF), but effectively it is the same architecture. Several existing implementations of streaming players, as well as encoding and packaging tools, support both technologies. Well-known examples include Apple's AVplayer, Shaka player, HLS.js, DASH.js, FFmpeg, etc. In this paper, we conduct a performance analysis of such streaming systems. We perform a series of live streaming experiments, repeated using identical video content, encoders, encoding profiles, and network conditions, emulated by using traces of real-world networks. We capture several performance metrics, such as average stream bitrate, the amounts of downloaded media data, streaming latency, buffering, frequency of stream switching, etc. Subsequently, we analyze the captured data and describe the observed differences in the performance of LL-HLS and LL-DASH-based systems.
Publication Date: 2021-11-09
DOI: 10.5594/M001943
Link: https://doi.org/10.5594/M001943
Author(s): Yuriy ReznikBrightcove, Inc.
Thiago TeixeiraBrightcove, Inc.
Bo ZhangBrightcove, Inc.
Copyright: © 2021 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

ISO.23009-1.2012 — ISO/IEC 23009-1:2012, Information Technology-Dynamic Adaptive Streaming Over HTTP (DASH)-Part 1: Media Presentation Description and Segment Formats. EXTERNAL
HTML5 Video, https://www.w3.org/TR/2011/WD-html5-20110113/ video.html EXTERNAL
T. Huang, C Ekanadham, A. Berglund, Z. Li, "Hindsight: evaluate video bitrate adaptation at scale," ACM Multimedia Systems Conference, Amherst, MA, June 18 - 21, 2019, pp 86–97. EXTERNAL
K. Spiteri, R. Sitaraman, D. Sparacio, "From Theory to Practice: Improving Bitrate Adaptation in the DASH Reference Player," ACMTrans. Multimedia Comput. Commun. Appl., vol. 15, no. 2s, Article 67, 2019. EXTERNAL
G. Conklin, G. Greenbaum, K. Lillevold, A. Lippman, and Y. Reznik, "Video coding for streaming media delivery on the internet," IEEE Trans. CSVT, vol. 11, no. 3, 2001, pp. 269-281. EXTERNAL
HLS tools, https://developer.apple.com/documentation/http_live_streaming/about_apple_s_http_live_streaming_tools EXTERNAL
S. Hesse, "Design of scheduling and rate-adaptation algorithms for adaptive HTTP streaming," SPIE 8856, Applications of Digital Image Processing XXXVI, 88560M, 2013. EXTERNAL
B. Taraghi, A. Zabrovskiy, C. Timmerer, H. Hellwagner, "CAdViSE: Cloud-based Adaptive Video Streaming Evaluation Framework for the Automated Testing of Media Players," ACM Multimedia Systems Conference, Online, June 8-11, 2020. EXTERNAL
AVFoundation, https://developer.apple.com/av-foundation/ EXTERNAL
Shaka player, https://github.com/google/shaka-player EXTERNAL
D. Talon, L. Attanasio, F. Chiariotti, M. Gadaleta, A. Zanella, M. Rossi, "Comparing DASH Adaptation Algorithms in a Real Network Environment," in European Wireless 2019; 25th European Wireless Conference, 2019. EXTERNAL
T. Huang, R. Johari, N. Mckeown, M. Trunnell, M. Watson, "A Buffer-based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service," ACM SIGCOMM, 2014, pp. 187– 198. EXTERNAL
C. Storck, F. Figueiredo, "A Performance Analysis of Adaptive Streaming Algorithms in 5G Vehicular Communications in Urban Scenarios," of IEEE Symposium on Computers and Communications, 2020, pp.1-7. EXTERNAL
A. Bentaleb, A. C. Begen, S. Harous, R. Zimmermann, "Data-Driven Bandwidth Prediction Models and Automated Model Selection for Low Latency," IEEE Transactions on Multimedia, August 2020. EXTERNAL
Open Broadcast Software, https://obsproject.com/ EXTERNAL
K. Durak, M. N. Akcay, Y. K. Erinc, B. Pekel, A. C. Begen, "Evaluating the Performance of Apple's Low-Latency HLS," IEEE Int. Workshop on Multimedia Signal Processing, September 21-24, 2020, pp.1-6. EXTERNAL
D. Raca, Y. Sani, C. J. Sreenan, J. J. Quinlan, "DASHbed: a testbed Framework for Large Scale Empirical Evaluation of Real-Time DASH in Wireless Scenarios," ACM Multimedia Syst. Conference, Amherst, MA, June 18-21, 2019, pp. 285-290. EXTERNAL
S. Sengupta, N. Ganguly, S. Chakraborty, P. De, "HotDASH: Hotspot Aware Adaptive Video Streaming using Deep Reinforcement Learning," IEEE International Conference on Network Protocols, 2018, pp.165-175. EXTERNAL
Z. Li, X. Zhu, J. Gahm, R. Pan, H. Hu, A. C. Begen, D. Oran, "Probe and Adapt: Rate-Adaptation for HTTP Video Streaming at Scale," IEEE Journal on Selected Areas in Communications, Vol. 32, No. 4, April 2014, pp. 719-733. EXTERNAL
C. Zhou, X. Zhang, L. Huo, and Z. Guo, "A control-theoretic approach to rate adaptation for dynamic HTTP streaming," Visual Comm. Image Processing, San Diego, CA, 2012, pp. 1-6. EXTERNAL
K. Spiteri, R. Urgaonkar, R. K. Sitaraman, "BOLA: Near-Optimal Bitrate Adaptation for Online Videos," Annual IEEE International Conference on Computer Communications, 2016, pp. 1-9. EXTERNAL
C. Midoglu, A. Zabrovskiy, O. Alay, D. Holbling-Inzko, C. Griwodz, C. Timmerer, "Docker-Based Evaluation Framework for Video Streaming QoE in Broadband Networks," ACM International Conference on Multimedia, Nice, France, 21 - 25 October 2019, pp. 2288–2291. EXTERNAL
FFmpeg, https://www.ffmpeg.org/ EXTERNAL
I. Ayad, Y. Im, E. Keller, S. Ha, "A Practical Evaluation of Rate Adaptation Algorithms in HTTPbased Adaptive Streaming", Elsevier Computer Networks vol. 133, 2018, pp. 90-103. EXTERNAL
DASH Industry Forum, "Low-Latency Modes for DASH", https://dashif.org/docs/CR-Low-Latency-Live-r8.pdf EXTERNAL
R. Netravali, A. Sivaraman, S. Das, A. Goyal, K. Winstein, J. Mickens, H. Balakrishnan, "Mahimahi: accurate record-and-replay for HTTP," USENIX Annual Technical Conference, Santa Clara, CA, July 8-10, 2015. EXTERNAL
B. Girod, M. Kalman, Y.J. Liang, and R. Zhang, "Advances in channel-adaptive video streaming," Wireless Comm. and Mobile Comp., vol. 2, no. 6, 2002, pp. 573-584. EXTERNAL
ETSI technical specification, "MPEG-DASH Profile for Transport of ISO-BMFF Based DVB Services over IP Based Networks", https://www.etsi.org/deliver/etsi_ts/103200_103299/103285/01.03.01_60/ts_10328v010301p.pdf EXTERNAL
B. Zhang, "Low-Latency DASH Streaming Using Open-Source Tools", https://bozhang-26963.medium.com/low-latency-dash-streaming-using-open-source-tools-f93142ece69d EXTERNAL
A. Bentaleb, C. Timmerer, A. C. Begen, R. Zimmermann, "Bandwidth prediction in low-latency chunked streaming," ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, Amherst, MA, June 21, 2019, pp. 7–13. EXTERNAL
M. Lim, M. N. Akcay, A. Bentalab, A. C. Begen, R. Zimmermann, "When they go high, we go low: low-latency live streaming in dash.js with LoL," ACM Multimedia Systems Conference, Online, June 8-11, 2020. EXTERNAL
B. Zhang, T. Teixeira, Y. Reznik, "Performance of Low-Latency HTTP-based Streaming Players", ACM Multimedia Systems Conference, Istanbul, Turkey, Sept. 28 - Oct 1, 2021. EXTERNAL
X. Yin, A. Jindal, V. Sekar, B. Sinopoli, "A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP," SIGCOMM Comput. Commun. Rev. no. 45, vol. 4, 2015, pp. 325– 338. EXTERNAL
I. Ozcelik, C. Ersoy, "Low-Latency Live Streaming Over HTTP in Bandwidth-Limited Networks," IEEE Communications Letters, vol. 25, no. 2, 2021, pp. 450-454. EXTERNAL
T. Karagkioules, R. Mekuria, D. Griffioen, A. Wagenaar, "Online Learning for Low-Latency Adaptive Streaming," ACM Multimedia Systems Conference, Online, June 8-11, 2020. EXTERNAL
Hls.js player, https://github.com/video-dev/hls.js/ EXTERNAL
G. Ribezzo, L. D. Cicco, V. Palmisano, S. Mascolo, “A DASH 360° immersive video streaming control system,” in Internet Tech. Letters, vol. 3, no. 5, 2020. EXTERNAL
A. Zabrovskiy, E. Kuzmin, E. Petrov, C. Timmerer, C. Mueller, "AdViSE: Adaptive Video Streaming Evaluation Framework for the Automated Testing of Media Players," ACM Multimedia Systems Conference, Taipei, Taiwan, June 20-23, 2017. EXTERNAL
J. Jiang, V. Sekar, H. Zhang, "Improving Fairness, Efficiency, and Stability in HTTP-based Adaptive Video Streaming with FESTIVE," in IEEE/ACM Transactions on Networking, vol. 22, no. 1, Feb. 2014, pp. 326-340. EXTERNAL
B. Zhang, "Setting up your Own Low-Latency HLS Server to Stream from any Source Inputs", https://bozhang-26963.medium.com/setting-up-your-low-latency-hls-server-to-stream-from-any-source-inputs-de1e757a6688 EXTERNAL
Apple, Enabling Low-Latency HLS, https://developer.apple.com/documentation/http_live_streaming/enabling_low-latency_hls EXTERNAL
A. Bentaleb, B. Taani, A. C. Begen, C. Timmerer, R. Zimmermann, "A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP," in IEEE Communications Surveys & Tutorials, vol. 21, no. 1, 2019, pp. 562-585. EXTERNAL
DASH Low Latency Server, https://github.com/maxutility2011/node-gpac-dash EXTERNAL
A. Bentaleb, C. Timmerer, A. C. Begen, R. Zimmermann, "Performance Analysis of ACTE: A Bandwidth Prediction Method for Low-latency Chunked Streaming," ACM Trans. Multimedia Comp., Comm., and Applications, vol 16, no. 2s, 2020. EXTERNAL
D. Raca, J. Quinlan, A. Zahran, and C. Sreenan. "Beyond throughput: A 4G LTE dataset with channel and context metrics," ACM Multimedia Systems Conference, New York, NY, USA, 2018, pp 460–465. EXTERNAL
A. Mondal, B. Palit, S. Khandelia, N. Pal, J. Jayatheerthan, K. Paul, N. Ganguly, Sandip Chakraborty, "EnDASH - A Mobility Adapted Energy Efficient ABR Video Streaming for Cellular Networks," IFIP Networking Conference, 2020, pp. 127-135. EXTERNAL
Dash.js player, https://github.com/Dash-Industry-Forum/dash.js EXTERNAL
D. Wu, Y. Hou, W. Zhu, Y-Q. Zhang, and J. Peha, "Streaming video over the internet: approaches and directions," IEEE Trans. CSVT, vol. 11, no. 3, 2001, pp. 282-300. EXTERNAL
Blender Foundation, Big Buck Bunny video, https://download.blender.org/ EXTERNAL
NGINX web server, https://www.nginx.com/ EXTERNAL
IETF RFC 8216 [Active*]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001943.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Yuriy Reznik, Thiago Teixeira, and Bo Zhang; Performance of Low-Latency DASH/CMAF and Low-Latency HLS Streaming Systems, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001943

Snippet:

Yuriy Reznik, Thiago Teixeira, and Bo Zhang; Performance of Low-Latency DASH/CMAF and Low-Latency HLS Streaming Systems, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at https://doi.org/10.5594/M001943

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Yuriy Reznik, Thiago Teixeira, and Bo Zhang; <cite>Performance of Low-Latency DASH/CMAF and Low-Latency HLS Streaming Systems</cite>, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/M001943" target="_blank" rel="noopener">https://doi.org/10.5594/M001943</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Yuriy Reznik, Thiago Teixeira, and Bo Zhang; <cite id="bib-10-5594-m001943">Performance of Low-Latency DASH/CMAF and Low-Latency HLS Streaming Systems</cite>, SMPTE Meetings and Conferences ( November 2021); SMPTE, 2021
<span class="doi">10.5594/M001943</span>
</li>