Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization, and Management Framework

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 128, No. 2, pp. 1–8
Abstract: There has been an increasing consensus in the video distribution industry that the design and operation of the full video delivery chain need to be driven by the quality of experience (QoE) appropriate to the end users. Here, we propose a new framework that uses a unified end-to-end solution to produce consistent QoE scores at all points along the delivery chain under the same evaluation criterion. This is a framework that produces a clear picture instantaneously to operation engineers, managing executives, and content creators about how video QoE degrades along the chain; a framework that allows immediate issue identification, localization, and resolution; a framework that enables quality and resource usage optimization; and a framework that provides reliable predictive metrics for long-term strategic resource and infrastructure allocations. The main challenge in the implementation of such a framework is to create a unified QoE metric that not only accurately predicts human QoE but is also lightweight and versatile, readily plugged into multiple points in the video delivery chain. We show that the SSIMPLUS metric offers the best promise, and we demonstrate the benefits of the proposed framework and QoE metric using bandwidth optimization as an example.
Publication Date: 2019-03-01
DOI: 10.5594/JMI.2018.2887288
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2018.2887288
Author(s): Zhou Wang
Abdul Rehman
Keyword(s): Adaptive Bitrate Streaming, End-to-end Quality Assessment, QoE, Video Distribution System, Video Coding, Video Quality Assessment, Video Streaming, Transcoding
Copyright: © 2018 SMPTE

Bibliographic Reference(s)

American Society of Cinematographers Technology Committee Progress Report 2016 [Active]
Z. Wang, E. P. Simoncelli, and A. C. Bovik, “Multi-Scale Structural Similarity for Image Quality Assessment,” Proc. IEEE Asilomar Conference on Signals Systems Computers, pp. 1398–1402, Nov. 2003. EXTERNAL
M. Seufert et al., “A Survey on Quality of Experience of HTTP Adaptive Streaming,” IEEE Comm. Surveys Tutor., 17(1), Sept. 2014. EXTERNAL
Z. Wang, L. Lu, and A. C. Bovik, “Video Quality Assessment Based on Structural Distortion Measurement,” Signal Process. Image Comm., 19(2):121–132, Feb. 2004. EXTERNAL
Z. Wang, “New Quality-of-Experience Measurement Technologies: Streamlining How Videos Are Delivered to Consumers,” IEEE Signal Process. Soc. Blogs, July 2017. EXTERNAL
Cisco Inc., “Cisco Visual Networking Index: Forecast and Methodology 2015–2020,” 2016. EXTERNAL
O. Oyman and S. Singh, “Quality of Experience for HTTP Adaptive Streaming Services,” IEEE Commun. Mag., 50(4):20–27, Apr. 2012. EXTERNAL
Z. Wang and Q. Li, “Information Content Weighting for Perceptual Image Quality Assessment,” IEEE Trans. Image Process., 20(5):1185–1198, May 2011. EXTERNAL
A. Rehman, K. Zeng, and Z. Wang, “Display Device-Adapted Video Quality-of-Experience Assessment,” Proc. IS&T/SPIE Electronic Imaging: Human Vision & Electronic Imaging, Feb. 2015. EXTERNAL
Z. Wang et al., “Image Quality Assessment: From Error Visibility to Structural Similarity,” IEEE Tran.s. Image Process., 13(4):600–612, Apr. 2004. EXTERNAL
Z. Duanmu, K. Ma, and Z. Wang, “Quality-of-Experience for Adaptive Streaming Video: An Expectation Confirmation Theory Motivated Approach,” IEEE Trans. Image Process., 27(12):6135–6146, Dec. 2018. EXTERNAL
“SSIMPLUS: The Most Accurate Video Quality Measure.” [Online]. Available: https://www.ssimwave.com/from-the-experts/ssimplus-the-most-accurate-video-quality-measure/ EXTERNAL
Limelight Networks, “The State of Online Video,” 2016. [Online]. Available: https://www.limelight.com/video/ EXTERNAL
Z. Duanmu et al., “A Quality-of-Experience Index for Streaming Video,” IEEE J. Sel. Topics Signal Process., 11(1):154–166, Feb. 2017. EXTERNAL
M. H. Pinson, “A New Standardized Method for Objectively Measuring Video Quality,” IEEE Trans. Broadcast., 50(3):312–322, Sept. 2004. EXTERNAL
Z. Li et al., “Toward A Practical Perceptual Video Quality Metric,” Netflix TechBlog, June 2016. EXTERNAL
T-REC-P.10 — International Telecommunications Union-Telecommunication (ITU-T), Recommendation P.10/G.100, Amd.1, “New Appendix I Definition of Quality of Experience (QoE),” 2007. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2018.2887288.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Zhou Wang and Abdul Rehman; Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization, and Management Framework, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 2, March 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2018.2887288

Snippet:

Zhou Wang and Abdul Rehman; Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization, and Management Framework, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 2, March 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2018.2887288

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Zhou Wang and Abdul Rehman; <cite>Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization, and Management Framework</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 2, March 2019); SMPTE, 2019. Available at <a href="https://doi.org/10.5594/JMI.2018.2887288" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2018.2887288</a></span>

SMPTE's HTML Pub

Preview:

Zhou Wang and Abdul Rehman; Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization, and Management Framework, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 2, March 2019); SMPTE, 2019
doi: 10.5594/JMI.2018.2887288
url: https://doi.org/10.5594/JMI.2018.2887288

Snippet:

<li>
Zhou Wang and Abdul Rehman; <cite id="bib-10-5594-jmi-2018-2887288">Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization, and Management Framework</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 2, March 2019); SMPTE, 2019
<span class="doi">10.5594/JMI.2018.2887288</span>
</li>