Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization and Management Framework

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2017, No. 10, pp. 1–11
Abstract: There has been an increasing consensus in the video distribution industry that the design and operation of the full video delivery chain needs to be driven by the quality-of-experience (QoE) appropriate to the end-user. In practice, however, this is an extremely difficult task, largely due to the lack of effective mechanisms to instantaneously measure or predict every viewer's QoE. Moreover, existing quality assurance methods operate independently at different points along the delivery chain, reporting partial, inopportune, and incoherent measurements. This siloed structure leads to a fragmented understanding of the resulting video as it moves through each stage of the delivery network - from the acquisition point and head-end down to the media data center, the network, and eventually the end-user's viewing devices. — Here we propose a new framework that uses a unified end-to-end solution to produce consistent QoE scores at all points along the delivery chain under the same evaluation criterion. This is a framework that produces a clear picture instantaneously to operation engineers, managing executives and content creators about how video QoE degrades along the chain, a framework that allows immediate issue identification, localization and resolution, a framework that enables quality and resource usage optimization of the delivery chain for each of its individual components or as a whole, and a framework that provides reliable predictive metrics for long-term strategic resource and infrastructure allocations. — The main challenge in the implementation of such a framework is to create a unified QoE metric or process by which to measure QoE that not only accurately predicts human QoE, but is also light-weight and versatile, readily plugged into multiple points in the video delivery chain as either a single-ended or double-ended measure, producing real-time QoE scores across a wide range of bitrates, video resolutions, frame rates and dynamic ranges, and combining presentation picture quality with video freezing and adaptive streaming events. We show that the SSIMPLUS metric offers the best promise to such a solution. Once such a framework and the QoE metric is deployed in a video distribution system, many benefits come naturally. We demonstrate the benefit using bandwidth optimization as an example.
Publication Date: 2017-10-23
DOI: 10.5594/M001774
ISBN: Print: 978-1-61482-959-1
Link: https://doi.org/10.5594/M001774
Author(s): Zhou WangUniversity of Waterloo, Canada
Abdul RehmanSSIMWAVE Inc., Canada
Keyword(s): QoE, Video Distribution System, Video Quality Assessment, Video Streaming, End-to-end Quality Assessment, Video Coding, Transcoding, Adaptive Bitrate Streaming
Copyright: © 2017 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

American Society of Cinematographers Technology Committee Progress Report 2016 [Active]
Z. Wang, E. P. Simoncelli and A. C. Bovik, "Multi-scale structural similarity for image quality assessment," IEEE Asilomar Conference on Signals, Systems and Computers, Nov. 2003. EXTERNAL
Z. Wang, L. Lu, and A. C. Bovik, “Video quality assessment based on structural distortion measurement,” Signal Processing: Image Communication, vol. 19, Feb. 2004. EXTERNAL
A. Rehman, K. Zeng and Z. Wang, "Display device-adapted video quality-of-experience assessment," IS&T/SPIE Electronic Imaging: Human Vision & Electronic Imaging, Feb. 2015. EXTERNAL
Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” IEEE Transactions on Image Processing, vol. 13, no. 4, Apr. 2004. EXTERNAL
SSIMPLUS: The most accurate video quality measure, https://www.ssimwave.com/from-the-experts/ssimplus-the-most-accurate-video-quality-measure/ EXTERNAL
Limelight Networks, “The state of online video,” https://www.limelight.com/video/, 2016. EXTERNAL
M. H. Pinson, “A new standardized method for objectively measuring video quality,” IEEE Transactions on Broadcasting, vol. 50, no. 3, pp. 312-322, Sept. 2004. EXTERNAL
O. Oyman, S. Singh, “Quality of experience for HTTP adaptive streaming services,” IEEE Communications Magazine, vol. 50, Apr. 2012. EXTERNAL
Z. Duanmu, K. Zeng, K. Ma, A. Rehman, and Z. Wang "A quality-of-experience index for streaming video," IEEE Journal of Selected Topics in Signal Processing, vol. 11, no. 1, pp. 154-166, Feb. 2017. EXTERNAL
Z. Wang, “New quality-of-experience measurement technologies: streamlining how videos are delivered to consumers,” IEEE Signal Processing Society Blogs, July 2017. EXTERNAL
Z. Li, A. Aaron, I. Katsavounidis, A. Moorthy and M. Manohara, “Toward A Practical Perceptual Video Quality Metric,” Netflix TechBlog, June, 2016 EXTERNAL
M. Seufert, S. Egger, M. Slanina, T. Zinner, T. Hobfeld, and P. Tran-Gia, “A survey on quality of experience of HTTP adaptive streaming,” IEEE Communications Surveys & Tutorials, vol. 17, no. 1, Sept. 2014. EXTERNAL
Cisco Inc., “Cisco Visual Networking Index: Forecast and Methodology 2015-2020”, 2016. EXTERNAL
T-REC-P.10 — International Telecommunications Union-Telecommunication (ITU-T), Recommendation P.10/G.100, Amd.1, “New Appendix I Definition of Quality of Experience (QoE),” 2007. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001774.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Zhou Wang and Abdul Rehman; Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization and Management Framework, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1. Available at https://doi.org/10.5594/M001774

Snippet:

Zhou Wang and Abdul Rehman; Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization and Management Framework, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1. Available at https://doi.org/10.5594/M001774

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Zhou Wang and Abdul Rehman; <cite>Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization and Management Framework</cite>, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1. Available at <a href="https://doi.org/10.5594/M001774" target="_blank" rel="noopener">https://doi.org/10.5594/M001774</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Zhou Wang and Abdul Rehman; <cite id="bib-10-5594-m001774">Begin with the End in Mind: A Unified End-to-End Quality-of-Experience Monitoring, Optimization and Management Framework</cite>, SMPTE Meetings and Conferences ( October 2017); SMPTE, 2017, ISBN: 978-1-61482-959-1
<span class="doi">10.5594/M001774</span>
</li>