Subjective Quality Evaluation of High Dynamic Range Video and Display for Future TV

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag J.
Volume: 124, No. 4, pp. 1–6
Abstract: The main objective of this paper is to verify test methodologies for the assessment of high dynamic range (HDR) video. To achieve this, a next generation HDR monitor by Dolby Laboratories was used to display professionally produced HDR content. Two complementary approaches for subjective assessment of HDR video were then designed and carried out at the European Broadcast Union and Ecole Polytechnique Fédérale de Lausanne premises. Results obtained from both evaluations were highly correlated, which shows that they offer a good degree of reliability and reproducibility in different situations. Analysis of the scores in both cases also shows good confidence intervals for each point under test. Finally, they could demonstrate that an increase in terms of quality of experience can be expected from the conventional level of 100 nits to HDR/high brightness at 4000 nits, with intermediate improvements at 400 and 1000 nits.
Publication Date: 2015-05-01
DOI: 10.5594/j18551
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/j18551
Author(s): Philippe Hanhart
bio
Philippe Hanhart received B.Sc. and M.Sc. degrees in electrical engineering from the Swiss Federal Institute of Technology in Lausanne (EPFL), in 2009 and 2011, respectively. Currently, he is working toward a Ph.D. degree and is a research assistant in the Multimedia Signal Processing Group. He is a recipient of the Anna Barbara Reinhard Prize for Student Excellence from the Institution of Engineering and Technology, top 10% best paper awards in MMSP2014 and ICIP2014, and has authored more than 30 publications. His research interests are in the fields of image and video processing to measure and improve quality of experience in immersive multimedia technologies, such as 3D, ultrahigh-definition, and high dynamic range (HDR).
Pavel Korshunov
bio
Pavel Korshunov is a postdoctoral researcher in the Multimedia Signal Processing Group at EPFL. He received a Ph.D. in computer science from National University of Singapore (NUS). He was a recipient of ACM TOMCCAP Nicolas D. Georganas Best Paper Award in 2011, two top 10% best paper awards in MMSP 2014 (16th International Workshop on Multimedia Signal Processing), and the top 10% best paper award in ICIP 2014 (International Conference on Image Processing. Korshunov is a co-editor of the new JPEG XT standard for HDR images, and has authored more than 50 publications. His research interests include computer vision and video analysis, video streaming, video and image quality assessment, crowdsourcing, high dynamic range imaging, ultrahigh-definition imaging, focus of attention, visual privacy protection mechanisms and their evaluation.
Touradj Ebrahimi
bio
Touradj Ebrahimi is a professor at the EPFL, where he is active in teaching and research of multimedia signal processing. He is also the convener of the JPEG committee, which has produced a family of standards that have revolutionized the world of imaging. He represents Switzerland as the head of its delegation to MPEG and JPEG standards and has contributed technical solutions to a large number of JPEG and MPEG standards and particularly in MPEG-2, MPEG-4, AVC/H.264, MVC, 3DVC, and HEVC/H.265. Ebrahimi serves as consultant, evaluator and expert for European Commission projects, for various governmental funding agencies in Europe, and also advises a few venture capital companies in Switzerland as a scientific and technical auditor.
Yvonne Thomas
bio
Yvonne Thomas graduated with a degree in television technologies and electronic media engineering from the University of applied Science Wiesbaden (HSRM), Germany, in October 2010. She received a prominent award of the ARD/ ZDF Academy for her thesis at the IFA in Berlin in September 2011. Following these studies, she joined the European Broadcasting Union (EBU) in the Technology and Innovation department in 2011. Since then she has been responsible for internal and external projects on 3D and future television technologies, such as UHDTV and LED studio lighting. Thomas coordinates the EBU's Strategic Program BeyondHD in which she led the creation of UHDTV and 3D test content. These were unique experiences and early bird projects that helps EBU members and research institutes to conduct further tests on formats beyond HD (codecs, displays, compression etc.). Further to this, Thomas has been involved in several standardization bodies, such as Digital Video Broadcasting and SMPTE, building the basis for more technical and strategic discussions and decision making for UHD technologies.
Hans Hoffmann
bio
Hans Hoffmann is senior manager and head of media fundamentals and production technologies in the EBU Technology and Innovation department. He joined the Institut für Rundfunktechnik (IRT) in 1993 as a research staff in new television production technologies. In February 2000, he became a senior engineer at the EBU, where he has been leading many activities on media, production technologies, video codec evaluations, established the EBU HDTV testing lab, and IT-based digital workflows and recently UHDTV. He has authored many EBU technical documents and IEEE (Institute of Electrical and Electronics Engineers) papers and is a standing speaker and contributor to international conferences. A SMPTE Fellow, Hoffmann served as SMPTE Engineering Vice President from 2011-2013. He is also a member of the FKT and IEEE.
Keyword(s): Video Signal Processing
Copyright: © 2015 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Perceptual Signal Coding for More Efficient Usage of Bit Codes [Active]
H. Seetzen, L. A. Whitehead, and G. Ward, “A High Dynamic Range Display Using Low and High Resolution Modulators,” SID Symp. Digest Tech. Papers, 34(1):1450-1453, May 2003. EXTERNAL
S. Daly, T. Kunkel, X. Sun, S. Farrell, and P. Crum, “Preference limits of the visual dynamic range for ultra high quality and aesthetic conveyance,” Proc. SPIE 8651, Human Vision and Electronic Imaging XVIII, March 2013. AcKnoWlEdgmEntS The authors would like to thank Dolby Laboratories Inc. staff, and in particular Suzanne Farrell, Sherif Gallab, and Timo Kunkel for providing Dolby Research HDR RGB backlight dual modulation display (aka Pulsar), HDR video, and help in the design, implementation, and analysis of the results. Furthermore, valuable help and input from the following individuals in the design, implementation, and analysis of tests reported in this paper are acknowledged: Andy Quested (BBC), Richard Salmon (BBC), Dagmar Driesnack (IRT), and Giorgio Dimino (RAI). First presented at IBC 2014, Amsterdam, The Netherlands, 11-15 September 2014. This paper is published here by kind permission of the IBC. Copyright © IBC. EXTERNAL
P. Hanhart, P. Korshunov, and T. Ebrahimi, “Subjective evaluation of higher dynamic range video,” Proc. SPIE 9217, Applications of Digital Image Processing XXXVII, September 2014. EXTERNAL
H. Seetzen, W. Heidrich, W. Stuerzlinger, G. Ward, L. Whitehead, M. Trentacoste, A. Ghosh, and A. Vorozcovs, “High Dynamic Range Display Systems,” ACM Trans Graphics, 23(3):760-768, August 2004. EXTERNAL
R-REC-BT.500-13 — Recommendation ITU-R BT.500-13, “Methodology for the Subjective Assessment of the Quality of Television Pictures,” International Telecommunication Union, Radiocommunication Sector, Geneva, 2012. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-j18551.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Philippe Hanhart, Pavel Korshunov, Touradj Ebrahimi, Yvonne Thomas, and Hans Hoffmann; Subjective Quality Evaluation of High Dynamic Range Video and Display for Future TV, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 4, May 2015); SMPTE, 2015. Available at https://doi.org/10.5594/j18551

Snippet:

Philippe Hanhart, Pavel Korshunov, Touradj Ebrahimi, Yvonne Thomas, and Hans Hoffmann; Subjective Quality Evaluation of High Dynamic Range Video and Display for Future TV, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 4, May 2015); SMPTE, 2015. Available at https://doi.org/10.5594/j18551

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Philippe Hanhart, Pavel Korshunov, Touradj Ebrahimi, Yvonne Thomas, and Hans Hoffmann; <cite>Subjective Quality Evaluation of High Dynamic Range Video and Display for Future TV</cite>, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 4, May 2015); SMPTE, 2015. Available at <a href="https://doi.org/10.5594/j18551" target="_blank" rel="noopener">https://doi.org/10.5594/j18551</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Philippe Hanhart, Pavel Korshunov, Touradj Ebrahimi, Yvonne Thomas, and Hans Hoffmann; <cite id="bib-10-5594-j18551">Subjective Quality Evaluation of High Dynamic Range Video and Display for Future TV</cite>, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 4, May 2015); SMPTE, 2015
<span class="doi">10.5594/j18551</span>
</li>

Metadata

Bibliographic Reference(s)

Reference Tree

Plain text (ISO 690 compliant)

HTML (ISO 690 compliant)

SMPTE's HTML Pub

Referenced By