HDR and WCG Image Quality Assessment Using Color Difference Metrics

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2019, No. 10, pp. 1–22
Abstract: High Dynamic Range (HDR) and Wide Color Gamut (WCG) imagery is now mainstream across content creation. Thus, having a reliable way of evaluating HDR systems is essential. One common way of measuring the quality of an HDR system is measuring the color errors introduced along the imaging pipeline. Unfortunately, development of color difference metrics has been based on test patches, as opposed to natural imagery, with evaluation mostly limited to Standard Dynamic Range (SDR) databases. In this paper, we evaluate several color difference metrics on five publicly available HDR distortion databases consisting of natural images and subjective scores. Distortion types include lower frequency distortions such as those from tone-mapping as well as higher frequency distortions resulting from compression artifacts by the various compression schemes such as JPEG. We analyze these databases with the well-established CIE L*a*b* metrics (ΔE₀₀, ΔE₉₄) as well as two HDR specific metrics: ΔEz (Jzazbz) and ΔEITP (ICTCP). To quantify the performance, we use four standard performance evaluation procedures. We observe that ΔEITP outperforms the other color difference metrics on four out of five databases. We also perform statistical analysis which demonstrates the effectiveness of using ΔEITP to assess overall image quality of HDR/WCG content. Weaknesses of all metrics for one database suggests more advanced spatio-chromatic visual models are worth pursuing.
Publication Date: 2019-10-21
DOI: 10.5594/M001882
Link: https://doi.org/10.5594/M001882
Author(s): Anustup ChoudhuryDolby Laboratories, Inc.
Jaclyn PytlarzDolby Laboratories, Inc.
Scott DalyDolby Laboratories, Inc.
Keyword(s): HDR, Wide Color Gamut, Color Difference Metric, ICTCP, ΔEITP
Copyright: © 2019 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Perceptual Signal Coding for More Efficient Usage of Bit Codes [Active]
Hitting the Mark—A New Color Difference Metric for HDR and WCG Imagery [Active]
An Assessment of Reference Levels in HDR Content [Active]
Black Level Visibility as a Function of Ambient Illumination [Active]
CIE.1976.2019 — ISO/CIE 11664-4:2019(E) Colorimetry - Part 4: CIE 1976 L*a*b* Colour Space EXTERNAL
ISO/CIE 11664-6 [Active]
M. Rousselot et. al., “Quality assessment of HDR/WCG images using hdr uniform color spaces,” Journal of Imaging 5(1) (2019) EXTERNAL
Z. Mai et. al., “Optimizing a tone curve for backward-compatible high dynamic range image and video compression,” IEEE Transactions on Image Processing 20(6),1558-1571 (2011) EXTERNAL
E. Kirchner and N. Dekker, “Performance measures of colordifference equations: correlation coefficient versus standardized residual sum of squares,” J. Opt. Soc. Am. A 28, 1841–1848 (2011). EXTERNAL
E. Zerman, G. Valenzise, and F. Dufaux, “An extensive performance evaluation of fullreference HDR image quality metrics,” Quality and User Experience, vol. 2, no. 1, p. 5, Apr 2017. EXTERNAL
R. Dror, A. Willsky, and E. Adelson (2004) “Statistical characterization of real-world illumination” JOV V4, 821-837. EXTERNAL
J. Kuang, G. M. Johnson and M. D. Fairchild, “Icam06: A refined image appearance model for hdr image rendering,” Journal of Visual Communication and Image Representation 18(5), 406-414 (2007). Special issue on High Dynamic Range Imaging EXTERNAL
M. Narwaria et. al., “Tone mapping-based high-dynamic-range image compression: Study of optimization criterion and perceptual quality,” Optical Engineering 52, 102008 (2013) EXTERNAL
S. Y. Choi et. al., “Investigation of Large Display Color Image Appearance I: Important Factors Affecting Perceived Quality” JIST 52(4). 2008 EXTERNAL
T. C. Aydin, R. Mantiuk, and H-P. Seidel (2008) “Extending Quality Metrics to Full Luminance Range Images” SPIE EXTERNAL
A. Lahoulou et. al., “Knowledge-based taxonomic scheme for full-reference objective image quality measurement models” JIST 60(6). 2016 EXTERNAL
B. Keelan (2002) “Predicting Multivariate Image Quality from Individual Perceptual Attributes” IS&T PICS conference. EXTERNAL
P. A. García et. al., “Measurement of the Relationship Between Perceives and Computed Color Differences,” Optical Soc. Am., 24(7):1823–1829, Jul. 2007 EXTERNAL
R. Mantiuk, K. Myszkowski, and H.-P. Seidel, “A perceptual framework for contrast processing of high dynamic range images,” ACM Trans. Appl. Percept., vol. 3, no. 3, pp. 286–308, Jul. 2006. EXTERNAL
M. Fairchild, P. H. Chen, “Brightness, lightness, and specifying color in high-dynamicrange scenes and images,” Proc. SPIE 2011, 7867 EXTERNAL
Safdar et al., “Perceptually uniform color space for image signals including high dynamic range and wide gamut,” Optics Express. 2017. EXTERNAL
E. Reinhard et. al., “Photographic tone reproduction for digital images,” ACM Trans. Graph., vol. 21, no. 3, pp. 267–276, Jul. 2002. EXTERNAL
G. Valenzise et. al., “Performance evaluation of objective quality metrics for hdr image compression,” In: SPIE optical engineering + applications, International Society for Optics and Photonics (2014) EXTERNAL
P. Korshunov et. al., “Subjective quality assessment database of HDR images compressed with jpeg xt,” in QoMEX, May 2015, pp. 1–6. EXTERNAL
M. Vranjes, S. Rimac-Drlje and K. Grgic (2017) “Review of objective video quality metrics and performance comparison using different databases” J. Image Communication V28(1). EXTERNAL
ITU-T, “Methods, metrics and procedures for statistical evaluation, qualification and comparison of objective quality prediction models,” 2012. EXTERNAL
Alman et al., “Performance Testing of Color Difference Metrics Using a Color Tolerance Dataset,” COLOR research and application. June 1989. EXTERNAL
VQEG, “Final report from the video quality experts group on the validation of objective models of video quality assessment” (2003) EXTERNAL
T. Kunkel et. al., “Assessing Color Discernibility in HDR Imaging using Adaptation Hulls” EXTERNAL
https://www.mathworks.com/help/images/ref/localtonemap.html EXTERNAL
M. Rousselot et. al., “Impacts of viewing conditions on hdr-vdp2,” In EUSIPCO, pp. 1442-1446 (2018). EXTERNAL
R-REC-BT.2124 — International Telecommunication Union – Radiocommunication (ITU-R), Recommendation BT.2124, “Objective Metric for the Assessment of the Potential Visibility of Colour Difference in Television,” Jan. 2019. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001882.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Anustup Choudhury, Jaclyn Pytlarz, and Scott Daly; HDR and WCG Image Quality Assessment Using Color Difference Metrics, SMPTE Meetings and Conferences ( October 2019); SMPTE, 2019. Available at https://doi.org/10.5594/M001882

Snippet:

Anustup Choudhury, Jaclyn Pytlarz, and Scott Daly; HDR and WCG Image Quality Assessment Using Color Difference Metrics, SMPTE Meetings and Conferences ( October 2019); SMPTE, 2019. Available at https://doi.org/10.5594/M001882

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Anustup Choudhury, Jaclyn Pytlarz, and Scott Daly; <cite>HDR and WCG Image Quality Assessment Using Color Difference Metrics</cite>, SMPTE Meetings and Conferences ( October 2019); SMPTE, 2019. Available at <a href="https://doi.org/10.5594/M001882" target="_blank" rel="noopener">https://doi.org/10.5594/M001882</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Anustup Choudhury, Jaclyn Pytlarz, and Scott Daly; <cite id="bib-10-5594-m001882">HDR and WCG Image Quality Assessment Using Color Difference Metrics</cite>, SMPTE Meetings and Conferences ( October 2019); SMPTE, 2019
<span class="doi">10.5594/M001882</span>
</li>

Metadata

Bibliographic Reference(s)

Reference Tree

Plain text (ISO 690 compliant)

HTML (ISO 690 compliant)

SMPTE's HTML Pub

Referenced By