A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 130, No. 7, pp. 22–30
- Abstract
- We have developed a computational model and a test model for predicting the brightness, a visual perception term, achieved by high-dynamic-range (HDR) televisions and computer monitors, in particular, those with materials that feature primary colors having high spectral purity. Quantum dot materials in combination with emissive pixel lighting is expanding the color gamut level to attain a degree of performance unmatched in today’s consumer and professional displays. These displays exhibit highly significant improvements in colorfulness and brightness owing to their narrowband primaries and to the Helmholtz–Kohlrausch (H–K) effect, where colors—notably reds and blues—are perceived as far brighter than their reference white. We blended the iCAM06 computational model originally designed for HDR image evaluation with an improved treatment of vivid colors. Our data collection relied on a rare, yet commercially available 2D spectroradiometer that captures up to 1.4 million samples of spectral data across any image, an achievement impossible to attain manually. Our approach coupled nicely with the filter image-processing steps in iCAM06. Finally, we extracted image brightness for white, red, and blue for determining the SEMI perceptual contrast length (PCL) to assess the predicted improvement level of our model and then matched those results to subjective experiments. As a result, we have a methodology that can be used by display makers to measure and predict brightness as a function of colorfulness to optimize luminance—notably for reducing power—in displays with spectrally pure primaries.
- Publication Date
- 2021-08-01
- DOI
10.5594/JMI.2021.3083571- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2021.3083571
- Author(s)
- Dale Stolitzka
bio
Dale Stolitzka is the principal engineer at the Samsung Display America Lab, San Jose, CA, who leads display standardization and this location’s Vision Lab. He leads or contributes substantially to industry standards in high-dynamic range (HDR), visual perception studies, motion artifact characterization, display compression, and transport protocols. He chairs the MIPI Alliance Display Working Group and the Video Electronics Standards Association (VESA) Display Steam Compression Task Group and was a past co-chair of the Joint Photographic Experts Group (JPEG) Coding, Test and Quality subgroup. He also is an active contributor to the International Committee for Display Metrology (ICDM). He champions HDR advancement and organic light-emitting diode (OLED) metrology. His experience spans consumer electronics displays, coding systems, and advanced transport mechanisms. Before joining Samsung, he developed computer and consumer electronics systems and mixed-signal system designs at Analog Devices, Santa Clara, CA, National Semiconductor, Santa Clara, Maxtor, San Jose, CA, and Raytheon, Mountain View, CA. He holds a BS degree in applied physics and an MEng degree in materials science and engineering, both from Cornell University, Ithaca, NY.Jong-Ho Chongbio
Jong-Ho Chong received an MA degree in image processing from Kyungpook National University, Daegu, South Korea, and was mainly the university’s image processing algorithm director for LCD mura detection based on perceptual concepts in 2006. He has been with Samsung Display, Yongin-si, South Korea, from 2006 to 2020 and had engaged in color science and image-quality evaluation. He is now conducting a PhD course at Kwangwoon University, Seoul, South Korea, for a digital holographic research. He has devoted much of his time to IEC TC100 and TC110 standardization work.ChangHee Leebio
Changhee Lee is an executive vice president of Samsung Display Company, Yongin-si, South Korea, where he is developing next-generation display technologies. He received a PhD degree in physics from the University of California, Santa Barbara, CA, in 1994. He is an SID Fellow and a member of the Korean Academy of Science and Technology.Jinoh Kwagbio
Jinoh Kwag is the executive vice president and the head of Display Research Center, Samsung Display, Yongin-si, South Korea. He has contributed to developing new LCD and OLED technologies with his outstanding leadership and rich experience for the last 30 years. Starting his career at Samsung SDI, he made a significant contribution in developing STN-LCD technology at SDI in 1987. After transferring to Samsung Electronics, he led projects of commercializing a series of TFT-LCD mobile and monitor products with a great success. After joining of Samsung Display Company, he led the development efforts of Slim-AMOLED display with integrated touch sensor (Super AMOLED) flexible Edge AMOLED(Y-OCTA) and hole-type AMOLED for Galaxy S Series and edge display. These technologies set a new trend in display industry and his achievements have contributed greatly to the sustainable success of the company. - Keyword(s)
- CIECAM02, Helmholtz-Kohlrausch Effect, HDR, iCAM06, Perceptual Contrast Length (PCL)
- Copyright
- © 2021 SMPTE
Bibliographic Reference(s)
- CIE.159.2004 — CIE 159:2004, “A Colour Appearance Model for Colour Management Systems: CIECAM02.” EXTERNAL
- R.W.G. Hunt, Measuring Colour, 2nd ed., Ellis Horwood: New York, 1991. EXTERNAL
- J. Van Derlofske et al., “3M™ Quantum Dot Enhancement Film (QDEF),” 3M Company, 2013. Accessed: Jul. 2, 2020. [Online]. Available: https://multimedia.3m.com/mws/media/985375O/3mtm-quantum-dot-enhancement-film-qdef-white-paper.pdf EXTERNAL
- G. Wyszecki and W. S. Stiles, Color Science, 2nd ed., Wiley: New York, NY, 2000. EXTERNAL
- CLASP, “New Video Test Sequence for Televisions,” CLASP: Washington, DC, 2016. Accessed: Jul. 2, 2020. [Online]. Available: https://clasp.ngo/updates/2016/new-video-test-sequence-for-televisions EXTERNAL
- J. Kuang, G. M. Johnson, and M. Fairchild, “iCAM06: A Refined Image Appearance Model for HDR Image Rendering,” J. Visual Commun. Image Representation, 18(5):406–414, Sept. 2007. EXTERNAL
- W. B. Cowan and C. Ware, “On the Brightness of Colours That Differ in Hue or Saturation,” ACM Comput. Surveys, 28:312– 314, 1987. EXTERNAL
- M. Fairchild, Color Appearance Models, 3rd ed., Wiley: New York, NY, 2013. EXTERNAL
- Y. Nayatani, “Simple Estimation Methods for the Helmholtz– Kohlrausch Effect,” Color Res. Appl., 22(6):385–401, Dec. 1997. EXTERNAL
- SEMI, D75-0118, “Test Method for Color Reproduction and Perceptual Contrast of Display,” Aug. 2017. EXTERNAL
- M. Wood, “Lightness – The Helmholtz–Kohlrausch Effect,” Out of the Wood, Summer 2012. Accessed: Jul. 2020. [Online]. Available: https://www.mikewoodconsulting.com/articles.htm EXTERNAL
- T. Shiga and S. Kitahara, “Power Reduction of OLED Displays by Tone Mapping Based on Helmholtz–Kohlrausch Effect,” IEICE Trans. Electron., E100-C(11):1026–1030, Nov. 2017. EXTERNAL
- C. Demers, “Peak Brightness of TVs—Max Luminosity and HDR Highlights” for RTINGS.com, Jun. 2016. Accessed: Jul. 2, 2020. [Online]. Available: https://www.rtings.com/tv/tests/picture-quality/peak-brightnessto remove any possible bias. The “—” results indicate the images were not tested for the particular question. As found in Experiment 1, a red foreground object stands out well, catches viewers’ attention, and should be rated as a highlighted region-of-interest object for computational purposes. The data shows significant viewer preference for Display A when PCLCOLOR exceeded 20%. The viewers overwhelmingly chose the display with more saturated colors and narrower primary color bandwidth. In one case, image # 53, viewers split their decision. This particular picture contained the brightest white (around a light fixture), but significantly less saturated color than any other pictures in the set. In terms of choosing a brighter or more vivid picture, our hypothesis is confirmed in a qualitative fashion and should be followed by another experiment to assess viewer reaction in degrees of PCLCOLOR. We note another singular result for image # 69 where viewers predominately favored Display A. However, the PCL ratio is the highest score in this test set, yet not preferred unanimously as might be expected by such a high computational score. This image will also be a subject of further study in a future phase. Excluding this one outlier, the subjective scoring correlated well with the PCL ratio, as shown by a Pearson correlation equal to 0.93. Discussion The evidence, both computationally and subjectively, supports integrating Nayatani’s model for H–K effect amplification with iCAM06 HDR image analysis. Furthermore, we used a critical reference display, but while valid, such a display is not practical for multiple demonstrations. Some HDR displays and certain cinema projectors in the market are expanding the boundaries of color range beyond DCI-P3; therefore, our study of colors beyond DCI-P3 is relevant. This paper has described a metrology and display analysis procedure that quantifies the brightness amplification when displays render highly saturated colors that extend beyond DCI-P3. However, we stopped short of recommending how the content delivery ecosystem should adapt to the study. There is prolific evidence of material technologies, such as quantum dot, increasing the primary color saturation and expanding the colors viewable on a display. We call for an industry dialogue to consider how to implement a production flow that makes use of greater and brighter color. SMPTE published SMPTE 428-121 and SMPTE 431-1 in 2006; it is natural to expect that state-of-the-art displays today can produce more colors that consumers will find desirable. Subjective testing with binary scoring has been useful and stable. We suggest further quantifying the brightness, colorfulness, vividness, and realism by testing with a larger population and image set and questioning with a Lickert-based scoring system. Undoubtedly, the code base we developed will be further refined to become of even greater value to the EXTERNAL
- Accessed: Jul. 2, 2020. [Online]. Available: https://www.nanosysinc.com/products EXTERNAL
- Accessed: Jul. 2, 2020. [Online]. Available: https://www.top-con-techno.co.jp/en/products-series/sr-5000/ EXTERNAL
- Video Electronics Standards Association (VESA) DisplayHDR Certified Products. Accessed: Jul. 2, 2020. [Online]. Available: https://displayhdr.org/certified-products/ EXTERNAL
- Y. Nayatani, “A Colorimetric Explanation of the Helmholtz– Kohlrausch Effect,” Color Res. Appl., 23(6):374–378, Dec. 1998. EXTERNAL
- C. Poynton, “Colour Appearance Issues in Digital Video, HD/UHD and D-Cinema,” PhD dissertation, Faculty of Applied Sciences, Simon Fraser University, 2018. EXTERNAL
- ITU-R BT.2020-2 [Active]
- SMPTE ST 428-1:2006 [Superseded]
- SMPTE ST 431-1:2006 [Active, Reaffirmed]
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2021.3083571.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Dale Stolitzka, Jong-Ho Chong, ChangHee Lee, and Jinoh Kwag; A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 7, August 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3083571
Snippet:
Dale Stolitzka, Jong-Ho Chong, ChangHee Lee, and Jinoh Kwag; A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 7, August 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3083571
HTML (ISO 690 compliant)
Preview:
Dale Stolitzka, Jong-Ho Chong, ChangHee Lee, and Jinoh Kwag; A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 7, August 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3083571
Snippet:
<span class="citation">Dale Stolitzka, Jong-Ho Chong, ChangHee Lee, and Jinoh Kwag; <cite>A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 7, August 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/JMI.2021.3083571" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2021.3083571</a></span>
SMPTE's HTML Pub
Preview:
Dale Stolitzka, Jong-Ho Chong, ChangHee Lee, and Jinoh Kwag; A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 7, August 2021); SMPTE, 2021
doi: 10.5594/JMI.2021.3083571
url: https://doi.org/10.5594/JMI.2021.3083571
doi: 10.5594/JMI.2021.3083571
url: https://doi.org/10.5594/JMI.2021.3083571
Snippet:
<li> Dale Stolitzka, Jong-Ho Chong, ChangHee Lee, and Jinoh Kwag; <cite id="bib-10-5594-jmi-2021-3083571">A Visual Model for Very Wide-Gamut HDR Displays That Accounts for the Helmholtz–Kohlrausch Effect</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 7, August 2021); SMPTE, 2021 <span class="doi">10.5594/JMI.2021.3083571</span> </li>