Visual Perception Entropy Measure

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 128, No. 10, pp. 51–57
Abstract: This paper is about a theoretical framework on perceptual reproduction quality assessment. Visual perception is the main theme for two approaches on image metrics: visual performance and image quality. Visual performance looks at the perception of standard elementary images, such as gratings, by different observers or by a single observer in different visual conditions; image quality looks at the perception of variations of the same complex scene by a standard observer. In the audiovisual field, all the configurations approved by the creative team must be reproduced in the final viewing. This cannot be measured by visual performance or image quality indexes. A third approach is needed, which may be called perceptual reproduction quality assessment. Visual perception assessment is not measuring defects, per se; it is built to evaluate the perceptual effectiveness of a given scene coding through a given reproduction technology. It is only dependent on the number of configurations being perceived through a given theater system relative to the various configurations reproduced and approved in the review room. As such, it is a statistical measure. It is, in fact, similar to the definition of relative entropy. One important fact is that this evaluation must include a model of visual perception. This paper illustrates how relative entropy and entropy loss can be estimated, while taking into account the coding transform, the projector performances, maximum light, and the characteristics of the human visual system. This scheme works easily for monochromatic content. Color, trichromacy, is quite challenging. The size of configurations goes from 2¹² to 2³⁶, around 6 billion configurations. Calculation and memory requirements are huge. Nonlinearities are adding complexity, leading to calculation of an upper limit only of entropy loss. The presentation of results is also a challenge. One way to solve this is to separately process lightness and chromatic information. In summary, the main arguments in this paper are: 1) besides image quality and visual performance, there is a need for perceptual reproduction quality assessment; 2) entropy is the proper statistical estimator for evaluating the perceptual reproduction quality; and 3) color reproduction quality estimation requires processing lightness and chromatic attributes separately.
Publication Date: 2019-11-01
DOI: 10.5594/JMI.2019.2941361
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2019.2941361
Author(s): François Hel
bio
François Helt has 30 years of professional video and film experience with a background in mathematics, semantics, and filmmaking. Since 1991, he has been a research and development manager for special effects software teams, including film scanners and film printer drivers. Helt was a technical manager of the European project Limelight from 1994 to 1997, which focused on designing a full digital film restoration system. Between 1997 and 2002, he was the founder and chief executive officer of the DUST Company, Sophia Antipolis, France, specializing in digital film restoration and processing. From 2004 to 2006, he was the author of the software for automatic digital film restoration and designed software for color conversion and calibration software for digital cinema. Helt was the technical director of Doremi Technologies (Europe), Sophia Antipolis, France, from 2006 to 2012 and the chief scientific officer of Highlands Technologies Solutions, Sophia Antipolis, France, from January 2013 to December 2016. He has been a scientific consultant for EclairColor, Paris, France, since January 2017. Helt also designed a projection measurement system. His current interests include visual perception models, measurement theory, and philosophy of information.
Keyword(s): Entropy, Perception, PQ, Quality Metrics, Sensation
Copyright: © 2019 SMPTE

Bibliographic Reference(s)

Contrast Sensitivity Experiment to Determine the Bit Depth for Digital Cinema [Active]
Quality Assessment Framework for Color Conversions and Perception [Active]
C. E. Shannon and W. Weaver, The Mathematical Theory of Communication. University of Illinois Press: Urbana and Chicago, 1998 (first published in 1949). EXTERNAL
R. W. G. Hunt, Measuring Color, 3rd ed. Fountain Press: Kingston upon Thames, England, 1998. EXTERNAL
E. Reinhard and T. Kunkel, “A Reassessment of the Simultaneous Dynamic Range of the Human Visual System,” Proc. 7th Symp. Appl. Percept. Graph. Visual., Los Angeles, 2010. EXTERNAL
C. A. B. Peacocke, Sense and Content. Clarendon Press: Oxford, 1983. EXTERNAL
G. E. M. Anscombe and L. Wiitgenstein, Remarks on Color. Blackwell Publishing: Oxford, U.K., 2007 (first published in 1977). EXTERNAL
J. L. Austin, Sense and Sensibilia (G. J. Warnock, ed.). Clarendon Press: Oxford, 1962. Coded data (valid combinations) (Transport color space) Display color (sampling size function of real display apparatus) P3DCI Perception weighting (histogram size function of human visual system) L* Perception weighting a* Perception weighting b* EXTERNAL
W. F. Schreiber, Fundamentals of Electronic Imaging Systems, 3rd ed. Springer-Verlag: Berlin, 1992. EXTERNAL
P. G. J. Barten, Contrast Sensitivity of the Human Eye and its Effects on Image Quality. SPIE: Bellingham, WA, 1999. EXTERNAL
R-REC-BT.2246-1 — International Telecommunication Union - Radiocommunication (ITU-R), Report ITU-R BT.2246-1, “The Present State of Ultra High Definition Television,” Geneva, 2012. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2019.2941361.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

François Hel; Visual Perception Entropy Measure, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 10, 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2019.2941361

Snippet:

François Hel; Visual Perception Entropy Measure, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 10, 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2019.2941361

HTML (ISO 690 compliant)

Preview:

François Hel; Visual Perception Entropy Measure, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 10, 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2019.2941361

Snippet:

<span class="citation">François Hel; <cite>Visual Perception Entropy Measure</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 10, 2019); SMPTE, 2019. Available at <a href="https://doi.org/10.5594/JMI.2019.2941361" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2019.2941361</a></span>

SMPTE's HTML Pub

Preview:

François Hel; Visual Perception Entropy Measure, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 10, 2019); SMPTE, 2019
doi: 10.5594/JMI.2019.2941361
url: https://doi.org/10.5594/JMI.2019.2941361

Snippet:

<li>
François Hel; <cite id="bib-10-5594-jmi-2019-2941361">Visual Perception Entropy Measure</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 10, 2019); SMPTE, 2019
<span class="doi">10.5594/JMI.2019.2941361</span>
</li>