Assessing the Quality of Compressed Pictures Using a Perceptual Model
Metadata
- Publisher
- SMPTE — White Plains, NY
- Doc Type
- Conference Paper
- Content Type
- Original Research
- Volume
- 1998, No. 7, pp. 1–14
- Abstract
- This paper presents an objective image quality metric based on a model of the human visual system. It essentially consists of two stages. Firstly, a multi-channel early vision model, tuned specifically for complex natural scenes, is used to determine the visibility of coding errors at each location in the scene. A model of visual attention is then used to identify regions of interest in the scene. This allows the visible errors to be weighted, depending on the perceptual importance of the region in which they occur. It is demonstrated that this technique produces a high correlation with subjective test data (0.93), compared to 0.87 when only the early vision model is used, and 0.65 for PSNR. A description of how this technique can be extended to video quality assessment is also included.
- Publication Date
- 1998-10-01
- DOI
10.5594/M00303- Link
- https://doi.org/10.5594/M00303
- Author(s)
- Wilfried OsbergerMeasurement Business Division, Tektronix, Inc., Beaverton, Oregon
- Copyright
- © 1998 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- 1. Daly S. The visible difference predictor: an algorithm for the assessment of image fidelity . In Watson A. B. , editor, Digital Images and Human Vision , pages 179 – 206 . MIT Press , Cambridge, Massachusetts , 1993 . EXTERNAL
- 10. Eckstein M. P. Ahumada A. Watson A. B. Image discrimination models predict signal detection in natural medical image backgrounds . In Proceedings of SPIE - Human Vision and Electronic Imaging II , volume 3016 , pages 44 – 56 , February 1997 . EXTERNAL
- 11. Eriksson R. Andren B. Brunnstrom K. Modelling the perception of digital images: A performance study . In Proceedings of SPIE - Human Vision and Electronic Imaging III , volume 3299 , pages 88 – 97 , San Jose, CA, January 1998 . EXTERNAL
- 12. Stelmach L. B. Tam W. J. Hearty P. J. Static and dynamic spatial resolution in image coding: An investigation of eye movements . In Proceedings of the SPIE , volume 1453 , pages 147 – 152 , San Jose, 1991 . EXTERNAL
- 13. Yarbus A. L. Eye Movements and Vision. Plenum Press , New York , 1967 . EXTERNAL
- 14. Duchowski A. T. McCormick B. H. Pre-attentive considerations for gaze-contingent image processing . In Proceedings of the SPIE - Human Vision, Visual Processing and Digital Display VI , volume 2411 , pages 128 – 139 , San Jose, February 1995 . EXTERNAL
- 15. Dick M. Ullman S. Sagi D. Parallel and serial processes in motion detection Science 237 : 400 – 402 , 1987 . EXTERNAL
- 16. Findlay J. M. The visual stimulus for saccadic eye movements in human observers Perception 9 : 7 – 21 , September 1980 . EXTERNAL
- 17. Stark L. Yamashita I. Tharp G. Ngo H. X. Search patterns and search paths in human visual search . In Brogan D Gale A Carr K , editors, Visual Search 2 , pages 37 – 58 . Taylor and Francis , 1993 . EXTERNAL
- 18. Boersema T. Zwaga H. J. G. Searching for routing signs in public buildings: the distracting effects of advertisements . In Brogan D , editor, Visual Search , pages 151 – 157 . Taylor and Francis , 1990 . EXTERNAL
- 19. Gale A. G. Human response to visual stimuli . In Hendee W. R. Wells P. N. T. , editors, The Perception of Visual Information , pages 127 – 147 . Springer-Verlag , 1997 . EXTERNAL
- 2. Lubin J. The use of psychophysical data and models in the analysis of display system performance . In Watson A. B. , editor, Digital Images and Human Vision , pages 163 – 178 . MIT Press , Cambridge, Massachusetts , 1993 . EXTERNAL
- 20. Mackworth N. H. Morandi A. J. The gaze selects informative details within pictures . Perception and Psychophysics , 2 ( 11 ): 547 – 552 , 1967 . EXTERNAL
- 21. D'Zmura M. Color in visual search . Vision Research , 31 ( 6 ): 951 – 966 , 1991 . EXTERNAL
- 22. Nagy A. L. Sanchez R. R. Chromaticity and luminance as coding dimensions in visual search . Human Factors , 34 ( 5 ): 601 – 614 , 1992 . EXTERNAL
- 23. Elias G. S. Sherwin G. W. Wise J. A. Eye movements while viewing NTSC format television . SMPTE Psychophysics Subcommittee white paper, March 1984 . EXTERNAL
- 24. Enoch J. M. Effect of the size of a complex display on visual search . Journal of the Optical Society of America , 49 ( 3 ): 208 – 286 , 1959 . EXTERNAL
- 25. Cole B. L. Hughes P. K. Drivers don't search: they just notice . In Brogan D , editor, Visual Search , pages 407 – 417 . Taylor and Francis , 1990 . EXTERNAL
- 26. Walker-Smith G. J. Gale A. G. Findlay J. M. Eye movement strategies involved in face perception Perception 6 : 313 – 326 , 1977 . EXTERNAL
- 27. Osberger W. Maeder A. J. McLean D. A computational model of the human visual system for image quality assessment . In Proceedings DICTA-97, pages 337 – 342 , Auckland, New Zealand, December 1997 . EXTERNAL
- 28. Peli E. Contrast in complex images . Journal of the Optical Society of America A , 7 ( 10 ): 2032 – 2040 , October 1990 . EXTERNAL
- 29. Osberger W. Maeder A. J. Automatic identification of perceptually important regions in an image using a model of the human visual system . In 14th International Conference on Pattern Recognition, pages 701 – 704 , Brisbane, Australia, August 1998 . EXTERNAL
- 3. van den Branden Lambrecht C. J. Perceptual models and architectures for video coding applications. PhD thesis, Ecole Polytechnique Federale de Lausanne (EPFL), Lausanne, Switzerland, 1996 . EXTERNAL
- 30. de Ridder H. Minkowski-metrics as a combination rule for digital image coding impairments . In Proceedings of the SPIE - Human Vision, Visual Processing and Digital Display III, volume 1666 , pages 16 – 26 , San Jose, February 1992 . EXTERNAL
- 31. Independent JPEG Group codec, available from ftp.uu.net/graphics/jpeg . EXTERNAL
- 32. EPWIC-1 (Embedded Predictive Wavelet Image Coder), available from ftp.cis.upenn.edu/pub/butch/EPWIC . EXTERNAL
- 33. Methodology for the subjective assessment of the quality of television pictures . ITU-R Recommendation 500–6, 1994 . EXTERNAL
- 34. Eckert M. P. Buchsbaum G. The significance of eye movements and image acceleration for coding television image sequences . In Watson A. B. , editor, Digital Images and Human Vision , pages 89 – 98 . MIT Press , Cambridge, Massachusetts , 1993 . EXTERNAL
- 35. Westen S. J. P. Lagendijk R. L. Biemond J. Spatio-temporal model of human vision for digital video compression . In Proceedings of the SPIE - Human Vision and Electronic Imaging II , volume 3016 , pages 260 – 268 , San Jose, February 1997 . EXTERNAL
- 36. Tam W. J. Stelmach L. Wang L. Lauzon D. Gray P. Visual masking at video scene cuts . In Proceedings of the SPIE - Human Vision, Visual Processing and Digital Display VI , volume 2411 , pages 111 – 119 , February 1995 . EXTERNAL
- 37. Hamberg R. de Ridder H. Continuous assessment of time-varying image quality . In Proceedings of the SPIE - Human Vision and Electronic Imaging II , volume 3016 , pages 248 – 259 , February 1997 . EXTERNAL
- 38. Tan K. T. Ghanbari M. Pearson D. E. A video distortion meter . In PCS-97 , pages 119 – 122 , Berlin, Germany , September 1997 . IEEE . EXTERNAL
- 39. Osberger W. Maeder A. J. Bergmann N. W. A perceptually based quantisation technique for MPEG encoding . In Proceedings of the SPIE - Human Vision and Electronic Imaging III , volume 3299 , pages 148 – 159 , San Jose, January 1998 . EXTERNAL
- 4. Geri G. A. Zeevi Y. Y. Visual assessment of variable-resolution imagery . Journal of the Optical Society of America , 12 ( 10 ): 2367 – 2375 , October 1995 . EXTERNAL
- 5. Kortum P. Geisler W. Implementation of a foveated image coding system for image bandwidth reduction . In Proceedings of the SPIE - Human Vision and Electronic Imaging , volume 2657 , pages 350 – 360 , San Jose, February 1996 . EXTERNAL
- 6. Tsumura N. Endo C. Haneishi H. Miyake Y. Image compression and decompression based on gazing area . In Proceedings of the SPIE - Human Vision and Electronic Imaging , volume 2657 , pages 361 – 367 , San Jose, February 1996 . EXTERNAL
- 7. Ahumada A. J. Beard B. L. Object detection in a noisy scene . In Proceedings of the SPIE - Human Vision and Electronic Imaging , volume 2657 , pages 190 – 199 , February 1996 . EXTERNAL
- 8. Webster M. A. Miyahara E. Contrast adaption and the spatial structure of natural images Journal of the Optical Society of America A 14 ( 9 ): 2355 – 2366 , September 1997 . EXTERNAL
- 9. Watson A. B. Borthwick R. Taylor M. Image quality and entropy masking . In Proceedings of the SPIE - Human Vision and Electronic Imaging II , volume 3016 , pages 2 – 12 , February 1997 . EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M00303.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Wilfried Osberger; Assessing the Quality of Compressed Pictures Using a Perceptual Model, SMPTE Meetings and Conferences ( October 1998); SMPTE, 1998. Available at https://doi.org/10.5594/M00303
Snippet:
Wilfried Osberger; Assessing the Quality of Compressed Pictures Using a Perceptual Model, SMPTE Meetings and Conferences ( October 1998); SMPTE, 1998. Available at https://doi.org/10.5594/M00303
HTML (ISO 690 compliant)
Preview:
Wilfried Osberger; Assessing the Quality of Compressed Pictures Using a Perceptual Model, SMPTE Meetings and Conferences ( October 1998); SMPTE, 1998. Available at https://doi.org/10.5594/M00303
Snippet:
<span class="citation">Wilfried Osberger; <cite>Assessing the Quality of Compressed Pictures Using a Perceptual Model</cite>, SMPTE Meetings and Conferences ( October 1998); SMPTE, 1998. Available at <a href="https://doi.org/10.5594/M00303" target="_blank" rel="noopener">https://doi.org/10.5594/M00303</a></span>
SMPTE's HTML Pub
Preview:
Wilfried Osberger; Assessing the Quality of Compressed Pictures Using a Perceptual Model, SMPTE Meetings and Conferences ( October 1998); SMPTE, 1998
doi: 10.5594/M00303
url: https://doi.org/10.5594/M00303
doi: 10.5594/M00303
url: https://doi.org/10.5594/M00303
Snippet:
<li> Wilfried Osberger; <cite id="bib-10-5594-m00303">Assessing the Quality of Compressed Pictures Using a Perceptual Model</cite>, SMPTE Meetings and Conferences ( October 1998); SMPTE, 1998 <span class="doi">10.5594/M00303</span> </li>