Methods for Evaluation of Digital Television Picture Quality

Metadata

Publisher: SMPTE — White Plains, NY
Doc Type: Conference Paper
Content Type: Original Research
Volume: 1996, No. 15, pp. 1–13
Abstract: With the emergence and proliferation of digital video compression in television systems, there is an increasing requirement for effective methods to evaluate picture quality. In this paper, we describe traditional and novel objective and subjective test methods. We review standard methods to subjectively evaluate picture quality, outline their limitations and suggest ways to change these subjective methods. In addition, we also discuss research into objective methods that employs perception-based models with easily measurable parameters that could give a high degree of correlation with subjective evaluation methods. Finally, we draw some conclusions about the types of research needed to further the development of methods for picture quality evaluation.
Publication Date: 1996-10-01
DOI: 10.5594/M00110
Link: https://doi.org/10.5594/M00110
Author(s): William Y. ZouPublic Broadcasting Service Alexandria, VA
Philip J. CorriveauCommunications Research Centre Ottawa, Ontario
Copyright: © 1996 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Zou W. Y. , “Performance Evaluation: From NTSC to Digitally Compressed Video,” SMPTE Journal , Dec. 1994 . EXTERNAL
10. Jones B. L. McManus P. R. , “Graphic Scaling of Qualitative Terms,” SMPTE Journal , November 1986 . EXTERNAL
11. Aldridge R. Davidoff J. Ghanbari M. Hands D. Pearson D. , “Recency Effect in the Subjective Assessment of Digitally-coded Television Pictures,” Rapport No. 1071, Proceedings of the MOSAIC Workshop Advanced Methods for the Evaluation of Television Picture Quality, Institute for Perception Research , Sept. 11, 1995 . EXTERNAL
12. Hamberg R. de Ridder H. , “Continuous Assessment of Perceptual Image Quality,” Rapport No. 1071, Proceedings of the MOSAIC Workshop Advanced Methods for the Evaluation of Television Picture Quality, Institute for Perception Research, Sept. 11, 1995 . EXTERNAL
13. Ardito M. Gunetti M. Visca M. , “Preferred Viewing Distance and Display Parameters,” Rapport No. 1071, Proceedings of the MOSAIC Workshop Advanced Methods for the Evaluation of Television Picture Quality, Institute for Perception Research , Sept. 11, 1995 . EXTERNAL
14. Ardito M. Gunetti M. , “The Impact of Display Parameters on the Quality Perceived by the Viewers,” IEEE 1995 . EXTERNAL
15. Rihs S. , “The Influence of Audio on Perceived Picture Quality and Subjective Audio-video Delay Tolerance,” Rapport No. 1071, Proceedings of the MOSAIC Workshop Advanced Methods for the Evaluation of Television Picture Quality, Institute for Perception Research , Sept. 11, 1995 . EXTERNAL
16. Barba J. Fenster P. Jeanty H. Gil J. , “Edge Detection in Cytology Using Local Statistical Properties,” SPIE vol. 974 Applications of Digital Image Processing XI ( 1988 ). EXTERNAL
17. ANSI standard T1.801.03-1996, “Digital Transport of One-Way Video Signals - Parameters for Objective Performance Assessment . EXTERNAL
18. Young R. A. , “Oh say, can you see? The physiology of vision,” SPIE vol. 1453 Human Vision, Visual Processing, and Digital Display II ( 1991 ). EXTERNAL
19. Lim J. , “Two-dimensional Signal and Image Processing,” Prentice Hall , 1990 . EXTERNAL
2. Technical Report 16: “DS-3 Transport for Contribution Application of System M-NTSC Television Signal - Analog Interface and Performance Objectives,” Committee T1-Telecommunications, May, 1991 . EXTERNAL
20. Carlson C. R. Cohen R. W. , “A Simple Psycho-physical Model for Predicting the Visibility of Displayed Information,” Proc. Soc. Infor. Display , vol. 21 . pp. 229 ( 1980 ). EXTERNAL
21. Teo P. C. Heeger D. J. , “Perceptual Image Distortion,” Proceedings of the First International Conference on Image Processing , vol. 2 pp. 982 – 986 , Austin, Nov. 1994 . EXTERNAL
22. Hamada H. Namba S. , “A Study on Objective Picture Quality Scales for Pictures Digitally Encoded for Broadcast,” IEICE Trans. com vol. 177 B No. 12 , Dec. 1994 . EXTERNAL
23. Saghri J. A. Cheatham P. S. Habibi A. , “An HVS-Based Image Quality Measure,” SPIE vol. 974 , Applications of Digital Image Processing XI ( 1988 ). EXTERNAL
24. Lubin J. , “A Visual Discrimination Model for Imaging System Design and Evaluation,” David Sarnoff Research Center , Feb. 1995 . EXTERNAL
25. Wolf S. , “Features for Automatic Quality Assessment of Digitally transmitted Video,” NTIA Report 90–264, US Department of Commerce , June, 1990 . EXTERNAL
26. Webster A. , “An Objective Video Quality Assessment System Based on Human Perception,” SPIE Human Vision, Visual Processing, and Digital Display IV, vol. 1913, San Jose, CA, Feb. 1993 . EXTERNAL
27. Wolf S. Webster A. , “Objective and Subjective Video Performance Testing of DS3 Rate Transmission Channels,” ANSI T1A1 contr. No. T1A1.5/93–060, April, 1993 . EXTERNAL
28. Seitz N. B. Wolf S. Voran S. Bloomfield R. , “User Oriented Measures of Telecommunication Quality,” IEEE Comm. Magazine , vol. 32 , No. 1 Jan. 1994 . EXTERNAL
29. Cressy C. P. Beakley G. W. , “Computer-based Testing of Digital Video Quality,” IS&T/SPIE's Symposium on Electronic Imaging Science and Technology, San Jose, CA, Feb. 1994 . EXTERNAL
3. Report 1206: “Methods for Picture Quality Assessment in Relation to Impairments from Digital Coding of Television Signals,” Reports of the CCIR, 1990 , Annex to vol. XI - part 1. EXTERNAL
30. Draft temporary document “Test Materials to be Used in Subjective Assessment” - ITU-R Document 11/6-E, 1996 sessions. EXTERNAL
4. E. S. Kohn and G. W. Beakley , “Resolution Testing of An HDTV CODEC with Moving Zone Plates,” 134th SMPTE Technical Conference, Toronto, Nov. 1992 . EXTERNAL
5. Beakley G. W. Caillouet C. R. Kohn E. S. Van Pelt J. L. , “Testing of a Digital HDTV CODEC Through the NASA Communications Network,” 1992 HDTV World Conference Proceedings, NAB, April 1992 . EXTERNAL
6. Beakley G. W. Kohn E. S. , “Transmission of Compressed Digital High-DefinitionVideo Through the NASA Communications Network,” Proceedings of SPIE Conference, San Diego, July 1992 . EXTERNAL
7. Teo P. Heeger D. , “Perceptual Image Distortion,” 1st. IEEE Intl. Conf. on Image Proc. , vol. 2 , pp. 982 – 986 , Nov. 1994 . EXTERNAL
8. Recommendation ITU-R BT. 500–6, “Methodology for the Subjective Assessment of the Quality of Television Pictures,” ITU-R 1974–1994 . EXTERNAL
9. Teunissen K. , “The Validity of CCIR Quality Indicators Along a Graphical Scale,” SMPTE Journal , vol. 105 , No. 3 , March 1996 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M00110.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

William Y. Zou and Philip J. Corriveau; Methods for Evaluation of Digital Television Picture Quality, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996. Available at https://doi.org/10.5594/M00110

Snippet:

William Y. Zou and Philip J. Corriveau; Methods for Evaluation of Digital Television Picture Quality, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996. Available at https://doi.org/10.5594/M00110

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">William Y. Zou and Philip J. Corriveau; <cite>Methods for Evaluation of Digital Television Picture Quality</cite>, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996. Available at <a href="https://doi.org/10.5594/M00110" target="_blank" rel="noopener">https://doi.org/10.5594/M00110</a></span>

SMPTE's HTML Pub

Preview:

William Y. Zou and Philip J. Corriveau; Methods for Evaluation of Digital Television Picture Quality, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996
doi: 10.5594/M00110
url: https://doi.org/10.5594/M00110

Snippet:

<li>
William Y. Zou and Philip J. Corriveau; <cite id="bib-10-5594-m00110">Methods for Evaluation of Digital Television Picture Quality</cite>, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996
<span class="doi">10.5594/M00110</span>
</li>