Validating Objective Measures of MPEG Video Quality

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE J
Volume: 107, No. 4, pp. 226–235
Abstract: In 1996, the American National Standards Institute (ANSI) adopted ANSI T1.801.03, which presents a number of new objective video quality metrics for quantifying the effects of digital compression and transmission impairments. The measurements in ANSI T1.801.03 were selected based on an extensive multilaboratory quality assessment study that included video systems from bit rates of 64 kbits/sec to 45 Mbits/sec and video test scenes that spanned a wide range of spatial and temporal coding difficulties. The set of objective video quality measurements effectively accounted for subjective judgments by human viewers. While 25 video systems were tested, this multilaboratory study did not include MPEG video systems and did not cover any bit rates between 1.6 and 10 Mbits/sec. This paper presents the results from two MPEG studies designed to fill in the bit-rate gap in the previous multilaboratory study.
Publication Date: 1998-04-01
DOI: 10.5594/J06401
ISSN: Print: 0036-1682
Link: https://doi.org/10.5594/J06401
Author(s): G. W. CermakGTE Laboratories, Inc., Waltham, MA 02254.
bio
Gregory Cermak specializes in applied psychophysics, using physical measures of perceptual stimuli to predict subjective responses by consumers. In addition to work on compressed video stimuli at the GTE Laboratories, he has conducted similar studies of speech quality there; and studies of traffic noise and acoustical measures, visual air quality and optical measures, and visual properties of painted surfaces and optical measures at the General Motors Research Laboratories. He has a Ph.D. in mathematical psychology from Stanford University.
S. WolfU.S. Dept. of Commerce, NTIA/ITS.N3, Boulder, CO 80303.
bio
Stephen Wolf received a B.S. in electrical engineering from Montana State University in 1979 and an M.S. in electrical and computer engineering from the University of California at Santa Barbara in 1983. From 1979 until 1988, he worked in design and development of radar signal processing techniques including inverse synthetic aperture radar (ISAR). Since 1988, he has been project leader for the Video Quality Standards Project at the Institute for Telecommunication Sciences, National Telecommunications and Information Administration, Boulder, Colo. Wolf is an active participant in the standardization activities of the ANSI-accredited T Committee's Working Group T1A1.5 (Multimedia Communications Coding and Performance) and has served as technical editor for two video performance standards, ANSI T1.801.01-1995 (Video Test Scenes) and ANSI T1.801.03-1996 (Objective Video Quality Parameters).
E. P. TweedyGTE Laboratories, Inc., Waltham, MA 02254.
bio
E. Patterson Tweedy graduated in 1940, with a degree in electrical engineering, from City and Guilds College, the engineering school of the Imperial College of Science and Technology in London. Most of his experience has been in the field of communication, including various forms of trunk telephone systems using both analog and digital transmission. In recent decades while employed by GTE Laboratories his attention has been devoted increasingly to video/audio systems, including satellite, cable, and broadcasting. For the last ten years he has been involved primarily in the use of digitally compressed video/audio applications, such as videoconferencing and entertainment to the home. Recent emphasis has been on evaluating applications using the H.261, H.323, and MPEG-1 and 2 standards.
M. H. PinsonU.S. Dept. of Commerce, NTIA/ITS.N3, Boulder, CO 80303.
bio
Margaret H. Pinson is a programmer for the Institute for Telecommunication Sciences, part of the U.S. Department of Commerce, where she develops applications for use in video and voice quality measurement research. She has a masters degree in computer science from the University of Colorado at Boulder.
A. A. WebsterU.S. Dept. of Commerce, NTIA/ITS.N3, Boulder, CO 80303.
bio
Arthur Webster received his M.S. in electrical engineering from the University of New Mexico in 1987. His work includes signal and image processing in such areas as radar, gyroscope testing, and laser speckle imaging. He has worked on video quality research since 1990 for the U.S. Department of Commerce, National Telecommunications and Information Administration (NTIA), and Institute for Telecommunication Sciences (ITS) at their Boulder Laboratories. He is currently active in national and international standards activities pertaining to multimedia performance assessment
Copyright: © 1998 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Correlation between Objective and Subjective Measurements for Video Compressed Systems [Active]
ITU-R BT.601.4 [Superseded]
1. Wolf S. , “Features for Automated Quality Assessment of Digitally Transmitted Video,” NTIA Report 90: 264 , June 1990 . EXTERNAL
10. Cermak G. W. Fay D. A. , “T1A1.5 Video Quality Project: GTE Labs Analysis,” ANSI T1A1 contribution number T1A1.5/94–148, Sept. 1994 . EXTERNAL
11. Cermak G. W. , “Consumer Acceptance of MPEG1 Video at 1.5 to 8.3 Mb/s.” ANSI T1A1 contribution number T1A1.5/96–108, May 1996 . EXTERNAL
12. Cermak G. W. , “Consumer Acceptance of MPEG2 Video at 3.0 to 8.3 Mb/s,” Broadband Access System, Lai W. S. (eds.), Proc. SPIE 2917 , pp. 53 – 62 , 1996 . EXTERNAL
13. ITU-T Rec. P.910, “Subjective Video Quality Assessment Methods for Multimedia Applications,” Recommendations of the ITU, Radiocommunication Sector. EXTERNAL
14. CCIR Rec. 500-5, “Method for the Subjective Assessment of the Quality of Television Pictures,” Recommendations of the ITU , Telecommunication Standardization Sector. EXTERNAL
16. ANSI T1.801.01-1995, American National Standard for Telecommunications—Digital Transport of Video Teleconferencing/Video Telephony Signals—Video Test Scenes for Subjective and Objective Performance Assessment. EXTERNAL
17. ITU-R Rec. BT.601-4, “Encoding Parameters of Digital Television for Studios,” Recommendations of the ITU , Radiocommunication Sector. EXTERNAL
18. Cermak G. , “Objective and Subjective Measures of MPEG Video Quality,” ANSI T1A1 contribution number T1A1.5/96-121, Oct. 1996 . EXTERNAL
19. ANSI T1.801.04-1997, “American National Standard for Telecommunications—Multimedia Communications Delay, Synchronization, and Frame Rate Measurement.” . EXTERNAL
20. Wolf S. Webster A. , “Objective and Subjective Video Performance Testing of DS3 Rate Transmission Channels,” ANSI T1A1 contribution number T1A1.5/93-60, April 1993 . EXTERNAL
21. ANSI T1.801.02-1996, American National Standard for Telecommunications—Digital Transport of Video Teleconferencing/Video Telephony Signals—Performance Terms, Definitions, and Examples. EXTERNAL
22. Bollen K. A. , Structural Equations With Latent Variables , Wiley : New York , 1989 . EXTERNAL
23. Cochran W. G. , “Some Effects of Errors of Measurement on Multiple Correlation,” J. Am. Stat. Assoc. , 65 : 22 – 34 , 1970 . EXTERNAL
3. Lubin J. , “A Visual Discrimination Model for Imaging System Design and Evaluation,” Report from the David Sarnoff Research Center, Feb. 1995 . EXTERNAL
4. Webster J. , “An Objective Video Quality Assessment System Based on Human Perception,” SPIE Human Vision, Visual Processing, and Digital Display IV. vol. 1913 , Feb. 1993 . EXTERNAL
5. Voran S. , “The Development of Objective Video Quality Measures that Emulate Human Perception,” IEEE Global Telecommunications Conference (GLOBECOM), Dec. 1991 . EXTERNAL
6. Cotton B. , “An Objective Model for Video Quality Performance,” ANSI T1A1 contribution number T1 A1.5/96-105, March 1996 . EXTERNAL
7. ITU-T Contribution to Question 22/12, COM 12-7 (Netherlands), “Objective measurement of video quality,” Feb. 1997 . EXTERNAL
8. ANSI T1.801.03-1996, American National Standard for Telecommunications—Digital Transport of One-Way Video Telephony Signals—Parameters for Objective Performance Assessment. EXTERNAL
9. ITU-T Contribution to Question 22/12, COM 12-66-E (USA), “Selections from the Draft American National Standard: Digital Transport of One-Way Video Signals—Parameters for Objective Performance Assessment,” Jan. 1996 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J06401.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

G. W. Cermak, S. Wolf, E. P. Tweedy, M. H. Pinson, and A. A. Webster; Validating Objective Measures of MPEG Video Quality, SMPTE Journal ( Volume: 107, Issue: 4, April 1998); SMPTE, 1998. Available at https://doi.org/10.5594/J06401

Snippet:

G. W. Cermak, S. Wolf, E. P. Tweedy, M. H. Pinson, and A. A. Webster; Validating Objective Measures of MPEG Video Quality, SMPTE Journal ( Volume: 107, Issue: 4, April 1998); SMPTE, 1998. Available at https://doi.org/10.5594/J06401

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">G. W. Cermak, S. Wolf, E. P. Tweedy, M. H. Pinson, and A. A. Webster; <cite>Validating Objective Measures of MPEG Video Quality</cite>, SMPTE Journal ( Volume: 107, Issue: 4, April 1998); SMPTE, 1998. Available at <a href="https://doi.org/10.5594/J06401" target="_blank" rel="noopener">https://doi.org/10.5594/J06401</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
G. W. Cermak, S. Wolf, E. P. Tweedy, M. H. Pinson, and A. A. Webster; <cite id="bib-10-5594-j06401">Validating Objective Measures of MPEG Video Quality</cite>, SMPTE Journal ( Volume: 107, Issue: 4, April 1998); SMPTE, 1998
<span class="doi">10.5594/J06401</span>
</li>

Metadata

Bibliographic Reference(s)

Reference Tree

Plain text (ISO 690 compliant)

HTML (ISO 690 compliant)

SMPTE's HTML Pub

Referenced By