SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multimedia

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 114, No. 4, pp. 152–160
Abstract: This paper proposes a novel methodology, SAMVIQ, to be used primarily for formal subjective evaluations of video contents in the multimedia domain. SAMVIQ stands for Subjective Assessment Methodology for Video Quality. First, the conventional methods used to assess the quality of moving pictures in television are briefly described. Then, by pointing out some principal differences between conventional television and multimedia video, the details of the SAMVIQ methodology, which has been designed for the multimedia environments, are introduced. The main advantages of SAMVIQ are highlighted and some examples of how it can be efficiently used for the evaluation of video codecs in both clear and error-prone environments are shown.
Publication Date: 2005-04-01
DOI: 10.5594/J11535
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/J11535
Author(s): F. Kozamernik
bio
Emmanuel Wyckens was born in 1969 and graduated with a degree in electronic engineering from Valenciennes University (France) in 1994, having specialized in images. In 1998, he joined France Telecom R&D and became involved in the development of digital processing algorithms for improving the video quality in MPEG-2 codecs. Wyckens' current activities are in the field of subjective video quality in multimedia (streaming and videoconferencing) applications, and in the standard- and high-definition television domains. He also participates in the work of EBU project group, Video in Multimedia (B/VIM).
V. Steinmann
bio
Volker Steinmann was born in Germany. In 2001, he received a degree in television techniques and electronic media from the University of Applied Science in Wiesbaden, Germany. He worked for two years at a streaming service provider where he was responsible for the technical realization of live streaming events. Since January 2003, Steinmann has worked at IRT, the R&D institute of German, Austrian, and Swiss public broadcasters. His activities are mainly focused on video-quality assessment for broad- and webcasting, as well as audio and video transport over IP.
P. Sunna
bio
Paola Sunna was born in Italy in 1971. In 1997, she received a degree in electronic engineering from the Politecnico of Turin. Her thesis was on objective video quality assessments in the MPEG-2 domain. Since then, Sunna has been working at RAI CRIT (the Centre for Research and Technological Innovation of the Italian broadcaster RAI); her activities are mainly focused on full lab testing of video-quality assessment schemes for broadcasting, webcasting, and 3G applications. Since 2002, she has been the chair of EBU project group Video in Multimedia (B/VIM), which has defined the new subjective methodology for multimedia quality evaluation—SAMVIQ.
E. Wyckens
Copyright: © 2005 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. In this paper, multimedia is used in a broad sense to embrace media content delivery over IP datacast channels to consumers using small handheld terminals such as mobile phones, portable PCs, and PDAs. EXTERNAL
10. By comparison, DSCQS and DSIS are capable of establishing a quality level relative to a reference sequence. EXTERNAL
11. The lower the standard deviation, the higher the consistency of results . EXTERNAL
12. This example is taken from France Telecom's software package . EXTERNAL
13. EBU B/VIM 043: Rejection criteria of assessors in the context of image quality assessments using a continuous quality scale, Contribution from France Telecom R&D, authors: Emmanuel Wyckens, Jean-Louis Blin, Jean-Charles Gicquel, Nov. 2002 . EXTERNAL
14. B/VIM is in the process of evaluating several playout cards in order to be able to playout standard-definition (SDTV) television pictures directly from PC to TV monitor . EXTERNAL
15. EBU BPN 055—Subjective viewing evaluations of some internet video codecs—Phase 1, Report by the EBU Project Group B/VIM (Video In Multimedia), May 2003 . EXTERNAL
16. EBU B/VIM 083: Subjective tests on video streaming in error-prone networks, Contribution from France Telecom R&D, authors: Emmanuel Wyckens, Jean-Louis Blin, Jean-Charles Gicquel, June 2004 . EXTERNAL
2. ITU-R BT 500.11: Methodology for the Subjective Assessment of the Quality of Television Pictures (Question ITU-R 211/11), Geneva, 2004 . EXTERNAL
3. Another important document is ITU-T Recommendation P.911 entitled “Subjective Audiovisual Quality Assessment Methods for Multimedia Applications,” Dec. 1998 . EXTERNAL
4. See, for instance, IST SOQUET project, which defines the “objective evaluation of Perceived Quality of Service (PQoS),” in order to manage the resources to meet users' end-to-end quality requirements. IST SOQUET (IST-2000-28521): System for management of quality of service in 3G networks, 2003 . EXTERNAL
5. EBU BPN 056: SAMVIQ—Subjective Assessment Methodology for Video Quality . Report by the EBU Project Group B/VIM (Video In Multimedia), May 2003 . EXTERNAL
6. ITU-R Recommendation BS.1534 “Method for Subjective Assessment of Intermediate Audio Quality:” see also BPN 049 “The EBU Subjective Listening Tests on Low Bit rate. Audio Codecs.” Report by the EBU Project Group B/AIM Audio in Multimedia, Sept. 2002 . EXTERNAL
7. Quality assessments are defined as those that establish the performance of systems under optimum conditions . Impairment assessments are used to study the systems subjected to nonoptimum conditions such as error-prone transmission and emission. EXTERNAL
8. Punctum proximum is defined as the nearest viewing distance, which is subjectively determined by the viewer's eyes for optimum accommodation to a given display . EXTERNAL
9. Document ITU-R 6Q/57-E: Draft New Recommendation for Subjective Assessment of Streaming Multimedia Images by Non-expert Viewers, source : EBU , Geneva , 27 April 2004 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J11535.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

F. Kozamernik, V. Steinmann, P. Sunna, and E. Wyckens; SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multimedia, SMPTE Motion Imaging Journal ( Volume: 114, Issue: 4, April 2005); SMPTE, 2005. Available at https://doi.org/10.5594/J11535

Snippet:

F. Kozamernik, V. Steinmann, P. Sunna, and E. Wyckens; SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multimedia, SMPTE Motion Imaging Journal ( Volume: 114, Issue: 4, April 2005); SMPTE, 2005. Available at https://doi.org/10.5594/J11535

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">F. Kozamernik, V. Steinmann, P. Sunna, and E. Wyckens; <cite>SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multimedia</cite>, SMPTE Motion Imaging Journal ( Volume: 114, Issue: 4, April 2005); SMPTE, 2005. Available at <a href="https://doi.org/10.5594/J11535" target="_blank" rel="noopener">https://doi.org/10.5594/J11535</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
F. Kozamernik, V. Steinmann, P. Sunna, and E. Wyckens; <cite id="bib-10-5594-j11535">SAMVIQ—A New EBU Methodology for Video Quality Evaluations in Multimedia</cite>, SMPTE Motion Imaging Journal ( Volume: 114, Issue: 4, April 2005); SMPTE, 2005
<span class="doi">10.5594/J11535</span>
</li>