Advanced Frame Rate Conversion and Performance Evaluation

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 115, No. 4, pp. 153–159
Abstract: A growing need for high-quality video frame rate conversion methods exists, such as those offered by motion-compensated frame interpolation (MCFI). However, with MCFI inaccurate motion trajectories may cause visible artifacts. An advanced MCFI-based frame rate converter has been developed that uses image segmentation, object-based motion field processing, and a method for measuring motion reliability. It is able to accurately estimate true motion trajectories and process motion occlusion well, producing high-quality frames with smooth motion. In this paper, the methods, algorithms, and techniques used in this advanced frame rate converter are first described. Then, objective and subjective performance comparisons are conducted between the proposed frame rate converter and four other frame rate converters.
Publication Date: 2006-04-01
DOI: 10.5594/J12254
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/J12254
Author(s): P. Blanchfield
bio
Phil Blanchfield received a diploma in electronics engineering technology from Algonquin College of Applied Arts and Technology in Ottawa, Canada, in 1981. He later earned two certificate diplomas in computing science also from Algonquin College. He has been working full time at the Communications Research Centre (CRC) in Ottawa since 1981 where he has held various positions including hardware research technologist, systems programmer, systems/network analyst, and video processing systems researcher.
D. Wang
bio
Demin Wang received BS and MS degrees in electrical engineering from the Shandong University of Technology, China, in 1982 and 1985, respectively, and a PhD from the Institut National des Sciences Appliquees (INSA) de Rennes, France, in 1992. In 1985, he joined the Shandong University of Technology where he served as a professor of electrical and computer engineering from 1992 to 1993. He was a visiting researcher at the University of Sherbrooke, Canada, from 1993 to 1994, and a visiting professor at the IRISA Rennes, France, from 1994 to 1995. Since 1996, he has been with the Communications Research Centre, Canada, where he is currently a senior scientist and project leader of video coding and processing. Wang's research interests include image processing, video coding, digital TV, and broadcasting. He has published over 80 journal and conference papers and holds two U.S. patents. He is also an associate editor for IEEE Trans. on Broadcasting.
A. Vincent
bio
André Vincent received a BS in electrical engineering from the École Polytechnique, Montréal, Canada, in 1975. From 1975 to 1977, he worked at the Department of National Defence, in the design of maritime communications systems. From 1977 to 1979, he worked at Canadian Marconi in the design and development of mobile radio communications systems. He joined the Communications Research Centre in Ottawa, Canada, in 1979, where he conducted research in the areas of Teletext, data transmission, television channel characterization, and digital mobile radio. Since 1986, he has been involved in research in HDTV, video processing, video compression, and 3-D video. Vincent has also been involved in several standardization bodies such as the ACATS, ATSC, MPEG, and ITU-R. He is currently manager of the Advanced Video Systems Group at the Communications Research Centre, Canada.
F. Speranza
bio
Filippo Speranza received a PhD in experimental psychology from the University of Toronto (Canada) in 1999. In 2001, he joined the Communications Research Centre where he serves as a research scientist in the Advanced Television Evaluation Laboratory (ATEL). His research interests are human visual perception, stereoscopic displays, and image-quality assessment.
R. Renaud
bio
Ron Renaud joined the Communications Research Centre in 1991 to assist in conducting formal subjective evaluations of proposed HDTV systems. Prior to that, he worked for many years at the Canadian Broadcasting Corp. He is currently senior technologist within the CRC's Advanced Video Systems group, which includes the Advanced Television Evaluation Laboratory (ATEL), a world-class video subjective assessment facility.
Copyright: © 2006 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Wang D. Vincent A. , “Uncertainty of Motion Estimation and its Application to Video Processing,” Proc. of Conf. on IPMU2002 , Annecy, France, pp. 493 – 500 , July 1–5, 2002 . EXTERNAL
2. Wang D. Vincent A. Blanchfield P. , “Hybrid De-interlacing Algorithm Based on Motion Vector Reliability,” The 7th World Multiconference on Systemics, Cybernetics and Informatics, Orlando, FL, July 27–30, 2003 . EXTERNAL
3. Wang D. Lauzon D. , “Hybrid Algorithm for Estimating True Motion Fields,” Opt. Eng. , 39 ( 11 ): 2876 – 2881 , Nov. 2000 . EXTERNAL
4. Wang D. , “A Multiscale Gradient Algorithm for Image Segmentation Using Watersheds,” Pattern Recog. , 30 ( 12 ): 2043 – 2052 , Dec. 1997 . EXTERNAL
5. Wang D. , “Unsupervised Video Segmentation Based on Watersheds and Temporal Tracking,” IEEE Trans, Circuits and Systems for Video Technology, Special Issue on Segmentation, Description, and Retrieval of Video Content , 8 ( 5 ): 539 – 546 , Sept. 1998 . EXTERNAL
6. Wang D. Ronsin J. , “High-Resolution Color Image Segmentation Using Multiscale Gradient and Watersheds,” Picture Coding Symposium 2001, Seoul, Korea, pp. 335 – 338 , April 25–27, 2001 . EXTERNAL
7. Wang D. Vincent A. , “A Method for Temporal Interpolation of an Image Sequence Using Object-Based Image Analysis,” US patent No. 6,625,333 B1, Sept. 23, 2003 . EXTERNAL
8. ITU-R Rec. BT. 500, “Methodology for the Subjective Assessment of the Quality of Television Picture,” 1974–2001 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J12254.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

P. Blanchfield, D. Wang, A. Vincent, F. Speranza, and R. Renaud; Advanced Frame Rate Conversion and Performance Evaluation, SMPTE Motion Imaging Journal ( Volume: 115, Issue: 4, April 2006); SMPTE, 2006. Available at https://doi.org/10.5594/J12254

Snippet:

P. Blanchfield, D. Wang, A. Vincent, F. Speranza, and R. Renaud; Advanced Frame Rate Conversion and Performance Evaluation, SMPTE Motion Imaging Journal ( Volume: 115, Issue: 4, April 2006); SMPTE, 2006. Available at https://doi.org/10.5594/J12254

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">P. Blanchfield, D. Wang, A. Vincent, F. Speranza, and R. Renaud; <cite>Advanced Frame Rate Conversion and Performance Evaluation</cite>, SMPTE Motion Imaging Journal ( Volume: 115, Issue: 4, April 2006); SMPTE, 2006. Available at <a href="https://doi.org/10.5594/J12254" target="_blank" rel="noopener">https://doi.org/10.5594/J12254</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
P. Blanchfield, D. Wang, A. Vincent, F. Speranza, and R. Renaud; <cite id="bib-10-5594-j12254">Advanced Frame Rate Conversion and Performance Evaluation</cite>, SMPTE Motion Imaging Journal ( Volume: 115, Issue: 4, April 2006); SMPTE, 2006
<span class="doi">10.5594/J12254</span>
</li>