A Biological Framework for Perceptual Video Processing and Compression

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 119, No. 8, pp. 24–32
Abstract: The recent rapid evolution of video compression and high-definition has given consumers richer, more varied experiences than at any time before. Not surprisingly, content providers find themselves searching for ways to provide better video quality more efficiently. Until now, technical advances in Motion Picture Experts Group (MPEG) compression have been able to keep up with market needs, but there are limits even to MPEG efficiency. Fortunately, emerging technologies inspired by the biology of vision could enable MPEG compression to gain new levels of quality and efficiency. This paper introduces a framework for image and video processing that is based on decades of research into the biology of human vision. It describes how visual information is processed in the retina and early visual system. It also explains how design principles that are at work within the human visual system can be incorporated into advanced MPEG encoders and other broadcast equipment used in various existing broadband networks (cable, telecommunications, satellite, etc.), resulting in cost savings for service providers and a better-quality experience for consumers.
Publication Date: 2010-11-01
DOI: 10.5594/J17294
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/J17294
Author(s): Sean McCarthy
bio
Sean McCarthy , fellow of the technical staff, brings a unique convergence of expertise in video compression, signal processing and the neurobiology of human vision to content distribution at Motorola. McCarthy's duties include leading advancements in state-of-the-art of video processing, compression, and practical vision science. He held similar responsibilities previously as chief scientist at both Modulus Video, which is now part of Motorola, as well as at ViaSense, a U.C. Berkeley spin-off that developed commercial applications based on expert knowledge of the human visual system. The author of several papers on retinal processing, McCarthy holds several patents on image and signal processing and resides on the board of the MPEG Industry Forum. He earned a B.S. in physics from Rensselaer Polytechnic, and a Ph.D. in bioengineering jointly at U.C. Berkeley and U.C. San Francisco.
Copyright: © 2010 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Wang Z. Bovik A. C. , “Mean Squared Error: Love It or leave It,” IEEE Signal Process. Mag. , 28 : 98 – 117 , Jan. 2009 . EXTERNAL
10. Watanabe S. , “Information-Theoretic Aspects of Inductive and Deductive Inference , IBM J. Res. Dev. 4 , 208 – 231 , April 1960 . EXTERNAL
11. Barlow H. B. , “Redundancy Reduction Revisited,” Network: Comput. Neural Syst. , 12 : 241 – 253 , Aug. 2001 . EXTERNAL
12. McCarthy S. T. Owen W. G. , “Apparatus and Methods for Image and Signal Processing,” US Pat. 6014468 ( 2000 ), US Pat. 6360021 (2002), US Pat. 7046852 (2006), 1998. EXTERNAL
13. Vu T. Q. McCarthy S.T. Owen W. G. , “Linear Transduction of Natural Stimuli by Light-Adapted and Dark-adapted Rods of the Salamander,” J. Physiol. , 505 ( 1 ): 193 – 204 , Nov. 1997 . EXTERNAL
14. Field D. J. , “Relationship Between the Statistics of Natural Images and the Response Properties of Cortical Cells,” J. Opt. Soc. Am. , A4 ( 12 ): 2379 – 2394 , Dec. 1987 . EXTERNAL
15. Hare W. A. Owen W. G. , “Spatial Organization of the Biplolar Cell's Receptive Field in the Retina of the Tiger Salamander,” J. Physiol. , 421 : 223 – 245 , Feb. 1990 . EXTERNAL
2. Winkler S. , Digital Video Quality: Vision Models and Metrics , John Wiley & Sons, Ltd. : Chichester, West Sussex, England , 2005 . EXTERNAL
3. Digital Video Image Quality and Perceptual Coding , Edited by Wu H. R. Ra K.R. , CRC Press , 2006 . EXTERNAL
4. ITU-T Rec. H.264 | ISO/IEC 144496–10 AVC, “Advanced Video Coding for Generic Audiovisual Services,” International Telecommunications Union , Geneva , 2002 . EXTERNAL
5. Dowling J. E. , The Retina: An approachable Part of the Brain , Harvard Univ. Press : Cambridge, MA , 1987 . EXTERNAL
6. He S. Weiler R. Vaney D.I. , “Endogenous Dopaminergic Regulation of Horizontal Cell Coupling in the Mammalian Retina,” J. Comp. Neurology , ( 418 ) 1 : 33 – 40 , Feb. 2000 . EXTERNAL
7. Magel S. C. Dowling J. E. , “Responsiveness and Receptive Filed Size of Carp Horizontal Cells are Reduced by Prolonged Darkness and Dopamine,” Science , 229 ( 4718 ): 1107 – 1109 , Sept. 1985 . EXTERNAL
8. Attneave F. , “Information Aspects of Visual Perception,” Psychol. Rev. , 61 : 183 – 93 , May 1954 . EXTERNAL
9. Barlow H. B. , The Coding of Sensory Messages: Current Problems in Animal Behaviour , Ed. Thorpe W. H. Zangwill O. L. , Cambridge University Press : Cambridge, MA , 331 – 360 , 1961 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J17294.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Sean McCarthy; A Biological Framework for Perceptual Video Processing and Compression, SMPTE Motion Imaging Journal ( Volume: 119, Issue: 8, 2010); SMPTE, 2010. Available at https://doi.org/10.5594/J17294

Snippet:

Sean McCarthy; A Biological Framework for Perceptual Video Processing and Compression, SMPTE Motion Imaging Journal ( Volume: 119, Issue: 8, 2010); SMPTE, 2010. Available at https://doi.org/10.5594/J17294

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Sean McCarthy; <cite>A Biological Framework for Perceptual Video Processing and Compression</cite>, SMPTE Motion Imaging Journal ( Volume: 119, Issue: 8, 2010); SMPTE, 2010. Available at <a href="https://doi.org/10.5594/J17294" target="_blank" rel="noopener">https://doi.org/10.5594/J17294</a></span>

SMPTE's HTML Pub

Preview:

Sean McCarthy; A Biological Framework for Perceptual Video Processing and Compression, SMPTE Motion Imaging Journal ( Volume: 119, Issue: 8, 2010); SMPTE, 2010
doi: 10.5594/J17294
url: https://doi.org/10.5594/J17294

Snippet:

<li>
Sean McCarthy; <cite id="bib-10-5594-j17294">A Biological Framework for Perceptual Video Processing and Compression</cite>, SMPTE Motion Imaging Journal ( Volume: 119, Issue: 8, 2010); SMPTE, 2010
<span class="doi">10.5594/J17294</span>
</li>