Stereoscopy and the Human Visual System
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 121, No. 4, pp. 24–43
- Abstract
- Stereoscopic displays have become important for many applications, including operation of remote devices, medical imaging, surgery, scientific visualization, and computer-assisted design. But the most significant and exciting development is the incorporation of stereo technology into entertainment: specifically, cinema, television, and video games. In these applications for stereo, three-dimensional (3D) imagery should create a faithful impression of the 3D structure of the scene being portrayed. In addition, the viewer should be comfortable and not leave the experience with eye fatigue or a headache. Finally, the presentation of the stereo images should not create temporal artifacts like flicker or motion judder. This paper reviews current research on stereo human vision and how it informs us about how best to create and present stereo 3D imagery. The paper is divided into four parts: (1) getting the geometry right, (2) depth cue interactions in stereo 3D media, (3) focusing and fixating on stereo images, and (4) how temporal presentation protocols affect flicker, motion artifacts, and depth distortion.
- Publication Date
- 2012-05-01
- DOI
10.5594/j18173- ISSN
- Print:
1545-0279 - Link
- https://doi.org/10.5594/j18173
- Author(s)
- Martin S. Banks
bio
Martin Banks received a bachelor's degree at Occidental College in 1970, majoring in psychology and minoring in physics. After a year in Germany, he entered graduate school, receiving a master's in psychology at University of California, San Diego in 1973 and Ph.D. in developmental psychology from the University of Minnesota in 1976. He was assistant and associate professor of psychology at the University of Texas at Austin from 1976–1985. Banks moved to UC Berkeley School of Optometry in 1985 where he is professor of optometry and vision science. He was chair of Vision Science from 1995–2002. Banks has received several awards for basic and applied research on topics including human visual development, visual space perception, the development and evaluation of stereoscopic displays, and inter-sensory perception.Jenny C. A. Readbio
Jenny Read studied physics at Oxford University, graduating in 1994, and stayed on to do a doctorate in theoretical astrophysics. She began her neuroscience career in 1997 with a Wellcome Trust Training Fellowship in mathematical biology from Oxford's Laboratory of Physiology, receiving an M.Sc. in neuroscience in 1999. In 2001, she moved to the U.S. to work at the National Eye Institute at the National Institutes of Health in Maryland. Since 2005, Read has been at Newcastle University in the northeast of England on a Royal Society University Research Fellowship. Her research includes computational models of disparity encoding and psychophysical measurement of depth perception.Robert S. Allisonbio
Robert Allison is associate professor of computer science and engineering at York University in Toronto (Canada). He received a BASc in computer engineering from the University of Waterloo in 1991. After graduation, he worked as an electrical engineer at Atlantis Aerospace in Brampton, Canada, where he designed electronics for flight training devices. Following this, he completed a MASc in electrical engineering (biomedical engineering) from the University of Toronto before obtaining a Ph.D. specializing in stereoscopic vision from York University in 1998. He was on the experimental team for the 1998 Neurolab space shuttle mission and did post-doctoral research at York University and the University of Oxford. Allison works on perception of space and self-motion in virtual environments, the measurement and analysis of eye-movements, and stereoscopic vision.Simon J. Wattbio
Simon Watt received a bachelor's degree in psychology from Cardiff University, Wales, in 1994, and a masters in psychology from Surrey University, England, in 1996. He completed a Ph.D. in human vision and visuo-motor control at Surrey in 2001. He was then a postdoctoral researcher at the School of Optometry, UC Berkeley, before moving to a faculty position at the School of Psychology, Bangor University, Wales, in 2004, where he is now a senior lecturer. He does basic and applied research on several topics related to 3D perception and binocular vision. In particular, he works on perceptual and ergonomic problems with current 3D display technologies. He also carries out research on depth perception, how 3D vision is used to control everyday movements such as reaching to grasp, and how the brain combines 3D information across sensory modalities such as vision and touch. - Copyright
- © 2012 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- Studies of the Influence of Display Size and Picture Brightness on the Preferred Viewing Distance for HDTV Programs [Active]
- Allison R. S. “Analysis of the Influence of Vertical Disparities Arising in Toed-In Stereoscopic Cameras,” J. Imag. Sci. Tech. 51 317 327 , 2007 . EXTERNAL
- Allison R. S. Howard I. P. Fang X. “Depth Selectivity of Vertical Fusional Mechanisms,” Vision Res. 40 2985 2998 , 2000 . EXTERNAL
- Howard I. P. Allison R. S. Zacher J. E. “The Dynamics of Vertical Vergence,” Exp. Brain Res. 116 153 159 , 1997 . EXTERNAL
- Howard I. P. Fang X. Allison R. S. Zacher J. E. “Effects of Stimulus Size and Eccentricity on Horizontal and Vertical Vergence,” Exp. Brain Res. 130 124 132 , 2000 . EXTERNAL
- Rogers B. J. Bradshaw M. F. “Disparity Minimisation, Cyclovergence, and the Validity of Nonius Lines as a Technique for Measuring Torsional Alignment,” Perception 28 127 141 , 1999 . EXTERNAL
- Longuet-Higgins H. C. “A Computer Algorithm for Reconstructing a Scene from Two Projections,” Nature 293 133 135 , 1981 . EXTERNAL
- Gårding J. Porrill J. Mayhew J. E. Frisby J. P. “Stereopsis, Vertical Disparity and Relief Transformations,” Vision Res. 35 703 722 , 1995 . EXTERNAL
- Read J. C. A. Phillipson G. P. Glennerster A. “Latitude and Longitude Vertical Disparities,” J. Vision 9 ( 13 ) 11 37 , 2009 . EXTERNAL
- Rogers B. J. Bradshaw M. F. “Vertical Disparities, Differential Perspective and Binocular Stereopsis,” Nature 361 253 255 , 1993 . EXTERNAL
- Ogle K. N. “Induced Size Effect I: A New Phenomenon in Binocular Vision Associated with the Relative Size of the Images in the Two Eyes,” Archives of Ophthalmology 20 604 , 1938 . EXTERNAL
- Backus B. T. Banks M. S. van Ee R. Crowell J. A. “Horizontal and Vertical Disparity, Eye Position, and Stereoscopic Slant Perception,” Vision Res. 39 1143 1170 , 1999 . EXTERNAL
- Banks M. S. Backus B. T. “Extra-retinal and Perspective Cues Cause the Small Range of the Induced Effect,” Vision Res. 38 187 194 , 1998 . EXTERNAL
- Bradshaw M. F. Glennerster A. Rogers B. J. “The Effect of Display Size on Disparity Scaling from Differential Perspective and Vergence Cues,” Vision Res. 36 1255 1264 , 1996 . EXTERNAL
- Backus B. T. Banks M. S. “Estimator Reliability and Distance Scaling in stereoscopic Slant Perception,” Perception 28 217 242 , 1999 . EXTERNAL
- Glennerster A. Tcheang L. Gilson S. J. Fitzgibbon A. W. Parker A. J. “Humans Ignore Motion and Stereo Cues in Favor of a Fictional Stable World,” Curr. Biol. 16 428 432 , 2006 . EXTERNAL
- Geller T. “Overcoming the Uncanny Valley,” IEEE Comput. Graph. Appl. 28 11 17 , 2008 . EXTERNAL
- Vishwanath D. Girshick A. R. Banks M. S. “Why Pictures Look Right When Viewed from the Wrong Place,” Nat. Neurosci. 8 1401 1410 , 2005 . EXTERNAL
- Julesz B. “Binocular Depth Perception of Computer Generated Patterns,” Bell Syst. Tech. J. 39 1125 1162 , 1960 . EXTERNAL
- Helmholtz H. Physiological Optics. English Translation 1962 by J. P. C. Southall from the 3rd German Edition of Handbuch Der Physiologischen Optik. Vos, Hamburg Dover New York 1909 . EXTERNAL
- Burge J. Fowlkes C. C. Banks M. S. “Natural-Scene Statistics Predict How the Figure–Ground Cue of Convexity Affects Human Depth Perception,” J. Neurosci. 30 7269 7280 , 2010 . EXTERNAL
- Mather G. Smith D. R. “Depth Cue Integration: Stereopsis and Image Blur,” Vision Res. 40 3501 3506 , 2000 . EXTERNAL
- Held R. T. Cooper E. A. O'Brien J. F. Banks M. S. “Using Blur to Affect Perceived Distance and Size,” ACM Trans. On Graphics 29 1 16 , 2010 . EXTERNAL
- Howard I. P. Rogers B. J. Depth Perception Vol. 2 Porteous Toronto 2002 . EXTERNAL
- Bülthoff H. H. Mallot H. A. “Integration of Depth Modules: Stereo and Shading,” J. Opt. Soc. Am. A 5 1749 1758 , 1988 . EXTERNAL
- Clark J. J. Yuille A. L. Data Fusion for Sensory Information Processing Systems Cluwer Boston 1990 . EXTERNAL
- Landy M. S. Maloney L. T. Johnston E. B. Young M. “Measurement and Modeling of Depth Cue Combination: In Defense of Weak Fusion,” Vision Res. 35 389 412 , 1995 . EXTERNAL
- Fisher R. A. “Theory of Statistical Estimation,” Math. Proc. Camb. Phil. Soc. 22 700 725 , 1925 . EXTERNAL
- Knill D. C. “Learning Bayesian Priors for Depth Perception,” J. Vision 7 13 , 2007 . EXTERNAL
- Siegel M. Nagata S. “Just Enough Reality: Comfortable 3-D Viewing via Microstereopsis,” IEEE Trans. Circ. Syst. Video. Tech. 10 387 396 , 2000 . EXTERNAL
- Hillis J. M. Ernst M. O. Banks M. S. Landy M. S. “Combining Sensory Information: Mandatory Fusion Within, but Not Between, Senses,” Science 298 1627 1630 , 2002 . EXTERNAL
- Knill D. C. “Robust Cue Integration: A Bayesian Model and Evidence from Cue-Conflict Studies with Stereoscopic and Figure Cues to Slant,” J. Vision 7 1 24 , 2007 . EXTERNAL
- Meese T. S. Holmes D. J. “Performance Data Indicate Summation for Pictorial Depth-Cues in Slanted Surfaces,” Spat. Vis. 17 127 151 , 2004 . EXTERNAL
- Muller C. M. Brenner E. Smeets J. B. “Testing a Counter-intuitive Prediction of Optimal Cue Combination,” Vision Res. 49 134 139 , 2009 . EXTERNAL
- Allison R. S. Howard I. P. Rogers B. J. Bridge H. “Temporal Aspects of Slant and Inclination Perception , Perception 27 1287 1304 , 1998 . EXTERNAL
- Girshick A. R. Banks M. S. “Probabilistic Combination of Slant Information: Weighted Averaging and Robustness as Optimal Percepts,” J. Vision 9 1 20 , 2009 . EXTERNAL
- van Ee R. Adams W. J. Mamassian P. “Bayesian Modeling of Cue Interaction: Bistability in Stereoscopic Slant Perception,” J. Opt. Soc. Am. A Opt. Image Sci. Vis. 20 1398 1406 , 2003 . EXTERNAL
- Hillis J. M. Watt S. Landy M. S. Banks M. S. “Slant from Texture and Disparity Cues: Optimal Cue Combination,” J. Vision 4 967 992 , 2004 . EXTERNAL
- Allison R. S. Howard I. P. “Temporal Dependencies in Resolving Monocular and Binocular Cue Conflict in Slant Perception , Vision Res 40 1869 1885 , 2000 . EXTERNAL
- Woods A. J. Docherty T. Koch R. “Image Distortions in Stereoscopic Video Systems,” Proc. of SPIE, Stereoscopic Displays and Applications IV, Merritt J. O. Fisher S. S. Eds., 1993 . EXTERNAL
- Held R. T. Banks M. S. “Misperceptions in Stereoscopic Displays: A Vision Science Perspective , Proc. Of APGV08 , 5 23 31 , 2008 . EXTERNAL
- Tsirlin I. Allison R. S. Wilcox L. M. “Stereoscopic Transparency: Constraints on the Perception of Multiple Surfaces,” J. Vision 8 1 10 , 2008 . EXTERNAL
- Sakano Y. Ando H. “Effects of Head Motion and Stereo Viewing on Perceived Glossiness,” J. Vision 10 1 14 , 2010 . EXTERNAL
- Banks M. S. Held R. T. Girshick A. R. “Perception of 3-D Layout in Stereo Displays,” Information Display 25 12 16 , 2009 . EXTERNAL
- Berezin O. “Digital Cinema in Russia: Status of 2D/3D DC Rollout. Is 3D Still a Driver for the Development of the Cinema Market?” 3Dmedia2010, http://www.kinopoisk.ru . EXTERNAL
- Lambooij M. Ijsselsteijn W. Fortuin M. Heynderickx I. “Visual Discomfort and Visual Fatigue of Stereoscopic Displays: A Review,” J. Imag. Sci. Tech. 53 ( 3 ) 1 14 , 2009 . EXTERNAL
- Mendiburu B. 3D Movie Making: Stereoscopic Digital Cinema from Script to Screen Focal Press Oxford 2009 . EXTERNAL
- Akeley K. Watt S. J. Girshick A. R. Banks M. S. “A Stereo Display Prototype with Multiple Focal Distances,” ACM Trans. Graph. 23 804 813 , 2004 . EXTERNAL
- Emoto M. Niida T. Okano F. “Repeated Vergence Adaptation Causes the Decline of Visual Functions in Watching Stereoscopic Television,” J. Display Tech. 1 328 340 , 2005 . EXTERNAL
- Hoffman D. L. Girshick A. R. Akeley K. Banks M. S. Vergence–Accommodation Conflicts Hinder Visual Performance and Cause Visual Fatigue,” J. Vision 8 1 30 , 2008 . EXTERNAL
- Ukai K. “Visual Fatigue Caused by Viewing Stereoscopic Images and Mechanism of Accommodation,” . Proc. 1st Int. Symp. Univ. Comm. 176 179 , 2007 . EXTERNAL
- Ukai K. Howarth P. A. “Visual Fatigue Caused by Viewing Stereoscopic Motion Images: Background, Theories and Observations,” Displays 29 106 116 , 2008 . EXTERNAL
- Wann J. P. Mon-Williams M. “Health Issues with Virtual Reality Displays: What We Do Know and What We Don't,” ACM SIGGRAPH Comput. Graph. 31 53 57 , 1997 . EXTERNAL
- Watt S. J. Akeley K. Ernst M. O. Banks M. S. “Focus Cues Affect Perceived Depth,” J. Vision 5 834 862 , 2005 . EXTERNAL
- Yano S. Emoto M. Mitsuhashi T. “Two Factors in Visual Fatigue Caused by Stereoscopic HDTV Images,” Displays 25 141 150 , 2004 . EXTERNAL
- Liu S. Cheng D. Hua H. “An Optical See-Through Head Mounted Display with Addressable Focal Planes . IEEE Int. Symp. Mixed and Augmented Reality 33 41 , 2008 . EXTERNAL
- Love G. D. Hoffman D. M. Hands P. J. W. Gao J. Kirby A. K. Banks M. S. “High-Speed Switchable Lens Enables the Development of a Volumetric Stereoscopic Display,” Optic. Express 17 15715 15725 , 2009 . EXTERNAL
- MacKenzie K. J. Hoffman D. M. Watt S. J. “Accommodation to Multiple-Focal-Planes Displays: Implications for Improving Stereoscopic Displays, and for Accommodation Control,” J. Vision 10 ( 8 ) 22 , 2010 . EXTERNAL
- McDowall I. Bolas M. “FakeSpace Labs Accommodation Display Research,” unpublished report, 1994 . EXTERNAL
- MacKenzie K. J. Dickson R. Watt S. J. “Vergence and Accommodation to Multiple-Image-Plane Stereoscopic Displays: ‘Real World' Responses with Practical Image-Plane Separations?” SPIE Proc. XXII Stereoscopic Displays and Applications 7863 1 11 , 2011 . EXTERNAL
- Campbell F. W. “The Depth of Field of the Human Eye,” Opt. Acta 4 157 164 , 1957 . EXTERNAL
- Charman W. N. Whitefoot H. “Pupil Diameter and the Depth of Field of the Human Eye as Measured by Laser Speckle,” J. Mod. Optic. 24 1362 3044 , 1977 . EXTERNAL
- Scheiman M. Wick B. Clinical Management of Binocular Vision: Heterophoric, Accommodative, and Eye Movement Disorders J. B. Lippincott Philadelphia 1994 . EXTERNAL
- Percival A. S. “The Relation of Convergence to Accommodation and Its Practical Bearing,” Ophthalmol. Rev. 11 313 328 , 1892 . EXTERNAL
- Shibata T. Kim J. Hoffman D. M. Banks M. S. “The Zone of Comfort: Predicting Visual Discomfort with Stereo Displays,” J. Vision 11 1 28 , 2011 . EXTERNAL
- Sheedy J. E. Saladin J. J. “Phoria, Vergence, and Fixation Disparity in Oculomotor Problems,” Am. J. Optom. Physiol. Optic. 54 474 478 , 1977 . EXTERNAL
- Advanced Television Systems Committee (ATSC) “ATSC Planning Team 1 Interim Report,” 2011 , http://www.atsc.org/PT1/PT-1-Interim-Report.pdf . EXTERNAL
- Yang S.-N. Schlieski T. Selmins B. Cooper S. Doherty R. A. Corriveau P. J. Sheedy J. E. “Individual Differences and Seating Position Affect Immersion and Symptom in Stereoscopic 3D Viewing,” Technical Report, Vision Performance Institute, Pacific University, 2011 . EXTERNAL
- Schor C. M. Kotulak J. C. “Dynamic Interactions Between Accommodation and Convergence Are Velocity Sensitive,” Vision Res. 26 927 942 , 1986 . EXTERNAL
- Rushton S. K. Riddell P. M. “Developing Visual Systems and Exposure to Virtual Reality and Stereo Displays: Some Concerns and Speculations About the Demands on Accommodation and Vergence,” Appl. Ergon. 30 69 78 , 1999 . EXTERNAL
- Watson A. B. Ahumada A. J. Farrell J. E. “Window of Visibility: Psychophysical Theory of Fidelity in Time-Sampled Visual Motion Displays,” J. Opt. Soc. Am. 3 300 307 , 1986 . EXTERNAL
- Kelly D. H. “Motion and Vision. II. Stabilized Spatio-temporal Threshold Surface,” J. Opt. Soc. Am. 69 1340 1349 , 1979 . EXTERNAL
- Hoffman D. M. Karasev V. I. Banks M. S. “Temporal Presentation Protocols: Flicker Visibility, Perceived Motion, and Perceived Depth,” J. SID 19 255 281 , 2011 . EXTERNAL
- Tyler C. W. “Depth Perception in Disparity Gratings,” Nature 251 140 142 , 1974 . EXTERNAL
- Klompenhouwer M. A. Velthoven L. J. “Motion Blur Reduction for Liquid Crystal Displays: Motion-Compensated Inverse Filtering,” Proc. SPIE 5308 690 , 2004 . EXTERNAL
- Feng X. F. “LCD Motion-Blur Analysis, Perception, and Reduction Using Synchronized Backlight Flashing,” Proc. SPIE 6057 1 14 , 2006 . EXTERNAL
- Klompenhouwer M. A. “Flat Panel Display Signal Processing: Analysis and Algorithms for Improved Static and Dynamic Resolution,” Ph.D. thesis, Eindhoven Univ. Press, 2006 . EXTERNAL
- Morgan M. J. “Perception of Continuity in Stroboscopic Motion: A Temporal Frequency Analysis,” Vision Res. 19 523 532 , 1979 . EXTERNAL
- Burr D. C. Ross J. How Does Binocular Delay Give Information About Depth? Vision Res. 19 523 532 , 1979 . EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-j18173.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Martin S. Banks, Jenny C. A. Read, Robert S. Allison, and Simon J. Watt; Stereoscopy and the Human Visual System, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 4, May 2012); SMPTE, 2012. Available at https://doi.org/10.5594/j18173
Snippet:
Martin S. Banks, Jenny C. A. Read, Robert S. Allison, and Simon J. Watt; Stereoscopy and the Human Visual System, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 4, May 2012); SMPTE, 2012. Available at https://doi.org/10.5594/j18173
HTML (ISO 690 compliant)
Preview:
Martin S. Banks, Jenny C. A. Read, Robert S. Allison, and Simon J. Watt; Stereoscopy and the Human Visual System, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 4, May 2012); SMPTE, 2012. Available at https://doi.org/10.5594/j18173
Snippet:
<span class="citation">Martin S. Banks, Jenny C. A. Read, Robert S. Allison, and Simon J. Watt; <cite>Stereoscopy and the Human Visual System</cite>, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 4, May 2012); SMPTE, 2012. Available at <a href="https://doi.org/10.5594/j18173" target="_blank" rel="noopener">https://doi.org/10.5594/j18173</a></span>
SMPTE's HTML Pub
Preview:
Martin S. Banks, Jenny C. A. Read, Robert S. Allison, and Simon J. Watt; Stereoscopy and the Human Visual System, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 4, May 2012); SMPTE, 2012
doi: 10.5594/j18173
url: https://doi.org/10.5594/j18173
doi: 10.5594/j18173
url: https://doi.org/10.5594/j18173
Snippet:
<li> Martin S. Banks, Jenny C. A. Read, Robert S. Allison, and Simon J. Watt; <cite id="bib-10-5594-j18173">Stereoscopy and the Human Visual System</cite>, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 4, May 2012); SMPTE, 2012 <span class="doi">10.5594/j18173</span> </li>