High Frame Rates and Human Vision: A View through the Window of Visibility

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 122, No. 2, pp. 18–32
Abstract: There is new interest in higher frame rates for digital cinema. The frame rate and subsequent processing have a large impact on the presence of artifacts in the final presentation. The structure of these artifacts is revealed by transforming the sequence of frames into the spatiotemporal frequency domain. The visibility of these artifacts can be determined through application of a tool called the window of visibility. This is a simplified representation of human visual sensitivity to spatial and temporal frequencies. This paper describes the capture and display of movies in signal processing terms. It shows how the several steps in the process can by represented in space and time and in spatial and temporal frequency. It then introduces the window of visibility as a simplified version of the human visual contrast sensitivity function. It shows how the tool can be used to compute the lowest artifact-free frame rate under simplified circumstances. It also shows how it can be used to visualize the impact of various steps in processing the image sequence. Finally, the paper describes the influence of luminance, eccentricity, color, and eye movements on the size and shape of the window of visibility. In conclusion, the tool provides a useful aid to understanding the role of human visual sensitivity in the selection of frame rates and frame processing. The paper also provides an interactive demonstration that allows exploration of the trade-offs in movie capture and display.
Publication Date: 2013-03-01
DOI: 10.5594/j18266XY
ISSN: Print: 1545-0279
Link: https://doi.org/10.5594/j18266XY
Author(s): Andrew B. Watson
Copyright: © 2013 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

High Frame Rate Distribution [Active]
10. Robson J. G. , “Spatial and Temporal Contrast Sensitivity Functions of the Visual System,” J. Opt. Soc. Am. , 56 : 1141 – 1142 , 1966 . EXTERNAL
11. Potmesil M. Chakravarty I. , “Modeling Motion Blur in Computer Generated Images,” Comput. Graph. , 17 ( 3 ): 389 – 399 , 1983 . EXTERNAL
12. Watson A. B. , “Temporal Sensitivity,” in Boff K. Kaufman L. Thomas J. (Eds.) , Handbook of Perception and Human Performance Wiley New York 1986 . EXTERNAL
13. Tyler C. W. Hamer R. D. , “Analysis of Visual Modulation Sensitivity. IV. Validity of the Ferry-Porter Law,” J. Opt. Soc. Am. A , 7 ( 4 ): 743 – 758 , 1990 , http://www.ncbi.nlm.nih.gov/pubmed/2338596 . EXTERNAL
14. Watson A. B. Yellott J. I. , “A Unified Formula for Light-Adapted Pupil Size,” J. Vis. , 12 ( 10 ), 2012 , http://journalofvision.org/12/10/12/ . EXTERNAL
15. Farrell J. E. Benson B. L. Haynie C. R. , “Predicting Flicker Thresholds for Video Display Terminals,” Proc. SID , 28 ( 4 ): 449 – 453 , 1987 . EXTERNAL
16. Barten P. G. J. , Contrast Sensitivity of the Human Eye and Its Effects on Image Quality SPIE Optical Engineering Press Bellingham, WA 1999 . EXTERNAL
17. Rabin J. , “Luminance Effects on Visual Acuity and Small Letter Contrast Sensitivity,” Optom. Vis. Sci. , 71 : 685 – 688 , 1994 . EXTERNAL
18. Mullen K. T. , “The Contrast Sensitivity of Human Colour Vision to Red–Green and Blue–Yellow Chromatic Gratings,” Journal of Physiology , 359 : 381 – 400 , 1985 . EXTERNAL
19. Varner D. , “Temporal Sensitivities Related to Color Theory,” J. Opt. Soc. Am. A , 1 : 474 – 481 , 1984 . EXTERNAL
2. Watson A. B. Ahumada A. J. Jr. Farrell J. , “Window of Visibility: Psychophysical Theory of Fidelity in Time-Sampled Visual Motion Displays,” J. Opt. Soc. Am. A , 3 ( 3 ): 300 – 307 , 1986 , http://www.opticsinfobase.org/viewmedia.cfm?uri=josaa-3-3-300&seq=0 . EXTERNAL
20. Drasdo N. Millican C. L. Katholi C. R. Curcio C. A. , “The Length of Henle Fibers in the Human Retina and a Model of Ganglion Receptive Field Density in the Visual Field,” Vis. Res. , 47 ( 22 ): 2901 – 2911 , 2007 , http://www.ncbi.nlm.nih.gov/pubmed/17320143 . EXTERNAL
21. Koenderink J. J. Bouman M. A. Bueno de Mesquita A. E. Slappendel S. , “Perimetry of Contrast Detection Thresholds of Moving Spatial Sine Wave Patterns. II. The Far Peripheral Visual Field (Eccentricity 0°–50°),” J. Opt. Soc. Am. , 68 : 850 – 854 , 1978 . EXTERNAL
22. Watson A. B. Malo J. , “Video Quality Measures Based on the Standard Spatial Observer,” presented at the International Conference on Image Processing, Rochester, NY , 2002 . EXTERNAL
23. Watson A. B. Hu J. McGowan J. F. III , “Digital Video Quality Metric Based on Human Vision,” J. Electron. Imag. , 10 ( 1 ): 20 – 29 , 2001 , http://vision.arc.nasa.gov/publications/jei2000_2wc.doc.pdf . EXTERNAL
24. Renz-Whitmore E. , “Beyond FPS: Shutter Angle & Shape Drive Our Experience of Motion Onscreen,” Pro Video Coalition, http://provideocoalition.com/pvcexclusive/story/beyond_fps_shutter_angle_shape_drive_our_experience_of_motion_onscreen , 2012 . EXTERNAL
25. Watson A. B. , “Vision Science: Demonstration of the Window of Visibility,” http://visionscience.com/cdf/watson-windowofvisibility-demo.html . EXTERNAL
3. Watson A. B. Ahumada A. J. , “Blur Clarified: A Review and Synthesis of Blur Discrimination,” J. Vis. , 11 ( 5 ): 1 – 23 , 2011 , http://journalofvision.org/11/5/10/ . EXTERNAL
4. Bracewell R. N. , The Fourier Transform and Its Applications , 3rd ed. , McGraw-Hill Boston 2000 . EXTERNAL
5. Hewlett G. Pettitt G. , “DLP Cinema™ Projection: A Hybrid Frame-Rate Technique for Flicker-Free Performance,” J. SID , 9 ( 3 ): 221 – 226 , 2001 , http://dx.doi.org/10.1889/1.1828795 . EXTERNAL
6. Watson A. B. , “Display Motion Blur: Comparison of Measurement Methods,” J. SID , 18 ( 2 ): 179 – 190 , 2010 . EXTERNAL
7. Schade O. H. Sr. , “Optical and Photoelectric Analog of the Eye,” J. Opt. Soc. Am. , 46 ( 9 ): 721 – 739 , 1956 . EXTERNAL
8. van Nes F. L. Bouman M. A. , “Spatial Modulation Transfer in the Human Eye,” J. Opt. Soc. Am. A , 57 : 401 – 406 , 1967 . EXTERNAL
9. de Lange H. , “Research into the Dynamic Nature of the Human Fovea–Cortex Systems with Intermittent and Modulated Light. I. Attenuation Characteristics with White and Colored Light,” J. Opt. Soc. Am. A , 48 : 777 – 784 , 1958 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-j18266XY.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Andrew B. Watson; High Frame Rates and Human Vision: A View through the Window of Visibility, SMPTE Motion Imaging Journal ( Volume: 122, Issue: 2, March 2013); SMPTE, 2013. Available at https://doi.org/10.5594/j18266XY

Snippet:

Andrew B. Watson; High Frame Rates and Human Vision: A View through the Window of Visibility, SMPTE Motion Imaging Journal ( Volume: 122, Issue: 2, March 2013); SMPTE, 2013. Available at https://doi.org/10.5594/j18266XY

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Andrew B. Watson; <cite>High Frame Rates and Human Vision: A View through the Window of Visibility</cite>, SMPTE Motion Imaging Journal ( Volume: 122, Issue: 2, March 2013); SMPTE, 2013. Available at <a href="https://doi.org/10.5594/j18266XY" target="_blank" rel="noopener">https://doi.org/10.5594/j18266XY</a></span>

SMPTE's HTML Pub

Preview:

Andrew B. Watson; High Frame Rates and Human Vision: A View through the Window of Visibility, SMPTE Motion Imaging Journal ( Volume: 122, Issue: 2, March 2013); SMPTE, 2013
doi: 10.5594/j18266XY
url: https://doi.org/10.5594/j18266XY

Snippet:

<li>
Andrew B. Watson; <cite id="bib-10-5594-j18266xy">High Frame Rates and Human Vision: A View through the Window of Visibility</cite>, SMPTE Motion Imaging Journal ( Volume: 122, Issue: 2, March 2013); SMPTE, 2013
<span class="doi">10.5594/j18266XY</span>
</li>