How to Ensure a Good Depth Perception on a Light Field Display

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 130, No. 9, pp. 60–70
Abstract: In this article, we define the technical requirements for a light field display to provide effective depth cues such as binocular disparity, motion parallax, and accommodation at a pixel resolution expected by the eye. These requirements are evaluated with respect to existing technologies (e.g.,integral imaging displays) or expected future ones (e.g., micro-light-emitting diode (LED) displays). Simulation of light field displays are proposed for different display sizes (smartphone, desktop, or TV), resolution per view, and pixel pitch. These simulations convey the main impact of the pixel pitch to reach the light field display goal in terms of depth cue requirements. The last part of the paper focusses on data generation issues: how to generate the necessary amount of views at the display side and what the adapted data formats are for such a purpose. The paper is associated with supplementary videos that will illustrate the view generation topic using a dedicated data format that is optimized for current graphics processing unit (GPU) processors. Video capture of early-stage light field displays will also be provided.
Publication Date: 2021-10-01
DOI: 10.5594/JMI.2021.3090913
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2021.3090913
Author(s): Didier Doyen
bio
Didier Doyen is a principal scientist at Interdigital, Cesson-Sévigné, France, where he is currently working on research activities related to emerging light field and holographic technologies. He also participates in Motion Picture Experts Group (MPEG) standardization efforts to facilitate the introduction of these technologies. In 1989, he received a degree in electronic engineering from INSA, Rennes, France. In 1990, he joined Thomson, Cesson-Sévigné, where he first obtained experience in digital video product development for the broadcast market. Since 1996, he has been involved in research project developing video processing algorithms to improve picture quality of different display technologies. He has also been involved in movie theatre antipiracy technology development. He has managed several research projects for Technicolor, Cesson-Sévigné, addressing 3D stereoscopic video technologies and has been involved in different European collaborative projects [enhanced digital cinema (EDCINE), multimedia scalable 3D (MUSCADE), and Remote Collaborative Real-Time Multimedia Experience Over the Future Internet (ROMEO)] on the market.
Valérie Allié
bio
Valérie Allié leads the Digital Holography research group at Interdigital Research & Innovation, where she is developing technologies for new immersive experiences to render natural and computer graphic (CG) content with proper sensation of depth, parallax, and natural refocusing. This research group develops new video formats, associated content processing techniques, and innovative nanophotonic components to serve future mixed reality (MR) glasses-based experiences. She has rich experience in research labs management. She has also spent five years in technology transfer and licensing.
Arno Schubert
bio
Arno Schubert is a project leader at Interdigital Research & Innovation. He started his career as a professional photographer before graduating as an optical engineer from the Cologne University of Applied Science, Cologne, Germany, in 1990. He joined Thomson/Technicolor, Cesson-Sévigné, France, in 1991 and in 2019 he joined InterDigital, Cesson-Sévigné, where he was involved in different research programs covering projection technologies, flat displays, high-dynamic range (HDR), color management, and 3D. He is based in Rennes, France, and in recent years, has been managing projects that explore the whole light field technology chain, from acquisition to rendering volumetric video.
Keyword(s): Depth Perception, Light Field Display, Volumetric Video
Copyright: © 2021 SMPTE

Bibliographic Reference(s)

S. Reichelt et al., “Depth cues in human visual perception and their realization in 3D displays,” in Three-Dimensional Imaging, Visualization, and Display 2010, vol. 7690, B. Javidi and J.-Y. Son, Eds. Bellingham, WA, USA: SPIE, 2010. EXTERNAL
David Fattal et al., “A Multi-Directional Backlight for a Wide-Angle, Glasses-Free 3D Display,” Nature, 495(7441):348–351, Mar. 2013. EXTERNAL
B. Vandame et al., “Pipeline for real-time video view synthesis,” in Proc. IEEE Int. Conf. Multimedia Expo Workshops (ICMEW), Jul. 2020, pp. 1–6. EXTERNAL
Patent WO 2018/014040, US2017/042462, Lightfield Labs. EXTERNAL
T. Burnett, “Extreme multi-view rendering for light-field displays,” in Proc. GTC, 2018, pp. 1–25. EXTERNAL
Interdigital Light Field Data Set. Accessed: 2019. [Online]. Available: https://www.interdigital.com/data_sets/light-field-dataset EXTERNAL
Gregory Kramida et al., “Resolving the Vergence-Accommodation Conflict in Head Mounted Displays,” IEEE Trans. Vis. Comput. Graph., 22(7):1912–1931, Jul. 2016. EXTERNAL
Peter Kovacs et al., “Quantifying Spatial and Angular Resolution of Light Field 3D Displays,” IEEE J. Sel. Top. Signal Process., 11(7):1213–1222, Aug. 2017. EXTERNAL
R. Braspenning et al., “Visual quality assessment of lenticular based 3D-displays,” in Proc. 13th Eur. Signal Process. Conf., 2005, pp. 1–4. EXTERNAL
J. Fleureau et al., “An immersive video experience with realtime view synthesis leveraging the upcoming MIV distribution standard,” in Proc. IEEE Int. Conf. Multimedia Expo Workshops (ICMEW), Jul. 2020, pp. 1–2. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2021.3090913.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Didier Doyen, Valérie Allié, and Arno Schubert; How to Ensure a Good Depth Perception on a Light Field Display, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3090913

Snippet:

Didier Doyen, Valérie Allié, and Arno Schubert; How to Ensure a Good Depth Perception on a Light Field Display, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at https://doi.org/10.5594/JMI.2021.3090913

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Didier Doyen, Valérie Allié, and Arno Schubert; <cite>How to Ensure a Good Depth Perception on a Light Field Display</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021. Available at <a href="https://doi.org/10.5594/JMI.2021.3090913" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2021.3090913</a></span>

SMPTE's HTML Pub

Preview:

Didier Doyen, Valérie Allié, and Arno Schubert; How to Ensure a Good Depth Perception on a Light Field Display, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021
doi: 10.5594/JMI.2021.3090913
url: https://doi.org/10.5594/JMI.2021.3090913

Snippet:

<li>
Didier Doyen, Valérie Allié, and Arno Schubert; <cite id="bib-10-5594-jmi-2021-3090913">How to Ensure a Good Depth Perception on a Light Field Display</cite>, SMPTE Motion Imaging Journal ( Volume: 130, Issue: 9, October 2021); SMPTE, 2021
<span class="doi">10.5594/JMI.2021.3090913</span>
</li>