Light-Field Acquisition System That Facilitates Camera and Depth-of-Field Compositing in Post-Production

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag J.
Volume: 124, No. 1, pp. 16–21
Abstract: Traditional film and broadcast cameras capture the scene from a single viewpoint, while important creative parameters such as the camera position and orientation, the depth of field, and the three-dimensional (3D) parallax when using a 3D camera rig are burned into the footage during acquisition. To realize artistic effects such as the matrix or the vertigo effect with traditional cameras is a complex task that requires skilled personnel. Within the matrix effect, the scene appears frozen while a camera movement is simulated by placing dozens of cameras in a mainly horizontal arrangement. The vertigo effect requires physical movement of the camera, which is usually mounted on a dolly, and translates forward and backward to and from the scene while the zoom and possibly the focus are changed accordingly. Usually, the scene needs to be shot multiple times until the best combination of zoom corrections and dolly movement is found.Against this background, a system is presented that allows capture of the light field of a sequence and thus offers full creative leeway of changing camera paths and orientation, as well as setting the focal plane in post-production. In contrast to previous approaches, the handling of the involved acquisition system is compact and thus suitable for on-set operation. This paper describes the associated content production and presents first results that underlie the suitability of the approach.
Publication Date: 2015-01-01
DOI: 10.5594/j18496
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/j18496
Author(s): Frederik Zilly
bio
Frederik Zilly is head of the Computational Imaging and Algorithms groups in the Moving Picture Department of Fraunhofer IIS in Erlangen, Germany. He received a diploma degree in physics from Free University of Berlin, Germany, in 2006. Before joining Fraunhofer IIS, he was a scientific project manager in the Immersive Media and 3D Video group in the Image Processing Department at Fraunhofer HHI in Berlin, where he was involved in several German and European research projects related to 3DTV. In this function he was mainly responsible for the development of the stereoscopic analyzer (STAN) and coordinated the activities of the Fraunhofer HHI concerning the European research MUSCADE project. Zilly has been honored for his work on the STAN system and received an Award for Outstanding Merit in Young Scientists, the Rudolf Urtel Prize 2011. He has served as reviewer for different international conferences and journals. Zilly's research focus is multicamera image processing algorithms.
Michael Schoberl
bio
Michael Schöberl received a diploma in electrical engineering with honors in 2006 from the University of Erlangen- Nuremberg. He then joined the Fraunhofer IIS, where he began work on high-quality imaging systems in the electronic imaging department. In 2007, he joined the University of Erlangen-Nuremberg to continue the research on algorithms for high-end camera systems in close cooperation with Fraunhofer IIS. In 2013, he received a Ph.D. with honors in electrical engineering for his work on digital cameras. Schöberl is currently working as a senior scientist at the Fraunhofer IIS, focusing on novel imaging technologies.
Matthias Ziegler
bio
Matthias Ziegler received a diploma in electrical engineering from Friedrich-Alexander University Erlangen, Germany, in 2012. He has been with Fraunhofer IIS since that time and is working on algorithms for computational imaging. His research focus is on light-field production workflows and algorithms, including disparity estimation, plenoptic cameras, and high-dynamic range.
Joachim Keinert
bio
Joachim Keinert is chief scientist at Fraunhofer IIS. He received diplomas from both the University of Stuttgart, Germany, and Télécom ParisTech (formerly ENST) in Paris, France. In 2009, he received a Ph.D. with honors in the domain of electronic system level design for image processing applications. His research interests focus on high-dynamic range video capture and processing, as well as light-field imaging and depth acquisition. Keinert actively participates in JPEG compression standardization and is experienced in the development of hardware and software for image processing in both embedded and general-purpose systems.
Siegfried Foessel
bio
Siegfried Foessel is head of the Moving Picture Technologies department at the Fraunhofer IIS in Erlangen and spokesman of the Fraunhofer digital cinema alliance. He was responsible for projects like the camera development ARRI D20/D21, the DCI (Digital Cinema Initiatives) certification test plan and the JPEG 2000 standardization for digital cinema. Foessel is a member of various standardization bodies and organizations such as SMPTE, Fernseh-und Kinotechische Gesellschaft e.V. (FKTG), the International Organization for Standardization (ISO) and Deutsches Institut für Normung e.V. (DIN). He became a SMPTE Fellow in 2014. Foessel was the 2014 recipient of the Josef-von-Fraunhofer award for the development of easyDCP, a tool for creating and playback of Digital Cinema Packages. In 2014, he was elected president of the FKTG, the German equivalent to SMPTE.
Copyright: © 2015 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Wilburn B. Joshi N. Vaish V. Talvala E.-V. Antunez E. Barth A. Adams A. Horowitz M. Levoy M. “High Performance Imaging Using Large Camera Arrays,” ACM SIGGRAPH Papers, 2005 . EXTERNAL
2. Ng R. Levoy M. Brédif M. Duval G. Horowitz M. Hanrahan P. “Light Field Photography with a Hand-held Plenoptic Camera,” Stanford Tech Report CTRS 2005-02, 2005 . EXTERNAL
3. Zilly F. Müller M. Kauff P. “The Stereoscopic Analyzer—An Image-Based Assistance Tool for Stereo Shooting and 3D Production,” Proc. ICIP 2010 , Hong Kong , Sept. 2010 . EXTERNAL
4. Zilly F. Riechert C. Müller M. Kauff P. “Multi-Camera Rectification Using Linearized Trifocal Tensor,” presented at the International Conference on Pattern Recognition, Tsukuba, Nov. 2012 . EXTERNAL
5. Riechert C. Zilly F. Müller M. Kauff P. “Real-Time Disparity Estimation Using Line-Wise Hybrid Recursive Matching and Cross-Bilateral Median Up-Sampling,” presented at the International Conference on Pattern Recognition, Tsukuba, Nov. 2012 . EXTERNAL
6. Kauff P. Atzpadin N. Fehn C. Müller M. Schreer O. Smolic A. Tanger R. “Depth Map Creation and Image-Based Rendering of Advanced 3DTV Services Providing Interoperability and Scalability,” Signal. Process. Image Comm. , 22 ( 2 ): 217 – 234 , Feb. 2007 . EXTERNAL
7. Mendiburu B. 3D Movie Making—Stereoscopic Digital Cinema from Script to Screen , Elsevier : Burlington, MA , 2008 . EXTERNAL
8. Zilly F. Kluger J. Kauff P. “Production Rules of 3D Stereo Acquisition,” Proc. IEEE , 99 ( 4 ): 590 – 606 , Apr. 2011 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-j18496.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Frederik Zilly, Michael Schoberl, Matthias Ziegler, Joachim Keinert, and Siegfried Foessel; Light-Field Acquisition System That Facilitates Camera and Depth-of-Field Compositing in Post-Production, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 1, January 2015); SMPTE, 2015. Available at https://doi.org/10.5594/j18496

Snippet:

Frederik Zilly, Michael Schoberl, Matthias Ziegler, Joachim Keinert, and Siegfried Foessel; Light-Field Acquisition System That Facilitates Camera and Depth-of-Field Compositing in Post-Production, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 1, January 2015); SMPTE, 2015. Available at https://doi.org/10.5594/j18496

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Frederik Zilly, Michael Schoberl, Matthias Ziegler, Joachim Keinert, and Siegfried Foessel; <cite>Light-Field Acquisition System That Facilitates Camera and Depth-of-Field Compositing in Post-Production</cite>, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 1, January 2015); SMPTE, 2015. Available at <a href="https://doi.org/10.5594/j18496" target="_blank" rel="noopener">https://doi.org/10.5594/j18496</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Frederik Zilly, Michael Schoberl, Matthias Ziegler, Joachim Keinert, and Siegfried Foessel; <cite id="bib-10-5594-j18496">Light-Field Acquisition System That Facilitates Camera and Depth-of-Field Compositing in Post-Production</cite>, SMPTE Motion Imaging Journal ( Volume: 124, Issue: 1, January 2015); SMPTE, 2015
<span class="doi">10.5594/j18496</span>
</li>