A Unified Trifocal System for Advanced Depth-Based 3D Capture

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 121, No. 7, pp. 48–55
Abstract: While benefits of depth maps for content creation and three-dimensional (3D) post-production for multiview displays are already widely known, their usage as an alternative stereo 3D (S3D) production workflow is becoming visible. In addition, the generation of reliable depth maps is still an active research topic. This paper describes a comprehensive 3D capture infrastructure approach comprising a trifocal camera system entirely based on Ethernet interface technology. This is a dedicated field recording solution realized with solid state technology capable of recording up to seven uncompressed “high frame rate” camera streams in parallel, and algorithms for trifocal depth estimation enabling realtime depth preview on set, as well as high-quality depth extraction offline. The new interface approach harmonizes and consolidates image data, depth information, and general metadata. The system provides a new 3D production workflow with no need for scene-dependent adjustments, but the possibility to calculate a virtual view with any favored baseline during post-production.
Publication Date: 2012-10-01
DOI: 10.5594/j18233XY
ISSN: Print: 1545-0279
Link: https://doi.org/10.5594/j18233XY
Author(s): Thomas Brune
bio
Thomas Brune joined Technicolor Research & Innovation, Hannover/Germany in 1996. He works in the field of movie and broadcast production infrastructures, image processing and is also a system architect for embedded realtime HW&SW solutions. He led activities for video capture and high-speed interfacing. Brune was responsible for the Technicolor contributions to the EC FP7 funded project “2020 3D media.” He graduated from the University of Hannover in 1996 and has background in microprocessor architectures, video compression, serial interfaces and according protocol stacks and FPGA technology.
Nicola M. Gutberlet
bio
Nicola Gutberlet graduated with a degree in computer science from the Technical University of Darmstadt in 2008. The same year, he joined the Image Processing Department of Fraunhofer Institute for Telecommunications HHI in Berlin. He is engaged in several European and German projects. Gutberlet's research focuses on multicamera systems in capturing and post-processing relating to panoramic imaging as well as depth estimation.
Ralf Tanger
bio
Ralf Tanger graduated from the Technical University of Berlin in 1996 with a degree in electrical engineering. From 1993 to 1997 he worked at Daimler-Benz Research in the field of image classification with Neural Networks. In 1997, he joined the Image Processing Department of the Fraunhofer Institute for Telecommunications HHI as researcher. Since 2002 he has been a scientific project manager. Tanger is engaged in several European (COST211ter, NEMESIS, VIRTUE, 2020 3D Media, 3D4YOU, MUSCADE) and German research projects in the fields of segmentation, video conferencing and 3D video. Currently, he is interested in 3D video analysis, depth estimation, and content creation for AS3D. Tanger is a member of IEEE, SMPTE and VDI.
Dirk Gandolph
bio
Dirk Gandolph joined Technicolor Research & Innovation in 1993 after receiving an engineering degree from Leibniz University in Hanover. He is working on image analysis for 3D scene acquisition and post-production, and inter alia contributed to the EC FP7 funded project “2020 3D media.”
Copyright: © 2012 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

Trinocular Depth Acquisition [Active]
1. European Commission, Seventh Framework Programme , “2020 3D Media: Spatial Sound and Vision,” http://www.20203dmedia.eu . EXTERNAL
2. Kolb A. Barth E. Koch R. Larsen R. , “Time-of-Flight Sensors in Computer Graphics,” Eurographics State Art Rep ., pp. 119 – 134 , 2009 . EXTERNAL
3. Hermans C. Francken Y. Cuypers T. Bekaert P. , “Depth from Encoded Sliding Projections,” Proc. 5th International Symposium on Visual Computing , Lecture Notes in Computer Science White Plains, NY , LNCS 5876, pp. 843 – 854 , 2009 . EXTERNAL
4. Automated Imaging Association , “GigE Vision Standard,” Version 1.2, Jan. 2010 . EXTERNAL
5. Brune T. Wittenburg J. P. , “A New Infrastructure for High Resolution 3D and Slow Motion Production-Sets Featuring the ‘FlashPak II’ Field-Recorder Demonstrator,” presented at the International Broadcasting Convention, Amsterdam, the Netherlands, Sept. 2010 . EXTERNAL
6. Tixel , “Technology,” http://www.tixeltec.com/technology_en.html . EXTERNAL
9. Bekaert P. , “Post-Production for Immersive 3D Media (Surround Video),” presented at the 3D Media Workshop of Fraunhofer Heinrich Hertz Institute, Berlin, Germany, Oct. 2009 , http://3dmedia.hhi.de/downloads.html . EXTERNAL
10. Stanford University, Stanford Computer Graphics Laboratory , “The Stanford Multi-Camera Array,” http://graphics.stanford.edu/projects/array/ . EXTERNAL
12. Atzpadin N. Kauff P. Schreer O. , “Stereo Analysis by Hybrid Recursive Matching for Real-Time Immersive Video Conferencing,” IEEE Trans. Circ. Syst. Video Tech. , 14 ( 3 ): 321 – 334 , 2004 . EXTERNAL
IETF RFC 768 [Active*]
IETF RFC 793 [Superseded*]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-j18233XY.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Thomas Brune, Nicola M. Gutberlet, Ralf Tanger, and Dirk Gandolph; A Unified Trifocal System for Advanced Depth-Based 3D Capture, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 7, 2012); SMPTE, 2012. Available at https://doi.org/10.5594/j18233XY

Snippet:

Thomas Brune, Nicola M. Gutberlet, Ralf Tanger, and Dirk Gandolph; A Unified Trifocal System for Advanced Depth-Based 3D Capture, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 7, 2012); SMPTE, 2012. Available at https://doi.org/10.5594/j18233XY

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Thomas Brune, Nicola M. Gutberlet, Ralf Tanger, and Dirk Gandolph; <cite>A Unified Trifocal System for Advanced Depth-Based 3D Capture</cite>, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 7, 2012); SMPTE, 2012. Available at <a href="https://doi.org/10.5594/j18233XY" target="_blank" rel="noopener">https://doi.org/10.5594/j18233XY</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Thomas Brune, Nicola M. Gutberlet, Ralf Tanger, and Dirk Gandolph; <cite id="bib-10-5594-j18233xy">A Unified Trifocal System for Advanced Depth-Based 3D Capture</cite>, SMPTE Motion Imaging Journal ( Volume: 121, Issue: 7, 2012); SMPTE, 2012
<span class="doi">10.5594/j18233XY</span>
</li>