SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007)
[ACTIVE]
Trinocular Depth Acquisition
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 116, No. 5-6, pp. 206–212
- Abstract
- This contribution presents a new concept for depth acquisition in post-production and visual effects (vfx) creation. The main idea is to mount two satellite cameras to the left and the right of an electronic D-cinema camera such that the whole rig forms a trinocular camera setup. Based on this system, depth is estimated by robust stereo matching and the trifocal constraint is exploited to determine the accuracy of the depth values. The information is calculated almost in realtime and can be directly previewed at the set. This paper explains the concept in more detail and describes the basic image processing algorithms. Finally, the theoretically achievable depth accuracy is discussed and results of the first experiments based on computer simulations are presented.
- Publication Date
- 2007-05-01
- DOI
10.5594/J11444- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/J11444
- Author(s)
- R. Tanger
bio
Ralf Tanger graduated with a degree in electrical engineering from the Technical University of Berlin in 1996. From 1993 to 1997 he worked for Daimler-Benz Research in the field of image classification with neural networks. In 1997, he joined the Image Processing department of the Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institute (FhG/HHI) in Berlin, Germany. He was engaged in several European and German research projects, mainly in the field of segmentation and video conferencing. Since 2002, he has been project manager. Currently, he is mainly interested in 3-D video analysis, large-scale system integration, and realtime processing. Tanger is a member of IEEE and VDI.N. Atzpadinbio
Nicole Atzpadin, nee Brandenburg, was born in Berlin, Germany in August 1973. She received a diploma degree in electrical engineering from the Technical University of Berlin, Germany, in May 2000. Since 1998, Atzpadin has been working in the Image Processing department of the Heinrich-Hertz-Institute. She first worked as a student in the field of disparity estimation. Since receiving her diploma degree she works as a research assistant on the DFG project 3-DEvi, where she is engaged in research for 3-D analysis, novel view synthesis, and realtime video conferencing. After a parental leave in 2003 to 2004, Atzpadin was self-employed and developed algorithms in the context of 3-D analysis for cinema post-production.M. Müllerbio
Marcus Müller received a diploma degree in computer science from the Technical University, Berlin, Germany, in 2004. Since 2001, he has been working in the Image Processing department, Fraunhofer Institute for Telecommunications HHI. He began working there as a student assistant, on color-segmentation and disparity estimation, in a two-year DFG project called VITA. Since receiving his diploma degree he has been working as a research assistant on several projects concerning stereo and multi-view-analysis, depth estimation, and novel view synthesis. Müller is now working on a PhD thesis on future 3-D-TV services.C. Fehnbio
Christoph Fehn received a diploma degree (MS) in electrical engineering from the University of Dortmund, Germany, in 1998. Since then, he has been with the Fraunhofer Institute for Telecommunications HHI, where he is currently working as a scientific project manager and coordinator for projects in the area of immersive media, three-dimensional television (3DTV), and digital cinema. In 2006, he received a PhD degree from the Technical University Berlin, Germany, for his work on a novel approach for 3-DTV. Fehn is a member of VDE, SMPTE, and IEEE and has been an active contributor to the ISO MPEG group, where he is acting as an associate editor of the new MPEG-C Part 3 standard, which is concerned with the definition of encoding and transport mechanisms for depth/parallax data or other auxiliary video data representations.P. KauffThe Immersive Media & 3D Video Group at the Fraunhofer Institute for Telecommunications HHIbio
Peter Kauff is head of the Immersive Media & 3D Video Group at the Fraunhofer Institute for Telecommunications HHI. He received a Dipl.-Ing. degree in electrical engineering and telecommunications from the Technical University of Aachen, Germany, in 1984. He has been with the Heinrich-Hertz-Institute since then, involved in numerous German and European projects related to digital HDTV signal processing and coding, interactive MPEG-4-based services, as well as a number of projects related to advanced 3-D video processing for immersive tele-presence and immersive media. Kauff has been engaged in several European research projects, such as Eureka 95, Race-project Flash, Acts-project Hamlet, COST211ter&quad, Esprit-Project Nemesis, IST-Projects Virtue and Attest, and the Presence Working Group of IST-FET Proactive Initiative.C. Herpelbio
Carsten Herpel holds a Dipl.-Ing. degree in communications engineering from RWTH Aachen, Germany. He is a senior technical advisor in the production workflow lab at Thomson's research facility in Hannover. His past expertise covers video compression, where he contributed to the MPEG-1 and −2 standards; multimedia system architecture (co-editor of MPEG-4 and −7 specifications), as well as logical formats for disk-based media (Blu-ray disk, HD-DVD). Currently, Herpel leads a project contributing to the evolution of workflows and infrastructure for high-end digital media production and post-production towards higher fidelity and 3-D. - Copyright
- © 2007 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- 1. Lourakis M.I.A. Argyros A. , “Vision-Based Camera Motion Recovery for Augmented Reality,” Proc. Compu. Graphics Intl. , CGI′04 , 2004 . EXTERNAL
- 2. Cornelis K. Pollefeys M. Vergauwen M. Verbiet F. , “Tracking Based Structure and Motion Recovery for Augmented Video Productions,” Proc. VRST′01 , pp. 17 ff , 2001 . EXTERNAL
- 3. Kim K.-T. Siegel M. Son J.-Y. , “Synthesis of a High-Resolution 3-D Stereoscopic Image Pair from a High-Resolution Monoscopic Image and a Low-Resolution Depth Map,” Proc. Vis. Comm. and Image Processing, SPIE Symposium on Electronic Imaging, 1998 . EXTERNAL
- 4. Mulligan J. Isler V. Daniilidis K. , “Trinocular Stereo: A Real-Time Algorithm and its Evaluation,” , Intl. J. of Compu. Sc. , 47 : 51 – 61 , April 2002. EXTERNAL
- 5. Zitnick C. L. Kang S. B. Uyttendaele M. Winder S. Szeliski R. , “High-Quality Video View Interpolation Using a Layered Representation,” Proc. Siggraph ′04 , pp. 600 – 608 2004 . EXTERNAL
- 6. Kauff P. Smolic A. Eisert P. Fehn C. Müller K. Schäfer R. , “Data Format and Coding for Free Viewpoint Video , Proc. Int. Broadcast Convention ′05 , 218 – 226 2005 . EXTERNAL
- 7. Fusiello A. Trucco E. Verri A. , “Rectification with Unconstrained Stereo Geometry,” Proc. British Machine Vis. Conf., Essex, U.K., pp. 556 – 565 , Sept. 1997 . EXTERNAL
- 8. Shashua A. Werman M. , “Trilinearity of Three Perspective Views and Its Associated Tensor,” Proc. Intl. Conf. on Compu. Vis., Boston, MA, June 1995 . EXTERNAL
- 9. Shashua A. , “Trilinear Tensor: The Fundamental Construct of Multiple-View Geometry and Its Applications,” Proc. Workshop on Algebraic Frames for the Perception Action Cycle,” Kiel, Germany, pp. 920 – 925 , Sept. 1997 . EXTERNAL
- 10. Fehn C. Atzpadin N. Müller M. Schreer O. Smolic A. Tanger R. Kauff P. , “An Advanced Concept for Providing Interoperability and Scalability for a Wide Range of Multi-Baseline Geometries,” , Proc. ICIP , 2006 , pp. 2961 – 2964 2006 . EXTERNAL
- 11. De Hann G. Biezen P.W.A.C. Huijgen H. Ojo O. A. , “True Motion Estimation with 3-D Recursive Search Block Matching,” , IEEE Trans. on Circuits Systems Video Technol. , 3 : 368 – 388 , Oct. 1993 . EXTERNAL
- 12. Ohm J.-R. Rümmler K. , “Variable Raster Multi-Resolution Video Processing with Motion Compensation Techniques,” Proc. Intl. Conf. of Image Processing (ICIP ′97), pp. 759 – 762 1997 . EXTERNAL
- 13. Kauff P. Schüür K. , “A Real-Time MPEG-4 Software Encoder Using Fast Motion Estimator Based on Hybrid Recursive Matching,” Proc. ACM Multimedia, pp. 55 – 58 , Oct. 2000 . EXTERNAL
- 14. Atzpadin N. Kauff P. Schreer O. , “Stereo Analysis by Hybrid Recursive Matching for Real-Time Immersive Video Conferencing,” , IEEE Trans. Circuits and Syst. for Video Technol. , 14 : 312 – 333 , Mar. 2004 . EXTERNAL
- 15. Fehn C. Cooke E. Schreer O. Kauff P. , “3-D Analysis and Image-Based Rendering for Immersive TV Applications,” , Signal Process Image Commun. , 17 : 705 – 715 , Oct. 2002 . EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J11444.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
R. Tanger, N. Atzpadin, M. Müller, C. Fehn, P. Kauff, and C. Herpel; Trinocular Depth Acquisition, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11444
Snippet:
R. Tanger, N. Atzpadin, M. Müller, C. Fehn, P. Kauff, and C. Herpel; Trinocular Depth Acquisition, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11444
HTML (ISO 690 compliant)
Preview:
R. Tanger, N. Atzpadin, M. Müller, C. Fehn, P. Kauff, and C. Herpel; Trinocular Depth Acquisition, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11444
Snippet:
<span class="citation">R. Tanger, N. Atzpadin, M. Müller, C. Fehn, P. Kauff, and C. Herpel; <cite>Trinocular Depth Acquisition</cite>, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at <a href="https://doi.org/10.5594/J11444" target="_blank" rel="noopener">https://doi.org/10.5594/J11444</a></span>
SMPTE's HTML Pub
Preview:
R. Tanger, N. Atzpadin, M. Müller, C. Fehn, P. Kauff, and C. Herpel; Trinocular Depth Acquisition, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007
doi: 10.5594/J11444
url: https://doi.org/10.5594/J11444
doi: 10.5594/J11444
url: https://doi.org/10.5594/J11444
Snippet:
<li> R. Tanger, N. Atzpadin, M. Müller, C. Fehn, P. Kauff, and C. Herpel; <cite id="bib-10-5594-j11444">Trinocular Depth Acquisition</cite>, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007 <span class="doi">10.5594/J11444</span> </li>