SMPTE Journal ( Volume: 111, Issue: 9, September 2002)
[ACTIVE]
Applications of Depth Metadata in a Production System
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Volume
- 111, No. 9, pp. 393–398
- Abstract
- This paper discusses applications for the use of depth metadata acquired with a production system that is under development in the EU IST-MetaVision project. The aim of the project is to develop a camera and production system to capture, store, and distribute program material that meets the demands of both the film and television industries. The key idea for cost-effective processing is to acquire and store metadata in addition to essence data (image material) such as camera and scene parameters. Available depth-sensing techniques are reviewed in order to identify suitable methods. At the current stage of technology no single technique covers all practical production situations, so several complementary techniques and a framework to integrate them are proposed. The requirements for representation and sensing of depth information are discussed for specific applications, and initial results are presented. Applications include the creation of special effects in post-production, optimized image coding, and (interactive) stereo viewing 3-D television (3-DTV).
- Publication Date
- 2002-09-01
- DOI
10.5594/J18348- ISSN
- Print:
0036-1682 - Link
- https://doi.org/10.5594/J18348
- Author(s)
- Oliver GrauBBC R & D, Tadworth, Surrey KT20 6NP, U.K.
bio
Oliver Grau received a master's degree in electrical engineering and a Ph.D., from the University of Hannover, Germany, in 1991 and 1999, respectively. From 1991 to 2000 he worked as a research scientist at the University of Hannover, where he was involved in several industrial, national, and international projects in industrial image processing and 3-D scene reconstruction. Grau joined the BBC R&D in April 2000, as a senior research engineer on the virtual production team. His main interests are 3-D surface reconstruction for applications in high-end animations and interactive programs.Shona MinellyBBC R & D, Tadworth, Surrey KT20 6NP, U.K.bio
Shona Minelly received a degree in electrical and electronic engineering from the University of Greenwich in 1994. From 1994 to 1998 she worked as a research student in the medical electronics laboratory at the University of Kent at Canterbury. Her work involved signal processing of His-Purkinje system electrocardiograms, for which she received a Ph.D. in 1998. Minelly joined BBC R&D in 1998 and currently works on the virtual production team, investigating stereo vision systems and applications of depth information in film and TV production.Graham ThomasBBC R & D, Tadworth, Surrey KT20 6NP, U.K.bio
Graham Thomas joined BBC R&D in 1983 after graduating from Oxford University with a degree in Physics. One of his first projects involved the development of phase correlation for motion estimation. He received a Ph.D. for this work as an external student with the University of Essex in 1990. The algorithm was incorporated in several commercial products, leading to a Queen's Award for Technology in 1998. He is the (co)inventor of 18 patents and has published many papers on image processing. Thomas is currently the project manager responsible for development of virtual production technology. - Copyright
- © 2002 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- 1. IST-1999–20859 MetaVision Project Home Page: http://www.ist-metavision.com/ . EXTERNAL
- 10. Ziegler M. Falkenhagen L. ter Horst R. Kalivas D. , “Evolution of Stereoscopic and Three-Dimensional Video,” Sig. Proc. Image Communication , Vol. 14 , pp. 173 – 194 , 1998 . EXTERNAL
- 11. Beardsley P. , “3-D Model Acquisition from Extended Image Sequences,” Proc. of the European Conf. on Computer Vision, pp. 683 – 695 , 1996 . EXTERNAL
- 12. Tucakov V. Lowe D. G. , “Temporally Coherent Stereo: Improving Performance Through Knowledge of Motion,” International Conference on Robotics and Automation, 1997 . EXTERNAL
- 13. Mulligan Daniilidis , “Predicting Disparity Windows for Real-time Stereo,” Proc. of the Sixth European Conference on Computer Vision, 2000 . EXTERNAL
- 14. Potmesil M. , “Generating Octree Models of 3-D Objects from their Silhouettes in a Sequence of Images,” Computer Vision Graphics and Image Processing , Vol. 40 , pp. 1 – 20 , 1987 . EXTERNAL
- 15. Szeliski R. , “Rapid Octree Construction from Image Sequences,” CVGIP: Image Understanding , Vol. 58 , No. 1 , pp. 23 – 32 , 1993 . EXTERNAL
- 16. Niem W. , “Robust and Fast Modelling of 3D Natural Objects from Multiple Views,” SPIE Proc. Image and Video Processing II , Vol. 2182 , pp. 388 – 397 , 1994 . EXTERNAL
- 17. Seitz S. Dyer C. R. , “Photorealistic Scene Reconstruction by Voxel Scene, Reconstruction by Voxel Colouring,” Proc. CVPR , pp. 1067 – 1073 , 1997 . EXTERNAL
- 18. Kutulakos U. Seitz S. , “A Theory of Shape by Space Carving,” Proc. ICCV 99 , 1999 . EXTERNAL
- 19. Matsumoto Y. Fujimura K. Kitamura T. , “Shape-from-Silhouette/Stereo and its Application to 3-D Digitizer,” Proc. 8th Conf. Discrete Geometry for Comp. Imagery, 1999 . EXTERNAL
- 2. Ayache N. Lustman F. , “Fast and Reliable Passive Trinocular Stereo Vision,” Proc. of the 1st Int. Conf. on Computer Vision, pp. 442 – 426 , 1987 . EXTERNAL
- 20. Nayar S. K. Watanabe M. Noguchi M. , “Real-Time Focus Range Sensor,” Proc. of the 5th International Conference on Computer Vision, pp. 995 – 1001 , 1995 . EXTERNAL
- 21. Price M. Thomas G. A. , “3D Virtual Production and Delivery using MPEG-4,” Proc. of Int. Broadcasting Convention (IBC 2000), Amsterdam, the Netherlands, Sept. 8–12, 2000 . EXTERNAL
- 22. Grau O. Price M. Thomas G. A. , “Use of 3D Techniques for Virtual Production, Conf. Proc. Videometrics,” Proc. of SPIE Vol. 4309 , pp. 22 – 23 , Jan. 2001 , San Jose, CA. EXTERNAL
- 3. Milenkovic V. J. Kanade T. , “Trinocular Vision using Photometric and Edge Orientation Constraints,” Proc. of Image Understanding Workshop , pp. 163 – 175 , 1985 . EXTERNAL
- 4. Nakamura Y. Matsuura T. Satoh K. Ohta Y. , “Occlusion Detectable Stereo—Occlusion Patterns in Camera Matrix,” Proc. IEEE Conf. On Computer Vision and Pattern Recognition, pp. 371 – 378 , 1996 . EXTERNAL
- 5. Kanade T. , “A Stereo Machine for Video-rate Dense Depth Mapping and its New Applications,” ARPA Image Understanding Workshop, 1996 . EXTERNAL
- 6. Park Jong-Il Inoue Seiki , “Acquisition of Sharp Depth Map from Multiple Cameras,” Signal Processing: Image Communication , Vol. 14 , pp. 7 – 19 , 1998 . EXTERNAL
- 7. NEC Max Flow Software , http://external.nj.nec.com/homepages/old/sebastien/papers/iccv98/code.html . EXTERNAL
- 8. Roy S. Cox I. J. “A Maximum-Flow Formulation of the N-camera Stereo Correspondence Problem,” IEEE Proc. of International Conference on Computer Vision, 1998 . EXTERNAL
- 9. Falkenhagen L. , “Depth Estimation from Stereoscopic Image Pairs Assuming Piecewise Continuous Surfaces,” Proc. of European WS on Combined Real and Synthetic Image Processing for Broadcast and Video Production,“ pp. 23 – 24 , Nov. 1994 , Hamburg, Germany. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J18348.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Oliver Grau, Shona Minelly, and Graham Thomas; Applications of Depth Metadata in a Production System, SMPTE Journal ( Volume: 111, Issue: 9, September 2002); SMPTE, 2002. Available at https://doi.org/10.5594/J18348
Snippet:
Oliver Grau, Shona Minelly, and Graham Thomas; Applications of Depth Metadata in a Production System, SMPTE Journal ( Volume: 111, Issue: 9, September 2002); SMPTE, 2002. Available at https://doi.org/10.5594/J18348
HTML (ISO 690 compliant)
Preview:
Oliver Grau, Shona Minelly, and Graham Thomas; Applications of Depth Metadata in a Production System, SMPTE Journal ( Volume: 111, Issue: 9, September 2002); SMPTE, 2002. Available at https://doi.org/10.5594/J18348
Snippet:
<span class="citation">Oliver Grau, Shona Minelly, and Graham Thomas; <cite>Applications of Depth Metadata in a Production System</cite>, SMPTE Journal ( Volume: 111, Issue: 9, September 2002); SMPTE, 2002. Available at <a href="https://doi.org/10.5594/J18348" target="_blank" rel="noopener">https://doi.org/10.5594/J18348</a></span>
SMPTE's HTML Pub
Preview:
Oliver Grau, Shona Minelly, and Graham Thomas; Applications of Depth Metadata in a Production System, SMPTE Journal ( Volume: 111, Issue: 9, September 2002); SMPTE, 2002
doi: 10.5594/J18348
url: https://doi.org/10.5594/J18348
doi: 10.5594/J18348
url: https://doi.org/10.5594/J18348
Snippet:
<li> Oliver Grau, Shona Minelly, and Graham Thomas; <cite id="bib-10-5594-j18348">Applications of Depth Metadata in a Production System</cite>, SMPTE Journal ( Volume: 111, Issue: 9, September 2002); SMPTE, 2002 <span class="doi">10.5594/J18348</span> </li>