A Non-Conventional Approach to the Conversion of 2D Video and Film Content to Stereoscopic 3D

Metadata

Publisher: SMPTE — White Plains, NY
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2010, No. 10, pp. 1–11
Abstract: We will present a non-conventional approach and method for converting naturalistic (non-computer-generated) 2D video and film material to Stereoscopic 3D. We will present experimental evidence to show the efficacy of colour-based surrogate depth maps for automatic 2D-to-3D conversion aimed at small screen applications. We will then present a semi-automatic 2D-to-3D conversion system (CRC-DMEG), also based on surrogate depth maps, for the conversion of video and film contents for commercial projection on large cinema screens. A major advantage of CRC-DMEG is that it exploits the correlation between the 2D colour images and the surrogate depth maps to allow for direct manipulation of the depth of objects in a scene. Another major advantage is that it allows for the instant realization of depth details, such as raindrops, foliage and the textures found in carpets. Our approach and method, minimizes the labor-intensive work associated with the conventional method of rotoscoping. Moreover, the manual task of filling in disoccluded regions is also significantly reduced.
Publication Date: 2010-10-01
DOI: 10.5594/M001385
Link: https://doi.org/10.5594/M001385
Author(s): Carlos VázquezCommunications Research Centre Canada, Ottawa, Canada
Wa James TamCommunications Research Centre Canada, Ottawa, Canada
Copyright: © 2010 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Yamada K. Suehiro K. Nakamura H. , “Pseudo 3D image generation with simple depth models,” International Conference on Consumer Electronics, Digest of Technical Papers , pp. 277 – 278 , Jan. 8–12, 2005 . EXTERNAL
10. Tam W. J. Vázquez C. Speranza F. , “Three- dimensional TV: A novel method for generating surrogate depth maps using colour information” , Proc. SPIE Stereoscopic Displays and Applications XX , pp. 7237 – 7248 , Jan. 2009 . EXTERNAL
11. Tam W. J. Vázquez C. , “Method and graphical user interface for modifying depth maps” , U.S. Patent Application No. 12/508,208, Jul. 23, 2009 . EXTERNAL
12. Tam W. J. Vázquez C. , “Generation of a depth map from a monoscopic color image for rendering stereoscopic still and video images” , U.S. Patent Application No. 12/060,978, Apr. 2, 2008 . EXTERNAL
13. Fehn C. , “Depth-image-based rendering (DIBR), compression and transmission for a new approach on 3D-TV,” Proc. SPIE Conference on Stereoscopic Displays and Virtual Reality Systems XI , vol. 5291 , pp. 93 – 104 , Jan. 2004 . EXTERNAL
14. Tam W. J. Stelmach L. B. Meegan D. Vincent A. , “Bandwidth reduction for stereoscopic video signals,” Proc. Stereoscopic Displays and Applications VII , vol. 3957 , pp. 33 – 40 , Jan.22–28, 2000 . EXTERNAL
15. Stelmach L. B. Tam W. J. Meegan D. Vincent A. , “Stereo image coding based on human visual characteristics: Mixed resolution and unequal bit allocation,” International Workshop on Synthetic-Natural Hybrid Coding and Three-dimensional Imaging (IWSNHC3DI'99) , Santorini, Greece, Sep. 1999 . EXTERNAL
16. Stelmach L. B. Tam W. J. Meegan D. , “Stereo image quality: Effects of spatio-temporal resolution,” Proc. Stereoscopic Displays and Virtual Reality Systems VI , vol. 3639 , pp. 4 – 11 , Jan. 1999 . EXTERNAL
17. ISO/IEC JTC 1/SC 29/WG11, Doc. ISO/IEC FDIS 23002–3:2007(E), “Part 3: Representation of auxiliary video and supplemental information”, Jan. 2007 . EXTERNAL
18. Zhang L. Tam W. J. , “Stereoscopic image generation based on depth images for 3D TV,” IEEE Transactions on Broadcasting , Vol. 51 : 2 , pp. 191 – 199 , 2005 . EXTERNAL
19. Vázquez C. Tam W. J. Speranza F. , “Stereoscopic imaging: Filling disoccluded areas in image-based rendering,” in Proc. SPIE Three-Dimensional TV, Video, and Display (ITCOM) , vol. 6392 , pp. 0D1 – 0D12 , Oct. 1–4, 2006 . EXTERNAL
2. Vázquez C. Tam W. J. , “CRC-CSDM: 2D-to-3D conversion using colour-based surrogate depth maps,” Proc. IEEE 3D Systems and Applications Workshop 2010 , pp. 1194 – 1205 , May 2010 . EXTERNAL
3. Battiato S. Curti S. La Cascia M. Tortora M. Scordato E. , “Depth map generation by image classification,” Proceedings of SPIE , vol. 5302 , pp. 95 – 104 , April 2004 . EXTERNAL
4. Geshwind D. M. , “Method to convert two dimensional motion pictures for three-dimensional systems” , U.S. Patent No. 4925294, May 15, 1990 . EXTERNAL
5. Kaye M. C. Best C. J. L. , “Method for conforming objects to a common depth perspective for converting two-dimensional images into three-dimensional images” , U. S. Patent No. 7102633, Sept. 5, 2006 . EXTERNAL
6. Tauber Z. Ze-Nian L. Drew M. S. , “Review and preview: Disocclusion by inpainting for image-based rendering,” IEEE Trans. on Systems, Man, and Cybernetics, Part C: Applications and Reviews , vol. 37 , no. 4 , pp. 527 – 540 , July 2007 . EXTERNAL
7. Harman P. Flack J. Fox S. Dowley M. , “Rapid 2D to 3D conversion,” SPIE Conference on Stereoscopic Displays and Virtual Reality Systems IX , vol. 4660 , pp. 78 – 86 , 2002 . EXTERNAL
8. Tam W. J. Speranza F. Zhang L. , “Depth map generation for 3D-TV: Importance of edge and boundary information” , Advances in Three-dimensional Television, Video and Display , Chap. 9, pp. 153 – 181 , Springer : New York , 2009 . EXTERNAL
9. Tam W. J. Vázquez C. Speranza F. , “Surrogate depth maps for stereoscopic imaging: Different edge types,” Proc. of SPIE Stereoscopic Displays and Virtual Reality Systems XIV , vol. 6490 , pp. 0C1–0C9 , Jan. 2007 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001385.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Carlos Vázquez and Wa James Tam; A Non-Conventional Approach to the Conversion of 2D Video and Film Content to Stereoscopic 3D, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at https://doi.org/10.5594/M001385

Snippet:

Carlos Vázquez and Wa James Tam; A Non-Conventional Approach to the Conversion of 2D Video and Film Content to Stereoscopic 3D, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at https://doi.org/10.5594/M001385

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Carlos Vázquez and Wa James Tam; <cite>A Non-Conventional Approach to the Conversion of 2D Video and Film Content to Stereoscopic 3D</cite>, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at <a href="https://doi.org/10.5594/M001385" target="_blank" rel="noopener">https://doi.org/10.5594/M001385</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Carlos Vázquez and Wa James Tam; <cite id="bib-10-5594-m001385">A Non-Conventional Approach to the Conversion of 2D Video and Film Content to Stereoscopic 3D</cite>, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010
<span class="doi">10.5594/M001385</span>
</li>