SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017)
[ACTIVE]
Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Mot. Imag. J
- Volume
- 126, No. 1, pp. 43–56
- Abstract
- This paper presents a novel pipeline for adding 3D geometry information to conventional green screen assets in virtual broadcast studios. Today’s green screen studios are limited to 2D object interaction. Information about depth is not available, and hence the 3D relation to nonvirtual objects is unknown. We overcome this situation by using an integrated RGB+depth camera and a specialized processing pipeline, which delivers an additional synchronized depth channel in realtime. This technology enables interaction of virtual and real objects, including shadow casting and occluding virtual objects. We implemented and tested several of these effects within a professional virtual studio renderer.
- Publication Date
- 2017-01-01
- DOI
10.5594/JMI.2016.2632398- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2016.2632398
- Author(s)
- Thomas HachPablo AriasCarles BoschJavier MontesaPablo Gascó
- Keyword(s)
- RGB+D, Broadcast, Green Screen, Time-of-flight, Depth Upscaling, Virtual Sets
- Copyright
- © 2016 SMPTE
Bibliographic Reference(s)
- Tri-Focal Rig (Practical Camera Configurations for Image and Depth Acquisition) [Active]
- L. I. Rudin, S. Osher, and E. Fatemi, “Nonlinear Total Variation Based Noise Removal Algorithms,” Phys. Nonlinear Phenom., 60:259-268, 1992. doi:10.1016/0167-2789(92)90242-F. EXTERNAL
- M. Lindner, I. Schiller, A. Kolb, and R. Koch, “Timeof-Flight Sensor Calibration for Accurate Range Sensing,” Comput. Vis. Image Underst., 114:1318-1328, 2010. doi:10.1016/j. cviu.2009.11.002. EXTERNAL
- S. Fuchs, M. Suppa, and O. Hellwich, “Compensation For Multipath in TOF Camera Measurements Supported by Photometric Calibration and Environment Integration,” in Computer Vision Systems, Springer: Berlin Heidelberg, pp. 31-41, 2013. EXTERNAL
- J. Kopf, M. F. Cohen, D. Lischinski, and M. Uyttendaele, Joint Bilateral Upsampling, ACM Press, p. 96, 2007. doi:10.1145/1275808.1276497. EXTERNAL
- M. Lindner and A. Kolb, “Lateral and Depth Calibration of PMD-Distance Sensors,” in Advances in Visual Computing, Springer: Berlin Heidelberg, pp. 524-533, 2006. EXTERNAL
- T. Hach and J. Steurer, “A Novel RGB-Z Camera for High-Quality Motion Picture Applications,” Proc 10th European Conference on Visual Media Production, pp. 4:1-4:10, 2013. EXTERNAL
- W. Kuhlmann, “Studioneubau für die Tagesschau beim NDR,” FKT, pp. 614-619, 2014. EXTERNAL
- J. Wang, F. Shi, J. Zhang, and Y. Liu, “A New Calibration Model of Camera Lens Distortion,” Pattern Recognit., 41:607-615, 2008. doi:10.1016/j.patcog.2007.06.012. EXTERNAL
- T. Hach, C. Bosch, P. Arias, J. Montesa, and P. Gascó, “Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios,” presented at the SMPTE 2015 Annual Technical Conference & Exhibition, Hollywood, CA, 2015. EXTERNAL
- M. Zhu and T. Chan, “An Efficient Primal-Dual Hybrid Gradient Algorithm For Total Variation Image Restoration,” UCLA CAM Rep. 08-34, 2008. EXTERNAL
- J. A. Nelder and R. Mead, “A Simplex Method For Function Minimization,” Comput. J., 7:308-313, 1965. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2016.2632398.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Thomas Hach, Pablo Arias, Carles Bosch, Javier Montesa, and Pablo Gascó; Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2016.2632398
Snippet:
Thomas Hach, Pablo Arias, Carles Bosch, Javier Montesa, and Pablo Gascó; Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2016.2632398
HTML (ISO 690 compliant)
Preview:
Thomas Hach, Pablo Arias, Carles Bosch, Javier Montesa, and Pablo Gascó; Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2016.2632398
Snippet:
<span class="citation">Thomas Hach, Pablo Arias, Carles Bosch, Javier Montesa, and Pablo Gascó; <cite>Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios</cite>, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at <a href="https://doi.org/10.5594/JMI.2016.2632398" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2016.2632398</a></span>
SMPTE's HTML Pub
Preview:
Thomas Hach, Pablo Arias, Carles Bosch, Javier Montesa, and Pablo Gascó; Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017
doi: 10.5594/JMI.2016.2632398
url: https://doi.org/10.5594/JMI.2016.2632398
doi: 10.5594/JMI.2016.2632398
url: https://doi.org/10.5594/JMI.2016.2632398
Snippet:
<li> Thomas Hach, Pablo Arias, Carles Bosch, Javier Montesa, and Pablo Gascó; <cite id="bib-10-5594-jmi-2016-2632398">Seamless 3D Interaction of Virtual and Real Objects in Professional Virtual Studios</cite>, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017 <span class="doi">10.5594/JMI.2016.2632398</span> </li>