Editing and Managing Multi-Channel Video — A Light Field Approach

Metadata

Publisher: SMPTE — White Plains, NY
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2011, No. 1, pp. 1–10
Abstract: A strong trend in the media industry is acquisition of higher data resolutions and broader ranges in color, spatial and temporal domains. The data can be in the form of multiple views over these domains. Media may be captured from multiple devices, a single device with high resolution/range capabilities or, a synthetic source such as a CGI scene. Video productions are evolving from working with one view at a time to capturing as much information as possible i.e., “super-sample the world!” and extracting only the views needed for mastering. The role of traditional story telling tools becomes challenging. Well known editorial and data management techniques have to be applied to multiple media samples of the same scene for different ranges and resolutions in the temporal, color and spatial domains. This paper presents concepts from the area of Light Fields to propose an editorial and data management system to work with these multi-view sources. A proposed data model and run-time system shows how media from various views can be grouped in a way that they appear as a single light field source to the editing and data management functions. By defining the interrelationship between the multiple sources with metadata and output view requirements, transformations can be applied on various input view samples to create novel output views of the scene. The use of range information is shown to be important as it extends common editing and data management techniques to the multi-view case.
Publication Date: 2011-10-01
DOI: 10.5594/M001073
Link: https://doi.org/10.5594/M001073
Author(s): Shailendra MathurAvid, 3510 Boul. St. Laurent, Montreal, Quebec, H2× 2V2, Canada
Stephen McNeillAvid, 3510 Boul. St. Laurent, Montreal, Quebec, H2× 2V2, Canada
Keyword(s): Color, HDR, Time & Sync, Alignment, Stereoscopic
Copyright: © 2011 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

[1] Levoy M. Hanrahan P. , Light Field Rendering , SIGGraph-96(31–42). EXTERNAL
[10] Lumsdaine A. Georgiev T. “The focused plenoptic camera.” In Proc. IEEE ICCP (2009), pp. 1 – 8 . EXTERNAL
[11] Georgiev T. Lumsdaine A. Goma S. , “High Dynamic Range Image Capture with Plenoptic 2.0 Camera” , Signal Recovery and Synthesis (SRS), Fall OSA Optics & Photonics Congress, 2009. EXTERNAL
[12] Reber Stephen J. Peters Eric C. , Patent No. 5,267,351, November 30, 1993 , “Media storage and retrieval system.”. EXTERNAL
[2] Debevec P.E. Malik J. , “Recovering High Dynamic Range Radiance Maps from Photographs,” SIGGraph 1997 , pp 369 – 378 . EXTERNAL
[3] Adelson E.H. Bergen J.R. (1991). “The plenoptic function and the elements of early vision” , In Computation Models of Visual Processing , Landy M. Movshon J.A. , eds., MIT Press , Cambridge , 1991 , pp. 3 – 20 . EXTERNAL
[4] Garmon Paul D. , Patent No. 5,355,450, October 11, 1994 , “Media composer with adjustable source material compression.”. EXTERNAL
[5] Shum H.Y. Kang S.B. , “A Review of Image-based Rendering Techniques” , IEEE/SPIE Visual Communications and Image Processing (VCIP) 2000, pp. 2 – 13 . EXTERNAL
[6] Gortler S.J. Grzeszczuk R. Szeliski R.S. Cohen M.F. , The Lumigraph , SIGGraph-96(43–54). EXTERNAL
[7] Yang J. Everett M. Buehler C. McMillan L. “A Real-Time Distributed Light Field Camera” , Thireteen Eurographic Workshop on Rendering 2002, pp. 77 – 85 . EXTERNAL
[8] Wilburn B. 2005 . “High performance imaging using large camera arrays.” ACM Trans. Graph. 24 , 3 , 765 – 776 . EXTERNAL
[9] Ng R. Levoy M. Brédif M. Duval G. Horowitz M. Hanrahan P. , “Light Field Photography with a Hand-Held Plenoptic Camera, Stanford Computer Science” Tech Report CSTR 2005-02, April 2005. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001073.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Shailendra Mathur and Stephen McNeill; Editing and Managing Multi-Channel Video — A Light Field Approach, SMPTE Meetings and Conferences ( October 2011); SMPTE, 2011. Available at https://doi.org/10.5594/M001073

Snippet:

Shailendra Mathur and Stephen McNeill; Editing and Managing Multi-Channel Video — A Light Field Approach, SMPTE Meetings and Conferences ( October 2011); SMPTE, 2011. Available at https://doi.org/10.5594/M001073

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Shailendra Mathur and Stephen McNeill; <cite>Editing and Managing Multi-Channel Video — A Light Field Approach</cite>, SMPTE Meetings and Conferences ( October 2011); SMPTE, 2011. Available at <a href="https://doi.org/10.5594/M001073" target="_blank" rel="noopener">https://doi.org/10.5594/M001073</a></span>

SMPTE's HTML Pub

Preview:

Shailendra Mathur and Stephen McNeill; Editing and Managing Multi-Channel Video — A Light Field Approach, SMPTE Meetings and Conferences ( October 2011); SMPTE, 2011
doi: 10.5594/M001073
url: https://doi.org/10.5594/M001073

Snippet:

<li>
Shailendra Mathur and Stephen McNeill; <cite id="bib-10-5594-m001073">Editing and Managing Multi-Channel Video — A Light Field Approach</cite>, SMPTE Meetings and Conferences ( October 2011); SMPTE, 2011
<span class="doi">10.5594/M001073</span>
</li>