High-Dynamic Range Video Cameras Based on Single Shot Non-Regular Sampling

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag J.
Volume: 123, No. 8, pp. 49–54
Abstract: Compared to traditional video acquisition, high-dynamic range video increases the visual experience, enhances the possibilities in post-production and simplifies stage lighting. However, existing techniques for high-dynamic range video capture are too expensive for low and medium budget cameras. Furthermore, they are not suitable to handle the most challenging lighting conditions. Against this background, the paper presents a novel technique for capturing high-dynamic range video. It is based on a non-regular mask of attenuation filters placed in front of a standard sensor. Compared to a traditional sensor with the same resolution, the captured image shows nearly the same amount of detail, but it has a much higher dynamic range. The achievable dynamic range increment depends on the underlying sensor capabilities. For highest quality requirements, a 12 f-stop sensor can be extended by 2 to 5 f-stops, a 14 f-stop sensor can be extended by 4 to 7 f-stops. The renouncement of bracketing avoids motion artifacts and reduces the data volume read from the sensor.
Publication Date: 2014-11-01
DOI: 10.5594/j18487
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/j18487
Author(s): Joachim Keinert
bio
Joachim Keinert, chief scientist at Fraunhofer IIS, has diplomas from both the University of Stuttgart, Germany, and Télécom ParisTech (formerly ENST) in Paris, France. In 2009, he received a Ph.D. with honors in the domain of electronic system level design for image processing applications. His research interests focus on high-dynamic range video capture and processing as well as light-field imaging and depth acquisition. Keinert actively participates in the JPEG compression standardization and is experienced in development of hard- and software for image processing in both embedded and general-purpose systems.
Michael Schoberl
bio
Michael Schöberl received a diploma in electrical engineering with honors in 2006 from the University of Erlangen-Nuremberg. He then joined the Fraunhofer IIS and started to work on high-quality imaging systems in the electronic imaging department. In 2007, he joined the University of Erlangen-Nuremberg to continue the research on algorithms for high-end camera systems in a close cooperation with Fraunhofer IIS. In 2013, he received a Ph.D. with honors in electrical engineering for his work on digital cameras. He is currently working as a senior scientist at the Fraunhofer IIS with a focus on novel imaging technologies.
Matthias Ziegler
bio
Matthias Ziegler was born in 1987 and received a diploma in electrical engineering from Friedrich-Alexander University Erlangen, Germany, 2012. He is with Fraunhofer IIS since that time and is working on algorithms for computational imaging. His research focus is on light-field production workflows and algorithms including disparity estimation, plenoptic cameras, and high-dynamic range.
Frederik Zilly
bio
Frederik Zilly is head of the Computational Imaging and Algorithms groups in the Moving Picture Department of Fraunhofer IIS in Erlangen, Germany. He received a diploma degree in physics from Free University of Berlin, Germany, in 2006. Before joining Fraunhofer IIS, he was scientific project manager in the Immersive Media and 3D Video group in the Image Processing Department at Fraunhofer HHI in Berlin where he was involved in several German and European research projects related to 3DTV. In this function was mainly responsible for the development of the stereoscopic analyzer (STAN) and coordinated the activities of the Fraunhofer HHI concerning the European research project MUSCADE project. Zilly has been honored for his work on the assistance system STAN (Stereoscopic Analyzer) with the Award for Outstanding Merit in Young Scientists, the Rudolf Urtel Prize 2011. He served as reviewer for different international conferences and journals His research focus lies in multi-camera image processing algorithms.
Siegfried Foessel
bio
Siegfried Foessel is head of the Moving Picture Technologies department at the Fraunhofer IIS in Erlangen and spokesman of the Fraunhofer digital cinema alliance. He was responsible for projects like the camera development ARRI D20/D21, the DCI (Digital Cinema Initiatives) certification test plan or the JPEG 2000 standardization for digital cinema. Foessel is member of various standardization bodies and organizations such as SMPTE, FKTG, ISO and DIN. He became a SMPTE Fellow in 2014. Foessel was the 2014 recipient of the Josef-von-Fraunhofer award for the development of easyDCP, a tool for creating and playback of Digital Cinema Packages. In 2014, he was elected to the president of the FKTG (Fernseh- und Kinotechische Gesellschaft e.V.), the German equivalent to SMPTE.
Copyright: © 2014 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. McCann J. Rizzi A. “The art and Science of HDR Imaging,” Wiley-IS&T Series in Imaging Science and Technology , Nov. 2011 . EXTERNAL
2. Akyüz A. O. Fleming R. Riecke B. E. Reinhard E. Bülthoff H. H. “Do HDR Displays Support LDR Content? A Psychophysical Evaluation,” Proc. ACM SIGGRAPH , 26 ( 3 ), No. 382007. EXTERNAL
3. Mann S. Picard R. W. “On Being ‘Undigital’ with Digital Cameras: Extending Dynamic Range by Combining Different Exposed Pictures,” Proc. 48th IS&T Annual Conf. , pp. 442 – 448 , May 1995 . EXTERNAL
4. Debevec P. E. Malik J. “Recovering High Dynamic Range Radiance Maps from Photographs,” Proc. 24th ACM Conf. on Comp. Graphics and Interactive Techniques (SIGGRAPH) , pp. 369 – 378 , Aug. 1997 . EXTERNAL
5. Aggarwal M. Ahuja N. “Split Aperture Imaging for High Dynamic Range,” Proc. IEEE Intern. Conf. on Comp. Vision (ICCV) , Vancouver, BC, Canada, pp. 10 – 17 , Jul. 2001 . EXTERNAL
6. Bonnard J. Loscos C. Valette G. Nourrit J. M. Lucas L. “High-Dynamic Range Video Acquisition with a Multiview Camera,” Optics, Photonics, and Dig. Technol. for Multimedia App. II. Vol. 84362012. EXTERNAL
7. Nayar S. Mitsunaga T. “High Dynamic Range Imaging: Spatially Varying Pixel Exposures,” Proc. IEEE Conf. on Comp. Vision and Pattern Recog. (CVPR) , Hilton Head, SC , pp. 472 – 479 , Jun. 2000 . EXTERNAL
8. Schöberl M. Keinert J. Ziegler M. Seiler J. Niehaus M. Schuller G. Kaup A. Foessel S. “Evaluation of a High Dynamic Range Video Camera with Non-Regular Sensor,” Proc. SPIE Electr. Imag.–Digital Photog. IX , Feb. 2013 . EXTERNAL
9. Schöberl M. Seiler J. Foessel S. Kaup A. “Increasing Imaging Resolution by Covering Your Sensor,” Proc. 18th IEEE Intern. Conf. on Image Proces. (ICIP) , pp. 1937 – 1940 , Sep. 2011 . EXTERNAL
10. European Machine Vision Association , “EMVA Standard 1288. Standard for Characterization of Image Sensors and Cameras,” Release 3.0, European Machine Vision Association, Barcelona , Spain , Nov. 2010 . EXTERNAL
11. Xiao F. Farrell J. Wandel B. “Psychophysical Thresholds and Digital Camera Sensitivity: The Thousand Photon Limit,” SPIE Electr. Imag.–Digital Photog. , 5678 : 75 – 84 , Jan. 2005 . EXTERNAL
12. European Machine Vision Association , “EMVA Standard 1288 Compliant Products.” http://www.emva.org/cms/index.php?idcatart=86 . May 2013. EXTERNAL
13. Schöberl M. Belz A. Nowak A. Seiler J. Kaup A. Foessel S. “Building a High Dynamic Range Video Sensor with Spatially Non-Regular Optical Filtering,” Proc. SPIE Optics + Photonics—Appl. of Digital Image Proc. XXXV , 84990C , Aug. 2012 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-j18487.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Joachim Keinert, Michael Schoberl, Matthias Ziegler, Frederik Zilly, and Siegfried Foessel; High-Dynamic Range Video Cameras Based on Single Shot Non-Regular Sampling, SMPTE Motion Imaging Journal ( Volume: 123, Issue: 8, November 2014); SMPTE, 2014. Available at https://doi.org/10.5594/j18487

Snippet:

Joachim Keinert, Michael Schoberl, Matthias Ziegler, Frederik Zilly, and Siegfried Foessel; High-Dynamic Range Video Cameras Based on Single Shot Non-Regular Sampling, SMPTE Motion Imaging Journal ( Volume: 123, Issue: 8, November 2014); SMPTE, 2014. Available at https://doi.org/10.5594/j18487

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Joachim Keinert, Michael Schoberl, Matthias Ziegler, Frederik Zilly, and Siegfried Foessel; <cite>High-Dynamic Range Video Cameras Based on Single Shot Non-Regular Sampling</cite>, SMPTE Motion Imaging Journal ( Volume: 123, Issue: 8, November 2014); SMPTE, 2014. Available at <a href="https://doi.org/10.5594/j18487" target="_blank" rel="noopener">https://doi.org/10.5594/j18487</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Joachim Keinert, Michael Schoberl, Matthias Ziegler, Frederik Zilly, and Siegfried Foessel; <cite id="bib-10-5594-j18487">High-Dynamic Range Video Cameras Based on Single Shot Non-Regular Sampling</cite>, SMPTE Motion Imaging Journal ( Volume: 123, Issue: 8, November 2014); SMPTE, 2014
<span class="doi">10.5594/j18487</span>
</li>