What Electronic Image Noise Signatures Can Tell Us About Image Linearity and Camera Encoding

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 133, No. 5, pp. 71–78
Abstract: Electronic image noise is often described as an artifact of image capture, which typically requires correction. Several sources of electronic image noise contribute to the overall total noise in an image. Some of the noise, known as systematic noise, can be corrected for in-camera, but noise due to specific sources, like photon noise, persists after capture and increases with exposure. We study this relationship between exposure and noise and discover that this relationship reveals information about the linearity, or nonlinearity, of the image encoding. Nonlinear encoding of images through an optoelectronic transfer function (OETF) is a typical image processing step that allows for perceptually efficient use of encoding bit depth, and the accurate measurement or estimation of the OETF becomes necessary for proper processing of images through motion picture post-production workflows. We propose a method based on this relationship and demonstrate how it reveals information that can be used in an inference framework to estimate the OETF and, in turn, linearize images for accurate processing without the need for charts or specific image capture conditions. In addition, we describe the limitations of our method, for example, where extensive and adaptive noise correction can prevent our method from accurately estimating the OETF.
Publication Date: 2024-09-01
DOI: 10.5594/JMI.2024/IEMT5198
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2024/IEMT5198
Author(s): Ricardo R. Figueroa
Keyword(s): Radiometric Calibration, OETF, Camera Response Function (CRF)
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

T. Mitsunaga and S.K. Nayar, “Radiometric Self Calibration,” In Computer Vision and Pattern Recognition, 1999, IEEE Computer Society Conference, Vol. 1, pages 2 vol. (xxiii+637+663), 1999. EXTERNAL
Paul E. Debevec and Jitendra Malik. “Recovering High Dynamic Range Radiance Maps from Photographs,” in Proc. of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH '97, pp. 369–378, New York, NY, 1997, ACM Press/Addison-Wesley Publishing Co.. EXTERNAL
M.D. Grossberg and S.K. Nayar. “Determining the Camera Response from Images: What Is Knowable?” Pattern Analysis and Machine Intelligence, IEEE Trans., 25(77):pp. 1455–1467, Nov. 2003. EXTERNAL
C. Manders, C. Aimone, and S. Mann, “Camera Response Function Recovery from Different Illuminations of Identical Subject Matter,” Image Processing, 2004, in ICIP '04. 2004 International Conference, Vol. 5, pp. 2965–2968. EXTERNAL
Seon Joo Kim, J.-M. Frahm, and M. Pollefeys. “Joint Feature Tracking and Radiometric Calibration from Auto-Exposure Video,” in Proc. IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8, Oct. 2007. EXTERNAL
H. Farid, “Blind Inverse Gamma Correction,” IEEE Transactions Image Processing, 10(10):pp. 1428–1433, Oct. 2001. EXTERNAL
S. Lin, Jinwei Gu, S. Yamazaki, and Heung-Yeung Shum. “Radiometric Calibration from a Single Image,” in Proc. 2004 IEEE Comp. Soc. Conf. Computer Vision and Pattern Recognition (CVPR) 2004, Vol. 2, pp. II-938–II-945, July 2004. EXTERNAL
M. Diaz and P. Sturm, “Radiometric Calibration Using Photo Collections,” in Proc. 2077 IEEE International Conference on Computational Photography (ICCP), pp. 1–8, Apr. 2011. EXTERNAL
K. Shafique and M. Shah, “Estimation of the Radiometric Response Function of a Color Camera from Differently Illuminated Images,” in Proc. 2004 International Conference on Image Proc (ICIP), Vol. 4, pp. 2339–2342, Oct. 2004. EXTERNAL
Sujit Kuthirummal, Aseem Agarwala, Dan B Goldman, and Shree K Nayar, “Priors for Large Photo Collections and What They Reveal About Cameras,” In Computer Vision-ECCV 2008, pp. 74–87, Springer: 2008. EXTERNAL
Ricardo R. Figueroa and Rui Li, “Bayesian methods for radiometric calibration in motion picture encoding workflows,” SMPTE Mot. Imag. J., 128(7):pp. 25–30, Aug 2019. EXTERNAL
M.D. Grossberg and S.K. Nayar. “Modeling the Space of Camera Response Functions.” Pattern Analysis and Machine Intelligence, IEEE Transactions, 26(10):pp. 1272–1282, Oct. 2004. EXTERNAL
Modeling eye movement patterns to characterize perceptual skill in image-based diagnostic reasoning processes Li R., Shi P., Pelz J., Alm C.O., Haake A.R. Computer Vision and Image Understanding, 151: pp. 138–152, Oct. 2016. EXTERNAL
Christopher M. Bishop, “Pattern Recognition and Machine Learning (Information Science and Statistics),” Springer-Verlag: Berlin, Heidelberg, 2006. EXTERNAL
Christophe Andrieu, Nando De Freitas, Arnaud Doucet, and Michael I Jordan. “An Introduction to MCMC for Machine Learning,” Machine Learning, 50(7–2):pp. 5–43, 2003. EXTERNAL
Noise, Dynamic Range, and Bit-Depth in Digital SLRs, Emil Martinec. [Online]. Available: https://homes.psd.uchicago.edu/-ejmartin/pix/20d/tests/noise/index.html. EXTERNAL
Ricardo R. Figueroa and Jinwei Gu, “Camera Radiometric Calibration from Motion Images,” in presented at the SMPTE Annual Technical Conference Exhibition, Hollywood, CA, Sep. 2013. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2024-IEMT5198.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Ricardo R. Figueroa; What Electronic Image Noise Signatures Can Tell Us About Image Linearity and Camera Encoding, MIJ 2024, Volume 133, Number 5 (pp. 71 to 78); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/IEMT5198

Snippet:

Ricardo R. Figueroa; What Electronic Image Noise Signatures Can Tell Us About Image Linearity and Camera Encoding, MIJ 2024, Volume 133, Number 5 (pp. 71 to 78); SMPTE, 2024. Available at https://doi.org/10.5594/JMI.2024/IEMT5198

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Ricardo R. Figueroa; <cite>What Electronic Image Noise Signatures Can Tell Us About Image Linearity and Camera Encoding</cite>, MIJ 2024, Volume 133, Number 5 (pp. 71 to 78); SMPTE, 2024. Available at <a href="https://doi.org/10.5594/JMI.2024/IEMT5198" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2024/IEMT5198</a></span>

SMPTE's HTML Pub

Preview:

Ricardo R. Figueroa; What Electronic Image Noise Signatures Can Tell Us About Image Linearity and Camera Encoding, MIJ 2024, Volume 133, Number 5 (pp. 71 to 78); SMPTE, 2024
doi: 10.5594/JMI.2024/IEMT5198
url: https://doi.org/10.5594/JMI.2024/IEMT5198

Snippet:

<li>
Ricardo R. Figueroa; <cite id="bib-10-5594-jmi-2024-iemt5198">What Electronic Image Noise Signatures Can Tell Us About Image Linearity and Camera Encoding</cite>, MIJ 2024, Volume 133, Number 5 (pp. 71 to 78); SMPTE, 2024
<span class="doi">10.5594/JMI.2024/IEMT5198</span>
</li>