Towards Automated Perceptual Shot Matching in Motion Pictures

Metadata

Publisher: SMPTE — Pasadena, CA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 00, pp. 1–19
Abstract: We present an automated shot matching algorithm that considers perceptual effects and scene-specific context based on shot sequence. The algorithm focuses on viewer-centric elements, such as attention to faces or objects and the overall color mood across shots. Using publicly available deep learning models to detect salient image features, we employ a committee-based approach that matches these aspects independently before combining them into a single RGB balance and black level offset per shot. While fully automated, the system allows post hoc manual adjustments, including the strictness of face, object, and mood matching as well as temporal strictness. This transparent, parameterized approach avoids the black-box nature of many deep learning algorithms, providing intuitive, editable results that colorists can easily refine. We include visual examples to illustrate the algorithm's perceptual accuracy, and summarize a study with 5 professional colorists focused on assessing the quality of the match and potential time savings. Comparing manual grading from raw footage versus algorithm-assisted pre-matched footage, results indicate that a match comparable to that of a human colorist can be achieved in 20% less time. The algorithm achieved roughly 70% of the quality of the colorist match, as judged by the participants. The consistent demonstration of significant improvement underscores the value of future long-term studies that evaluate the impact on resource management and grading quality in real-world settings.
Publication Date: 2025-10-13
ISBN: Electronic: 978-1-61482-966-9
Author(s): Julius Tschannerl
Daniele Siragusano
Keyword(s): Color Matching, Color Grading, Perceptual Shot Matching, Machine Learning
Copyright: © 2025 SMPTE

Bibliographic Reference(s)

ISO.22028-1.2016 — International Organization for Standardization (ISO), ISO 22028–1:2016(en), “Photography and graphic technology-Extended colour encodings for digital image storage, manipulation, and interchange-Part 1: Architecture and requirements,” Mar. 2016. EXTERNAL
R. Xu and D. Wunsch, “Survey of clustering algorithms,” in IEEE Transactions on Neural Networks, vol. 16, no. 3, pp. 645–678, 2005. EXTERNAL
A. Vaswani, “Attention Is All You Need”, arXiv:1706.03762, 2017. EXTERNAL
A. Dosovitskyi, “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale”, arXiv:2010.11929, 2020. EXTERNAL
A. Radford, “Learning Transferable Visual Models From Natural Language Supervision”, arXiv:2103.00020, 2021. EXTERNAL
M. Oquab, “DINOv2: Learning Robust Visual Features without Supervision”, arXiv:2304.07193, 2023. EXTERNAL
Academy Color Encoding System (ACES), P-2013–001, “Recommended Procedures for the Creation and Use of Digital Camera System Input Device Transforms (IDTs)”, 2020, Available: https://docs.acescentral.com/#ux-guidelines EXTERNAL
FilmLight Ltd., D. Siragusano, “Additive mixture”, Accessed: 17/09/2025. Available: https://youtu.be/6h4mpYdQQMk?si=pmCo0DNQogUX9IIL, 2024. EXTERNAL
A. Adadi and M. Berrada, “Peeking inside the black-box: A survey on explainable artificial intelligence (xAI)”, IEEE Access, vol. 6, pp. 52 138–52 160, 2018. EXTERNAL
M. Ebner, “Algorithms for Color Constancy under Uniform Illumination” in Color Constancy. John Wiley & Sons, Ltd, ch. 6, pp. 103–141, 2006. EXTERNAL
A. Patt and R. Zeckhauser, “Action bias and environmental decisions”, Journal of Risk and Uncertainty, vol. 21, no. 1, pp. 45–72, 2000. EXTERNAL
V. C. Cardei, B. Funt, “Committee-Based Color Constancy”, Proc. IS&T 7th Color and Imaging Conf., pp 311–313, 1999. EXTERNAL
J. Deng, “RetinaFace: Single-stage Dense Face Localisation in the Wild”, arXiv:1905.00641, 2019. EXTERNAL
Y. Taigman, “DeepFace: Closing the Gap to Human-Level Performance in Face Verification”, IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA, 2014, pp. 1701–1708, 2014. EXTERNAL
N. Ravi, “SAM 2: Segment Anything in Images and Videos”, arXiv:2408.00714, 2024. EXTERNAL
P. J. Rousseeuw, “Silhouettes: A graphical aid to the interpretation and validation of cluster analysis”, Journal of Computational and Applied Mathematics, vol. 20, pp 53–65, 1987. EXTERNAL
Antler Post, N. Shaw,”Apple Log Profile”, Accessed: 17/09/2025, Available: https://antlerpost.com/colour-spaces/AppleLog.html, 2024. EXTERNAL
SMPTE ST 2065-1:2021 [Active]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/978-1-61482-966-9-4.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: 978-1-61482-966-9

Snippet:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: 978-1-61482-966-9

HTML (ISO 690 compliant)

Preview:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: 978-1-61482-966-9

Snippet:

<span class="citation">Julius Tschannerl and Daniele Siragusano; <cite>Towards Automated Perceptual Shot Matching in Motion Pictures</cite>, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: 978-1-61482-966-9</span>

SMPTE's HTML Pub

Preview:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: 978-1-61482-966-9

Snippet:

<li>
Julius Tschannerl and Daniele Siragusano; <cite id="bib-978-1-61482-966-9-4">Towards Automated Perceptual Shot Matching in Motion Pictures</cite>, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: 978-1-61482-966-9
</li>