Towards Automated Perceptual Shot Matching in Motion Pictures

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 135, No. 1, pp. 27–37
Abstract: We present an automated shot-matching algorithm that incorporates perceptual effects and scene-specific context. Focusing on viewer-centric elements, such as attention to faces or objects and overall color mood, the system uses publicly available deep learning models to detect salient features. A committee-based approach matches these aspects independently, then combines them into a single RGB balance and black-level offset per shot. Although fully automated, the system supports manual adjustments to the strictness of face, object, mood, and temporal matching. This transparent, parameterized design avoids black-box behavior and provides intuitive, editable results for colorists. Visual examples demonstrate perceptual accuracy, and a study with five professional colorists evaluates match quality and potential time savings. Comparing manual grading of raw footage with algorithm-assisted pre-matched footage, results show a human-comparable match achieved 20% faster, with the algorithm reaching about 70% of colorist quality. These findings highlight the value of extended real-world evaluation.
Publication Date: 2026-01-01
DOI: 10.5594/JMI.2026/AAZW6907
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2026/AAZW6907
Author(s): Julius Tschannerl
Daniele Siragusano
Keyword(s): Color Matching, Color Grading, Perceptual Shot Matching, Machine Learning
Copyright: © 2026 SMPTE

Bibliographic Reference(s)

ISO.22028-1.2016 — International Organization for Standardization (ISO), ISO 22028–1:2016(en), “Photography and graphic technology-Extended colour encodings for digital image storage, manipulation, and interchange-Part 1: Architecture and requirements,” Mar. 2016. EXTERNAL
R. Xu and D. Wunsch, “Survey of Clustering Algorithms,” IEEE Trans. Neural Netw., 16 (3): 645–678, May 2005. EXTERNAL
A. Vaswani, “Attention Is All You Need,” arXiv preprint arXiv:1706.03762, Jun. 2017. EXTERNAL
A. Dosovitskiy, “An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale,” arXiv preprint arXiv: 2010.11929, Oct. 2020. EXTERNAL
A. Radford, “Learning Transferable Visual Models From Natural Language Supervision,” arXiv preprint arXiv: 2103.00020, Mar. 2021. EXTERNAL
M. Oquab, “DINOv2: Learning Robust Visual Features Without Supervision,” arXiv preprint arXiv: 2304.07193, Apr. 2023. EXTERNAL
Academy Color Encoding System (ACES), P-2013–001, Recommended Procedures for the Creation and Use of Digital Camera System Input Device Transforms (IDTs), 2020. [Online]. Available: https://docs.acescentral.com/#ux-guidelines. EXTERNAL
FilmLight Ltd., D. Siragusano, “Additive Mixture,” video presentation, 2024. Accessed Sep. 17, 2025. [Online]. Available: https://youtu.be/6h4mpYdQQMk. EXTERNAL
A. Adadi and M. Berrada, “Peeking Inside the Black Box: A Survey on Explainable Artificial Intelligence (XAI),” IEEE Access, 6: 52138–52160, Sep. 2018. EXTERNAL
M. Ebner, “Algorithms for Color Constancy Under Uniform Illumination,” in Color Constancy, John Wiley & Sons, Ltd., Ch. 6, pp. 103–141, 2006. EXTERNAL
A. Patt and R. Zeckhauser, “Action Bias and Environmental Decisions,” J. Risk Uncertainty, 21 (1): 45–72, Jul. 2000. EXTERNAL
V. C. Cardei and B. Funt, “Committee-Based Color Constancy,” Proc. IS&T 7th Color Imaging Cont., Scottsdale, AZ, pp. 311–313, Nov. 1999. EXTERNAL
J. Deng, “RetinaFace: Single-Stage Dense Face Localisation in the Wild,” arXiv preprint arXiv:1905.00641, May 2019. EXTERNAL
Y. Taigman, “DeepFace: Closing the Gap to Human-Level Performance in Face Verification,” Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), pp. 1701–1708, Jun. 2014. EXTERNAL
N. Ravi, “SAM 2: Segment Anything in Images and Videos,” arXiv preprint arXiv:2408.00714. Aua. 2024. EXTERNAL
P. J. Rousseeuw, “Silhouettes: A Graphical Aid to the Interpretation and Validation of Cluster Analysis,” J. Comput. Appl. Math., 20: 53–65, Nov. 1987. EXTERNAL
Antler Post, N. Shaw, “Apple Log Profile,” technical note, 2024. Accessed Sep. 17, 2025. [Online]. Available: https://antlerpost.com/colour-spaces/AppleLog.html. EXTERNAL
“Spearman Rank Correlation Coefficient,” in The Concise Encyclopedia of Statistics, pp. 502–505, Springer: New York, NY, 2008, doi:10.1007/978-0-387-32833-1_379. EXTERNAL
SMPTE ST 2065-1:2021 [Active]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2026-AAZW6907.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MIJ 2026, Volume 135, Number 1 (pp. 27 to 37); SMPTE, 2026. Available at https://doi.org/10.5594/JMI.2026/AAZW6907

Snippet:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MIJ 2026, Volume 135, Number 1 (pp. 27 to 37); SMPTE, 2026. Available at https://doi.org/10.5594/JMI.2026/AAZW6907

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Julius Tschannerl and Daniele Siragusano; <cite>Towards Automated Perceptual Shot Matching in Motion Pictures</cite>, MIJ 2026, Volume 135, Number 1 (pp. 27 to 37); SMPTE, 2026. Available at <a href="https://doi.org/10.5594/JMI.2026/AAZW6907" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2026/AAZW6907</a></span>

SMPTE's HTML Pub

Preview:

Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MIJ 2026, Volume 135, Number 1 (pp. 27 to 37); SMPTE, 2026
doi: 10.5594/JMI.2026/AAZW6907
url: https://doi.org/10.5594/JMI.2026/AAZW6907

Snippet:

<li>
Julius Tschannerl and Daniele Siragusano; <cite id="bib-10-5594-jmi-2026-aazw6907">Towards Automated Perceptual Shot Matching in Motion Pictures</cite>, MIJ 2026, Volume 135, Number 1 (pp. 27 to 37); SMPTE, 2026
<span class="doi">10.5594/JMI.2026/AAZW6907</span>
</li>