Towards Automated Perceptual Shot Matching in Motion Pictures
Metadata
- Publisher
- SMPTE — Pasadena, CA
- Doc Type
- Conference Paper
- Content Type
- Original Research
- Volume
- 00, pp. 1–19
- Abstract
- We present an automated shot matching algorithm that considers perceptual effects and scene-specific context based on shot sequence. The algorithm focuses on viewer-centric elements, such as attention to faces or objects and the overall color mood across shots. Using publicly available deep learning models to detect salient image features, we employ a committee-based approach that matches these aspects independently before combining them into a single RGB balance and black level offset per shot. While fully automated, the system allows post hoc manual adjustments, including the strictness of face, object, and mood matching as well as temporal strictness. This transparent, parameterized approach avoids the black-box nature of many deep learning algorithms, providing intuitive, editable results that colorists can easily refine. We include visual examples to illustrate the algorithm's perceptual accuracy, and summarize a study with 5 professional colorists focused on assessing the quality of the match and potential time savings. Comparing manual grading from raw footage versus algorithm-assisted pre-matched footage, results indicate that a match comparable to that of a human colorist can be achieved in 20% less time. The algorithm achieved roughly 70% of the quality of the colorist match, as judged by the participants. The consistent demonstration of significant improvement underscores the value of future long-term studies that evaluate the impact on resource management and grading quality in real-world settings.
- Publication Date
- 2025-10-13
- ISBN
[object Object]- Author(s)
- Julius TschannerlDaniele Siragusano
- Keyword(s)
- Color Matching, Color Grading, Perceptual Shot Matching, Machine Learning
- Copyright
- © 2025 SMPTE
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/978-1-61482-966-9-4.json
Reference this Doc
Plain text (ISO 690 compliant)
Preview:
Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: [object Object]
Snippet:
Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: [object Object]
HTML (ISO 690 compliant)
Preview:
Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: [object Object]
Snippet:
<span class="citation">Julius Tschannerl and Daniele Siragusano; <cite>Towards Automated Perceptual Shot Matching in Motion Pictures</cite>, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: [object Object]</span>
SMPTE's HTML Pub
Preview:
Julius Tschannerl and Daniele Siragusano; Towards Automated Perceptual Shot Matching in Motion Pictures, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: [object Object]
Snippet:
<li> Julius Tschannerl and Daniele Siragusano; <cite id="bib-978-1-61482-966-9-4">Towards Automated Perceptual Shot Matching in Motion Pictures</cite>, MTS 2025, Article 4 (pp. 1 to 19); SMPTE, 2025, ISBN: [object Object] </li>