Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 126, No. 8, pp. 1–7
Abstract: This paper describes an experimental system that can create good quality subtitlei files for video clips derived from broadcast content. The system is designed to run automatically without the need for human verification. The approach utilizes existing metadata sources, an off-air broadcast archive and an archive of original subtitle files along with audio fingerprinting and speech-to-text technology to identify the source programme. It then locates the position of the video clip, verifies the match between the video clip and the subtitles, and creates a new subtitle file. This paper also reports on the results of the work using a large corpus of over 7,000 video clips and, further, smaller sets of clips from different television genres, and explores where improvements might be made. It then looks at the limitations of the current approach discussing alternative methods for providing subtitles for video clips.iThis paper uses the UK nomenclature of “subtitles” rather than “closed captions” as it was originally written for a European audience.
Publication Date: 2017-10-01
DOI: 10.5594/JMI.2017.2732858
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2017.2732858
Author(s): Mike Armstrong
Keyword(s): Accessibility, Artificial Intelligence, Automation, Captions, Metadata, Search, Subtitles
Copyright: © 2017 SMPTE

Bibliographic Reference(s)

EBU Tech 3380 [Active]
B. Butterworth, “History of the ‘BBC Redux’ project,” BBC Internet Blog, 2008, http://www.bbc.co.uk/blogs/bbcinternet/2008/10/history_of_the_bbc_redux_proje.html EXTERNAL
J. Tweed, “What is PIPs?” BBC Internet Blog, 2009, http://www.bbc.co.uk/blogs/bbcinternet/2009/02/what_is_pips.html EXTERNAL
M. Armstrong et al. “Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape,” presented at the IBC 2015 Conference, Amsterdam, The Netherlands, Sep. 2015. EXTERNAL
M. Armstrong, “Subtitling the Story of Life App” BBC R&D Blog, 2017, http://www.bbc.co.uk/rd/blog/2016-12-subtitling-the-story-of-life-app EXTERNAL
D. Jurafsky and J. H. Martin, Speech and Language Processing, Second Edition, Pearson Education International: Upper Saddle River, NJ, 2009. EXTERNAL
M. Armstrong, “Introducing Automatically Matched Subtitles,” BBC R&D Blog, 2017, http://www.bbc.co.uk/rd/blog/2017-06-automatically-matched-subtitles EXTERNAL
BBC R&D Snippets, http://www.bbc.co.uk/rd/projects/snippets EXTERNAL
C. J. Hughes and M. Armstrong, “Automatic Retrieval of Closed Captions for Web Clips from Broadcast TV Content,” Proc. NAB Broadcast Engineering Conf., pp. 318-324, Apr. 2015. EXTERNAL
BBC Subtitle Guidelines, Version 1.1.1, 2016, http://bbc.github.io/subtitle-guidelines/ EXTERNAL
Independent Television Commission, “ITC Guidance on Standards for Subtitling,” 1999. EXTERNAL
K. Yan, H. Derek, and H. Sukthankar, “Computer Vision for Music Identification,” IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1(1), 2005. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2017.2732858.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Mike Armstrong; Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 8, October 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2017.2732858

Snippet:

Mike Armstrong; Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 8, October 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2017.2732858

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Mike Armstrong; <cite>Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips</cite>, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 8, October 2017); SMPTE, 2017. Available at <a href="https://doi.org/10.5594/JMI.2017.2732858" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2017.2732858</a></span>

SMPTE's HTML Pub

Preview:

Mike Armstrong; Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 8, October 2017); SMPTE, 2017
doi: 10.5594/JMI.2017.2732858
url: https://doi.org/10.5594/JMI.2017.2732858

Snippet:

<li>
Mike Armstrong; <cite id="bib-10-5594-jmi-2017-2732858">Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips</cite>, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 8, October 2017); SMPTE, 2017
<span class="doi">10.5594/JMI.2017.2732858</span>
</li>