Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles
Metadata
- Publisher
- SMPTE
- Doc Type
- Journal Article
- Content Type
- Original Research
- Abbreviated Title
- SMPTE Motion Imaging Jour.
- Volume
- 135, No. 4, pp. 16–24
- Abstract
- This paper describes a proof-of-concept approach to monitoring timing errors and word loss in TV subtitles. It reviews previous attempts at subtitle monitoring and the problems caused to viewers by subtitle timing errors and word loss. It then introduces the use of speech to text technology and the conventions in subtitling where repetition, non-speech content and errors can make the task of aligning the speech-to-text transcript to subtitles more challenging. The paper describes the approach taken to remove non-speech content from the subtitles and transcript, along with the complex and iterative natural language processing techniques devised to ensure a sufficiently accurate alignment between the two. It then gives examples of the ways in which the results are displayed and some sample results showing the scale of problems with subtitle quality, along with examples of 24-hour plots, which are a convenient way to identify issues across a large sample of data. The paper concludes by reviewing the limits of this approach in terms of accuracy and points out the need for human oversight.
- Publication Date
- 2026-07-01
- DOI
10.5594/JMI.2026/TZBT7663- ISSN
- Print:
1545-0279| Electronic:2160-2492 - Link
- https://doi.org/10.5594/JMI.2026/TZBT7663
- Author(s)
- Michael Armstrong
- Keyword(s)
- Accessibility, Quality, Monitoring, Subtitles, Captions
- Copyright
- © 2026 SMPTE
Bibliographic Reference(s)
- Subtitle Quality: Measuring and Improving Subtitle Quality. BBC R&D Project Page, Jan. 2012. [Online]. Available: https://www.bbc.co.uk/rd/projects/live-subtitle-quality. EXTERNAL
- M. Armstrong, “The Development of a Methodology to Evaluate the Perceived Quality of Live TV Subtitles,” Proc. IBC 2013, Amsterdam, The Netherlands. pp.11-1. IET on behalf of IBC 2013, Sep. 2013. [Online]. Available: https://digital-library.theiet.org/doi/abs/10.1049/ibc.2013.0044. EXTERNAL
- T. Ware and M. Simpson, Live Subtitles Re-Timing Proof of Concept, BBC R&D White Paper WHP 318. [Online]. Available: https://www.bbc.co.uk/rd/publications/whitepaper318. EXTERNAL
- Ofcom, Measuring Live Subtitling Quality: Results From the First Sampling Exercise, Apr. 2014. [Online]. Available: https://web.archive.org/web/20210419114907/ https://www.ofcom.org.uk/research-and-data/tv-radio-and-on-demand/tvresearch/live-subtitling/sampling-results. EXTERNAL
- Ofcom, Measuring Live Subtitling Quality: Results From the Second Sampling Exercise, Nov. 2014. [Online]. Available: https://web.archive.org/web/20210419114907/ https://www.ofcom.org.uk/research-and-data/tv-radio-andon-demand/tv-research/live-subtitling/sampling-results-2. EXTERNAL
- Ofcom, Measuring Live Subtitling Quality: Results From the Third Sampling Exercise, May 2015. [Online]. Available: https://web.archive.org/web/20210704063409/ https://www.ofcom.org.uk/research-and-data/tv-radio-and-on-demand/tvresearch/live-subtitling/sampling-results-3. EXTERNAL
- Ofcom, Measuring Live Subtitling Quality: Results From the Fourth Sampling Exercise, Nov. 2015. [Online]. Available: https://web.archive.org/web/20210419114907/ https://www.ofcom.org.uk/research-and-data/tv-radio-and-on-demand/tv-research/live-subtitling/sampling_results_4. EXTERNAL
- P. Romero-Fresco, “Accessing Communication: The Quality of Live Subtitles in the UK,” Lang. Commun., 49: 56–69, Jul. 2016. [Online]. Available: https://www.sciencedirect.com/science/article/abs/pii/S0271530916300398. EXTERNAL
- S. Bason and M. Armstrong, “TVX2014 Short Paper-Subtitle Monitoring,” BBC R&D Blog, Oct. 2014. [Online]. Available: https://www.bbc.co.uk/rd/blog/2014-10-tvx2014-subtitle-monitoring. EXTERNAL
- J. Sandford, “The Impact of Subtitle Display Rate on Enjoyment Under Normal Television Viewing Conditions,” IBC2015 Conf., 2015. [Online]. Available: https://www.bbc.co.uk/rd/publications/whitepaper306. EXTERNAL
- T. Apone, B. Botkin, M. Brooks, and L. Goldberg, “Research Into Automated Error Ranking of Real-Time Captions in Live Television News Programs,” The Carl and Ruth Shapiro Family National Center for Accessible Media at WGBH (NCAM), 2011. [Online]. Available: http://ncamftp.wgbh.org/ncam-old-site/file_download/CC_Metrics_research_paper_final.pdf. EXTERNAL
- A. Rane, “BBC Look North's Subtitle Mix-Up Has Peter Levy and Fans in Hysterics,” Grimsby Live, Apr. 2022. [Online]. Available: https://www.grimsbytelegraph.co.uk/news/celebs-tv/bbc-look-norths-subtitle-mix-6928975. EXTERNAL
- UK Subtitling Audiences Network, UK Subtitling Audience Survey, forthcoming publication. EXTERNAL
- A. Szarkowska and O. Gerber-Morón, “Two or Three Lines: A Mixed-Methods Study on Subtitle Processing and Preferences,” Perspectives, 27 (1): 144–164, 2019. [Online]. Available: https://discovery.ucl.ac.uk/id/eprint/10054421/3/Szarkowska_Two%20or%20three%20lines_a%20mixed-methods%20study%20on%20subtitle%20processing%20and%20preferences_plain_FINAL.pdf. EXTERNAL
- R. G. Baker, Guidelines for the Subtitling of Television Programmes. London, U.K.: Indep. Broadcast. Authority, 1981. EXTERNAL
- R. G. Baker, D. Lambourne, and C. Rowson, Handbook for Television Subtitlers. London, U.K.: Indep. Broadcast. Authority, 1982. EXTERNAL
- R. G. Baker and A. F. Newell, “Teletext Subtitles for the Deaf: Problems in Linguistics and Psychology,” Proc. Int. Broadcast. Conv., pp. 97–100, 1980. EXTERNAL
- G. J. Downey, Closed Captioning: Subtitling, Stenography, and the Digital Convergence of Text With Television. Baltimore, MD, USA:Johns Hopkins Univ. Press, 2008, p. 85. EXTERNAL
- Ofcom, Ofcom's Guidelines on Providing Television and On-Demand Access Services, Jul. 2024. [Online]. Available: https://www.ofcom.org.uk/tv-radio-and-on-demand/accessibility/tv-access-services/. EXTERNAL
- K. Kuhn, V. Kersken, B. Reuter, N. Egger, and G. Zimmermann, “Measuring the Accuracy of Automatic Speech Recognition Solutions,” ACM Trans. Access. Comput., 16 (4): 1–23, 2024. [Online]. Available: https://dl.acm.org/doi/pdf/10.1145/3636513. EXTERNAL
- A. Dimri, “Using Gen AI to Add Subtitles on BBC Sounds,” BBC Media Centre, Aug. 2024. [Online]. Available: https://www.bbc.co.uk/mediacentre/2024/using-gen-ai-to-add-subtitles-on-bbc-sounds. EXTERNAL
- R. T. Davies, “An Update on Generative AI (Gen AI) at the BBC,” BBC Media Centre, Jan. 2025. [Online]. Available: https://www.bbc.com/mediacentre/2025/articles/update-generative-ai-at-the-bbc. EXTERNAL
- A. T. Hadgu and T. Gebru, “Replacing Federal Workers With Chatbots Would Be a Dystopian Nightmare,” Sci. Am., Apr. 2025. [Online]. Available: https://www.scientificamerican.com/article/replacing-federal-workers-with-chatbots-would-be-a-dystopian-nightmare/. EXTERNAL
- Linto AI, Whisper-Timestamped [Software]. [Online]. Available: https://github.com/linto-ai/whisper-timestamped. EXTERNAL
- M. Armstrong, “Automatic Recovery and Verification of Subtitles for Large Collections of Video Clips,” SMPTE Motion Imag. J., 126 (8): 1–7, Oct. 2017. [Online]. Available: https://www.bbc.co.uk/rd/publications/whitepaper323. EXTERNAL
- Subtiting Audiences Network. [Online]. Available: https://subtitlingaudiences.org/. EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2026-TZBT7663.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Michael Armstrong; Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles, MIJ 2026, Volume 135, Number 4 (pp. 16 to 24); SMPTE, 2026. Available at https://doi.org/10.5594/JMI.2026/TZBT7663
Snippet:
Michael Armstrong; Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles, MIJ 2026, Volume 135, Number 4 (pp. 16 to 24); SMPTE, 2026. Available at https://doi.org/10.5594/JMI.2026/TZBT7663
HTML (ISO 690 compliant)
Preview:
Michael Armstrong; Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles, MIJ 2026, Volume 135, Number 4 (pp. 16 to 24); SMPTE, 2026. Available at https://doi.org/10.5594/JMI.2026/TZBT7663
Snippet:
<span class="citation">Michael Armstrong; <cite>Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles</cite>, MIJ 2026, Volume 135, Number 4 (pp. 16 to 24); SMPTE, 2026. Available at <a href="https://doi.org/10.5594/JMI.2026/TZBT7663" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2026/TZBT7663</a></span>
SMPTE's HTML Pub
Preview:
Michael Armstrong; Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles, MIJ 2026, Volume 135, Number 4 (pp. 16 to 24); SMPTE, 2026
doi: 10.5594/JMI.2026/TZBT7663
url: https://doi.org/10.5594/JMI.2026/TZBT7663
doi: 10.5594/JMI.2026/TZBT7663
url: https://doi.org/10.5594/JMI.2026/TZBT7663
Snippet:
<li> Michael Armstrong; <cite id="bib-10-5594-jmi-2026-tzbt7663">Using Generative-AI Speech-to-Text Output to Provide Automated Monitoring of Television Subtitles</cite>, MIJ 2026, Volume 135, Number 4 (pp. 16 to 24); SMPTE, 2026 <span class="doi">10.5594/JMI.2026/TZBT7663</span> </li>