“AI News Anchor” with Deep Learning-based Speech Synthesis
Metadata
- Publisher
- SMPTE — White Plains, NY, USA
- Doc Type
- Conference Paper
- Content Type
- Original Research
- Volume
- 2020, No. 11, pp. 1–13
- Abstract
- Deep learning-based text-to-speech (DL-TTS) is used in various situations and the sound quality is close to that of humans. We previously developed a news-specific DL-TTS system and implemented it to our AI news anchor for live broadcast programs and automatic news-speech distribution services. — We also developed our DL-TTS system for controlling speaking style and speech speed, pitch, intonation, and volume to facilitate the creation of various programs. More specifically, this method enables the changing of specific speaking styles, such as news style that mimics the style of news reporters, and conversation style. The purpose of creating this system was to eliminate discomfort due to differences in speech and speaking styles. Controlling the speaking-style is important in news speech because a mismatched speaking style does not appropriately convey news articles. For this study, we conducted an evaluation experiment on the conveying of simple news articles for language learners regarding speaking-style control and found appropriate speaking styles for automatically generated news speech. We conducted another evaluation experiment on whether synthetic speech generated from our system for “easy news” for Japanese language learners is useful for helping people understand the news in Japanese. We also discuss practical applications of our system. — Our news-specific deep neural network based-TTS system was found to effectively provide new services to broadcast stations. In the future, we will consider various use cases of flexible production by using a cloud system. The coronavirus pandemic has forced broadcasters to adopt new working styles. Thus, we will explore a new production system, such as a cloud-based system, for newsspeech automation for this new normal.
- Publication Date
- 2020-11-10
- DOI
10.5594/M001915- Link
- https://doi.org/10.5594/M001915
- Author(s)
- Kiyoshi KuriharaNHK (Japan Broadcasting Corporation) Science & Technology Research Laboratories, 1-10-11 Kinuta, Setagaya, Tokyo 157-8510, JapanNobumasa SeiyamaNHK (Japan Broadcasting Corporation) Science & Technology Research Laboratories, 1-10-11 Kinuta, Setagaya, Tokyo 157-8510, JapanTadashi KumanoNHK (Japan Broadcasting Corporation) Science & Technology Research Laboratories, 1-10-11 Kinuta, Setagaya, Tokyo 157-8510, JapanTakashi FukayaNHK (Japan Broadcasting Corporation), 2-2-1 Jinnan, Shibuya, Tokyo 150-8001, JapanKazunari SaitoNHK (Japan Broadcasting Corporation), 2-2-1 Jinnan, Shibuya, Tokyo 150-8001, JapanSatoshi SuzukiNHK (Japan Broadcasting Corporation), 2-2-1 Jinnan, Shibuya, Tokyo 150-8001, Japan
- Keyword(s)
- Text-to-Speech, AI News Anchor, Automatic Generated News Speech
- Copyright
- © 2020 Society of Motion Picture and Television Engineers, Inc.
Bibliographic Reference(s)
- Automatic Generation of Audio Descriptions for Sports Programs [Active]
- H. Segi, et al., "Template-Based Methods for Sentence Generation and Speech Synthesis," in 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 1757-1760, 2011. EXTERNAL
- Unity, 2020, no.25, June, Available: https://unity.com/ EXTERNAL
- H. Nakajima and T. Yamada, Nikkei Innovation Lab, "Innovation of Techniques Identifying Error (Proofreading Support) Device," 2018, Available: https://nilab.nikkei.co.jp/en/_theme/thesis-using-ai-for-article-proofreading-support-was-presented/ EXTERNAL
- H. Segi, et al., "An Automatic Broadcast System for a Weather Report Radio Program," IEEE Trans Broadcast, 59 (3): 548-555 2013. EXTERNAL
- NHK, "Nhk News Web Easy," Available: https://www3.nhk.or.jp/nhkworld/en/learnjapanese/audionews/ EXTERNAL
- K. Kurihara, et al., "Prosodic Features Control by Symbols as Input of Sequence-to-Sequence Acoustic Modeling for Neural TTS," presented at the IEICE Transactions on Information and Systems 2021. EXTERNAL
- Vizrt, Available: https://www.vizrt.com/products/viz-virtual-studio EXTERNAL
- H. Zen and A. Senior, "Deep Mixture Density Networks for Acoustic Modeling in Statistical Parametric Speech Synthesis," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 3844-3848, 2014. EXTERNAL
- Amazon, "Polly," Available: https://aws.amazon.com/polly/ EXTERNAL
- A. v. d. Oord, et al., "WaveNet: A Generative Model for Raw Audio," arXiv preprint arXiv:1609.03499 2016. EXTERNAL
- M. Morise, et al., "World: A Vocoder-Based High-Quality Speech Synthesis System for Real-Time Applications," IEICE Transactions on Information and Systems, E99D (7): 1877-1884 2016. EXTERNAL
- NHK, "News Yomiko (in Japanese)," Available: https://www.nhk.or.jp/voice/yomiko/ EXTERNAL
- D. F. Glas, et al., "Erica: The Erato Intelligent Conversational Android," in 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 22-29, 2016. EXTERNAL
- NHK Broadcasting Culture Research Institute, NHK's New Dictionary of Japanese Pronunciation and Accentuation. (in Japanese), Tokyo, 2016. EXTERNAL
- A. Imai, et al., "A New Touchscreen Application to Retrieve Speech Information Efficiently," IEEE Transactions on Consumer Electronics, 59 (1): 200-206 2013. EXTERNAL
- K. Tokuda, et al., "Speech Synthesis Based on Hidden Markov Models," in Proceedings of the IEEE, pp. 1234-1252, 2013. EXTERNAL
- J. Shen, et al., "Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictions," in Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4779-4783, 2018. EXTERNAL
- NHK STRL, "Automated Production of Weather Information Radio Programs," Available: https://www.nhk.or.jp/strl/open2019/tenji/17_e.html EXTERNAL
- The Mainichi, "Public Broadcaster's AI Newsreader to Make Senryu Poetry Debut," Available: https://mainichi.jp/english/articles/20190313/p2a/00m/0et/014000c EXTERNAL
- NHK, "AI Announcer Has Made a Debut on “News Check 11” Program," BROADCAST TECHNOLOGY, vol.2018, no.June, 11, pp. 28 2018, Available: https://www.nhk.or.jp/strl/publica/bt/bt74/pdf/nt-editors0074.pdf EXTERNAL
- Google, "Cloud Text-to-Speech," Available: https://cloud.google.com/text-to-speech EXTERNAL
- H. Segi, et al., "Development of a Prototype Data-Broadcast Receiver with a High-Quality Voice Synthesizer," IEEE Transactions on Consumer Electronics, 56 (1): 169-174 2010. EXTERNAL
- NHK Broadcasting Culture Research Institute, "Japanese Language for Broadcasting," Available: https://www.nhk.or.jp/bunken/english/research/kotoba/index.html EXTERNAL
- Sogou, "Sogou Introduces World's First 3D AI News Anchor," Available: http://ir.sogou.com/2020-05-21-Sogou-Introduces-Worlds-First-3D-AI-News-Anchor EXTERNAL
- Netflix, "Recording Dubbed Dialogue in a Home Environment," 2020, no.June 11 2020, Available: https://partnerhelp.netflixstudios.com/hc/en-us/articles/360047052733-Recording-Dubbed-Dialogue-In-A-Home-Environment EXTERNAL
Source Data (JSON)
Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001915.json
Reference Tree
Explore all references and references to this document, as a navigable tree.
Open Reference TreeReference this Doc
Plain text (ISO 690 compliant)
Preview:
Kiyoshi Kurihara, Nobumasa Seiyama, Tadashi Kumano, Takashi Fukaya, Kazunari Saito, and Satoshi Suzuki; “AI News Anchor” with Deep Learning-based Speech Synthesis, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at https://doi.org/10.5594/M001915
Snippet:
Kiyoshi Kurihara, Nobumasa Seiyama, Tadashi Kumano, Takashi Fukaya, Kazunari Saito, and Satoshi Suzuki; “AI News Anchor” with Deep Learning-based Speech Synthesis, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at https://doi.org/10.5594/M001915
HTML (ISO 690 compliant)
Preview:
Kiyoshi Kurihara, Nobumasa Seiyama, Tadashi Kumano, Takashi Fukaya, Kazunari Saito, and Satoshi Suzuki; “AI News Anchor” with Deep Learning-based Speech Synthesis, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at https://doi.org/10.5594/M001915
Snippet:
<span class="citation">Kiyoshi Kurihara, Nobumasa Seiyama, Tadashi Kumano, Takashi Fukaya, Kazunari Saito, and Satoshi Suzuki; <cite>“AI News Anchor” with Deep Learning-based Speech Synthesis</cite>, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/M001915" target="_blank" rel="noopener">https://doi.org/10.5594/M001915</a></span>
SMPTE's HTML Pub
Preview:
Kiyoshi Kurihara, Nobumasa Seiyama, Tadashi Kumano, Takashi Fukaya, Kazunari Saito, and Satoshi Suzuki; “AI News Anchor” with Deep Learning-based Speech Synthesis, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020
doi: 10.5594/M001915
url: https://doi.org/10.5594/M001915
doi: 10.5594/M001915
url: https://doi.org/10.5594/M001915
Snippet:
<li> Kiyoshi Kurihara, Nobumasa Seiyama, Tadashi Kumano, Takashi Fukaya, Kazunari Saito, and Satoshi Suzuki; <cite id="bib-10-5594-m001915">“AI News Anchor” with Deep Learning-based Speech Synthesis</cite>, SMPTE Meetings and Conferences ( November 2020); SMPTE, 2020 <span class="doi">10.5594/M001915</span> </li>