Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 126, No. 1, pp. 57–62
Abstract: Whereas the closed-caption broadcasting is provided for almost the whole broadcast time in Korea, the sign language interpretation is not. By translating the realtime closed captions, it is possible to provide three-dimensional (3D) sign language translations for more broadcast time. We propose a sign language broadcasting system for weather forecasts and extend it for all kinds of TV programs. To find the frequency of each word, we analyzed the last three years’ weather forecast scripts, and an open-domain corpus of about 1.2 million words from the Korean Broadcasting System. We use KorLex, the Korean wordnet, to build the sign language synonym dictionary and for the word sense disambiguation to improve the translation performance. Optically captured sign language motions are used for the 3D avatar to present sign language with motion blending. We developed a mobile on-demand sign language weather forecast application and a realtime sign language interpretation system for all kinds of TV programs.
Publication Date: 2017-01-01
DOI: 10.5594/JMI.2016.2632278
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2016.2632278
Author(s): Juhyun Oh
Seonggyu Jeon
Byungsun Kim
Minho Kim
Sangwook Kang
Hyukchul Kwon
Iktae Kim
Youngho Song
Keyword(s): Machine Translation, Sign Language
Copyright: © 2016 SMPTE

Bibliographic Reference(s)

CEA 708-D:2008 [Superseded]
Pusan National University, “Artificial Intelligence Laboratory.” Retrieved December 15, 2016, from http://borame.cs.pusan.ac.kr/. EXTERNAL
A. Yoon, S. Hwang, E. Lee, and H. Kwon, “Construction of Korean Wordnet KorLex 1.5,” Journal of KIISE: Software and Applications, 36(1):92-108, 2009. (in Korean). EXTERNAL
H. Kaneko, N. Hamaguchi, M. Doke, and S. Inoue, “Sign language animation using TVML,” Proc. 9th ACM SIGGRAPH Conf. Virtual-Reality Continuum Appl. in Ind., (VRCAI), Seoul, Korea, pp. 289-292, 2010. EXTERNAL
T. Araújo, F. Ferreira, D. Silva, F. Lemos, G. Neto, D. Omaia, G. Filho, and T. Tavares, “Automatic Generation of Brazilian Sign Language Windows for Digital TV Systems,” Journal of the Brazilian Computer Society, 19(2):107-125, 2012. EXTERNAL
Korean Broadcasting System, “My best friend K.” Retrieved December 15, 2016, from http://myk.kbs.co.kr/. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2016.2632278.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Juhyun Oh, Seonggyu Jeon, Byungsun Kim, Minho Kim, Sangwook Kang, Hyukchul Kwon, Iktae Kim, and Youngho Song; Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2016.2632278

Snippet:

Juhyun Oh, Seonggyu Jeon, Byungsun Kim, Minho Kim, Sangwook Kang, Hyukchul Kwon, Iktae Kim, and Youngho Song; Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at https://doi.org/10.5594/JMI.2016.2632278

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Juhyun Oh, Seonggyu Jeon, Byungsun Kim, Minho Kim, Sangwook Kang, Hyukchul Kwon, Iktae Kim, and Youngho Song; <cite>Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs</cite>, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017. Available at <a href="https://doi.org/10.5594/JMI.2016.2632278" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2016.2632278</a></span>

SMPTE's HTML Pub

Preview:

Juhyun Oh, Seonggyu Jeon, Byungsun Kim, Minho Kim, Sangwook Kang, Hyukchul Kwon, Iktae Kim, and Youngho Song; Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017
doi: 10.5594/JMI.2016.2632278
url: https://doi.org/10.5594/JMI.2016.2632278

Snippet:

<li>
Juhyun Oh, Seonggyu Jeon, Byungsun Kim, Minho Kim, Sangwook Kang, Hyukchul Kwon, Iktae Kim, and Youngho Song; <cite id="bib-10-5594-jmi-2016-2632278">Avatar-Based Sign Language Interpretations for Weather Forecast and other TV Programs</cite>, SMPTE Motion Imaging Journal ( Volume: 126, Issue: 1, 2017); SMPTE, 2017
<span class="doi">10.5594/JMI.2016.2632278</span>
</li>