3D Video Technology Based on Spatial Imaging for Advanced Broadcasting

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 129, No. 9, pp. 24–30
Abstract: In this study, we investigate three-dimensional (3D) video technology based on spatial imaging to implement a next-generation broadcasting service. This technology allows viewers to watch 3D videos without the need for specialized glasses. However, the main challenge associated with the application of this technology is the large amount of ray information that needs to be acquired and reproduced to improve the quality of the 3D videos. Therefore, we are in the process of actively developing methods to acquire high-density ray information from multiviewpoint images, captured using a multicamera system; in addition, we are devising 3D display methods using multiple display devices. In this paper, we present the most recent results of our research regarding 3D television technologies, including a prototype system based on our novel display method called “Aktina Vision.” This system can reproduce 3D videos of real objects at a resolution of approximately 330,000 pixels, three times that of conventional full-parallax spatial imaging methods using a lens array.
Publication Date: 2020-10-01
DOI: 10.5594/JMI.2020.3010391
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2020.3010391
Author(s): Hayato Watanabe
bio
Hayato Watanabe received BS and MS degrees in information and computer science from Keio University, Tokyo, Japan, in 2010 and 2012, respectively. In 2012, he joined the Japan Broadcasting Corporation (NHK), Tokyo. Since 2015, he has been engaged in research on three-dimensional September 2020 | SMPTE Motion Imaging Journal 7 display systems with the NHK Science & Technology Research Laboratories (STRL).
Hisayuki Sasaki
bio
Hisayuki Sasaki received a BS degree in engineering systems and an MS degree in engineering mechanics from the University of Tsukuba, Tsukuba, Japan, in 1999 and 2001, respectively, and a PhD degree in information sciences from Tohoku University, Sendai, Japan, in 2018. He joined NHK in 2001 and worked at the Akita Broadcasting Station. Since 2006, he has been engaged in research on three-dimensional (3D) imaging systems at the NHK STRL.
Kensuke Ikeya
bio
Kensuke Ikeya received a BS degree in engineering from the Tokyo University of Agriculture and Technology, Tokyo, Japan, in 2004, an MS degree in engineering from the University of Electro-Communications, Tokyo, in 2006, and a PhD degree in engineering from the Tokyo Institute of Technology, in 2018. He joined NHK in 2006. Since 2009, he has been engaged in research on multiviewpoint robotic cameras and their applications with the NHK STRL.
Naoto Okaichi
bio
Naoto Okaichi received an MS degree in complexity science and engineering from the University of Tokyo, Tokyo, Japan in 2008. He is currently pursuing a PhD degree in interdisciplinary information studies with the University of Tokyo. He joined NHK in 2008. Since 2012, he has been with the NHK Science & Technology Research Laboratories, where he has been engaged in research on three-dimensional display systems.
Masanori Kano
bio
Masanori Kano received BS and MS degrees from Sophia University, Tokyo, Japan, in 2007 and 2009, respectively. He joined NHK in 2009, and he has been working with the Science & Technology Research Laboratories since 2013. His research interests include camera calibration, 3D image processing, and 3D display.
Takuya Omura
bio
Takuya Omura received BE and ME degrees in mechanical engineering from Keio University, Tokyo, Japan, in 2016 and 2018, respectively. In 2018, he joined NHK. Since 2018, he has been engaged in research on threedimensional display systems with the NHK STRL.
Kensuke Hisatomi
bio
Kensuke Hisatomi received BE and ME degrees in applied physics from Waseda University, Shinjuku, Japan, in 1997 and 1999, respectively, and a PhD degree in information science and technology from the University of Tokyo, Japan, in 2016. He joined NHK in 1999. From 2003 to 2007, he worked in the Engineering Administration Department, where he was involved in the development of digital broadcasting. He has been with NHK STRL, since 2007. He was a visiting researcher with Surrey University, Guildford, U.K., from 2010 to 2011. His current research interests include augmented reality and virtual reality.
Masahiro Kawakita
bio
Masahiro Kawakita received BS and MS degrees in physics from Kyushu University, Fukuoka, Japan, in 1988 and 1990, respectively, and a PhD degree in electronic engineering from the University of Tokyo, Japan, in 2005. He joined NHK in 1990. Since 1993, he has been with the NHK STRL, where he has been researching applications of liquid-crystal devices and optically addressed spatial modulators, three-dimensional TV cameras, and display systems.
Tomoyuki Mishina
bio
Tomoyuki Mishina received BS and MS degrees from the Tokyo University of Science, Tokyo, Japan, in 1987 and 1989, respectively, and a PhD degree from the Tokyo Institute of Technology, Tokyo, in 2007. He joined NHK in 1989. Since 1992, he has been working on three-dimensional imaging systems with the NHK STRL.
Keyword(s): 3D Broadcasting Service, 3D Capture Technology, 3D Display Technology, Spatial Imaging, Multi-camera, Integral 3D Display, High-definition 3D Video
Copyright: © 2020 SMPTE

Bibliographic Reference(s)

H. Watanabe, “Aktina Vision: Full-Parallax Three-Dimensional Display with 100 Million Light Rays,” Sci. Rep., 9, 2019, Art. no. 17688, doi: 10.1038/s41598-019-54243-6. 13.T.Omuraetal.,“Full-Parallax3DDisplayUsingTime-Multiplexing Projection Technology,” Proc. IS&T Electron. Imag., pp. 100-1–100-5, 2020, doi: 10.2352/ISSN.2470-1173.2020.2.SDA-100. EXTERNAL
K. Ikeya et al., “Capturing Method for Integral Three-Dimensional Imaging Using Multiviewpoint Robotic Cameras,” J. Electron. Imaging, 27(2):023022-1–023022-13, Apr. 2018, doi: 10.1117/1.JEI.27.2.023022. EXTERNAL
F. Okano et al., “Real-Time Pickup Method for a Three-Dimensional Image Based on Integral Photography,” Appl. Opt., 36(7):1598–1603, 1997, doi: 10.1364/AO.36.001598. EXTERNAL
G. Lippmann, “Epreuves Reversible. Photographies Integrals,” C.-R. Acad. Sci., 146:446–451, 1908. EXTERNAL
F. Okano et al., “Real-Time Integral Imaging Based on Extremely High Resolution Video System,” Proc. IEEE, 94(3):490–501, Mar. 2006, doi: 10.1109/JPROC.2006.870687. EXTERNAL
H. Sasaki et al., “Color Moiré Reduction and Resolution Enhancement of Flat-Panel Integral Three-Dimensional Display,” Opt. Exp., 27(6):8488–8503, 2019. doi: 10.1364/OE.27.008488. EXTERNAL
H. Sasaki et al., “Color Moiré Reduction Method for Thin Integral 3D Displays,” Proc. IEEE VR, pp. 1144–1145, 2019, doi: 10.1109/VR.2019.8798364. EXTERNAL
N. Okaichi et al., “High-Quality Direct-View Display Combining Multiple Integral 3D Images,” J. Soc. Inf. Display, 27:41–52, Nov. 2018, doi: 10.1002/jsid.741. EXTERNAL
J. Arai et al., “Integral Imaging System With 33 Mega-Pixel Imaging Devices Using the Pixel-Offset Method,” Proc. SPIE Opt. Des. Eng. IV, 8167, 2011, doi: 10.1117/12.896753. EXTERNAL
N. Okaichi et al., “Integral 3D Display Using Multiple LCD Panels and Multi-Image Combining Optical System,” Opt. Exp., 25(3):2805–2817, 2017, doi: 10.1364/OE.25.002805. EXTERNAL
H. Sasaki et al., “Color Moire Reduction and Resolution Enhancement Technique for Integral Three-Dimensional Display,” Proc. 3DTV-CON, 2017, doi: 10.1109/3DTV.2017.8280402. EXTERNAL
M. Kano et al., “3D Imaging with 330,000 Pixels Using Camera Array,” ITE Winter Annu. Convention, 23D-1, 2018 (in Japanese). EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2020.3010391.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Hayato Watanabe, Hisayuki Sasaki, Kensuke Ikeya, Naoto Okaichi, Masanori Kano, Takuya Omura, Kensuke Hisatomi, Masahiro Kawakita, and Tomoyuki Mishina; 3D Video Technology Based on Spatial Imaging for Advanced Broadcasting, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3010391

Snippet:

Hayato Watanabe, Hisayuki Sasaki, Kensuke Ikeya, Naoto Okaichi, Masanori Kano, Takuya Omura, Kensuke Hisatomi, Masahiro Kawakita, and Tomoyuki Mishina; 3D Video Technology Based on Spatial Imaging for Advanced Broadcasting, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020. Available at https://doi.org/10.5594/JMI.2020.3010391

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Hayato Watanabe, Hisayuki Sasaki, Kensuke Ikeya, Naoto Okaichi, Masanori Kano, Takuya Omura, Kensuke Hisatomi, Masahiro Kawakita, and Tomoyuki Mishina; <cite>3D Video Technology Based on Spatial Imaging for Advanced Broadcasting</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020. Available at <a href="https://doi.org/10.5594/JMI.2020.3010391" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2020.3010391</a></span>

SMPTE's HTML Pub

Preview:

Hayato Watanabe, Hisayuki Sasaki, Kensuke Ikeya, Naoto Okaichi, Masanori Kano, Takuya Omura, Kensuke Hisatomi, Masahiro Kawakita, and Tomoyuki Mishina; 3D Video Technology Based on Spatial Imaging for Advanced Broadcasting, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020
doi: 10.5594/JMI.2020.3010391
url: https://doi.org/10.5594/JMI.2020.3010391

Snippet:

<li>
Hayato Watanabe, Hisayuki Sasaki, Kensuke Ikeya, Naoto Okaichi, Masanori Kano, Takuya Omura, Kensuke Hisatomi, Masahiro Kawakita, and Tomoyuki Mishina; <cite id="bib-10-5594-jmi-2020-3010391">3D Video Technology Based on Spatial Imaging for Advanced Broadcasting</cite>, SMPTE Motion Imaging Journal ( Volume: 129, Issue: 9, October 2020); SMPTE, 2020
<span class="doi">10.5594/JMI.2020.3010391</span>
</li>