A Method of Video Production Using Dynamic 3D Models and Its Application to Making Scenes of a Crowd

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 118, No. 7, pp. 29–36
Abstract: This paper describes a method of producing scenes for TV programs, using “dynamic 3D human models.” Dynamic 3D human models are 3D models generated from images shot by multiple cameras surrounding an actor for each frame using 3D-reconstruction and texture-mapping techniques. They can provide highly realistic images as well as natural motions without having to use a motion-capture system. In addition, they allow production to be more flexible, enabling the positions of models to be changed or multiplying the amount used. Dynamic 3D human models are therefore suitable for producing crowd scenes. Although techniques of 3D reconstruction and texture mapping have been discussed and several applications have been proposed, they have not been widely introduced into TV or movie production, because of the huge amounts of data and insufficient textural quality. By establishing an efficient production flow with recent powerful computers and 24 HD cameras, the authors succeeded in producing crowd scenes with sufficient quality for a TV program, which will be aired in December 2009. The scenes involving 1,000 soldiers can be produced by shooting several sequences with two actors. The production flow that was established is described as well as scenes that were produced using dynamic 3D human models for a drama.
Publication Date: 2009-10-01
DOI: 10.5594/J15983
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/J15983
Author(s): Kensuke HisatomiScience and Technical Research Laboratories of NHK (Japan Broadcasting Corp.).
bio
Kensuke Hisatomi currently works in the Science and Technical Research Laboratories of NHK (Japan Broadcasting Corp.). He joined NHK in 1999. From 2003 to 2007, he worked in the Engineering Administration Department of NHK where he was involved in development of digital broadcasting in Japan. He has been in the Science and Technical Research Laboratories since 2007. His research interests include three-dimensional reconstruction and three-dimensional video processing for broadcasting. Hisatomi received B.E. and M.E. degrees in applied physics from Waseda University in 1997 and 1999, respectively.
Kimihiro TomiyamaTokyo Institute of Technology
bio
Kimihiro Tomiyama joined NHK in 1998 after receiving B.E. and M.E. degrees from the Tokyo Institute of Technology. He has been with NHK Science & Technical Research Laboratories since 2001, and has researched 3D video coding for broadcasting.
Miwa KatayamaAdvanced Television systems department of the Science & Technology Research Laboratories of NHK
bio
Miwa Katayama is a principal research engineer in the advanced television systems department of the Science & Technology Research Laboratories of NHK. Her research interests include three-dimensional video systems, image coding, and video applications. Katayama is a member of the Institute of Electrical and Electronics Engineers (IEEE). She received a B.S. degree from Sophia University in 1990, and M.S. and Ph.D. degrees from Tokyo University in 1992 and 1995, respectively.
Yuichi IwadateNHK Science and Technical Research Laboratories
bio
Yuichi Iwadate is a senior research engineer in the NHK Science and Technical Research Laboratories. He received a B.E. degree and a Dr. Eng. degree from Doshisha University, Kyoto, Japan, in 1981 and 1993, respectively. He has been involved in research on HDTV systems, digital transmission systems, and 3D image processing. Currently he is interested in a scene reconstruction method using multiple camera system.
Koji MatsunagaNational College of Technology
bio
Koji Matsunaga is a computer graphics supervisor of the drama “sakano-ueno-kumo,” which includes scenes produced by the method described in the paper. He joined NHK in 1990 after graduating Yamaguchi Ube National College of Technology. From 1990 to 1997, he worked as a cameraman at NHK Tottori Broadcasting Station. Matsunaga worked at Tokyo Broadcasting Center of NHK since 1997 as a computer-graphic engineer and a supervisor of video effects, where he is engaged in the visual effects of science programs and dramas.
Yoshiyuki ItoProduction and development of computer graphics in the broadcast engineering department of NHK.
bio
Yoshiyuki Ito is currently engaged in the production and development of computer graphics in the broadcast engineering department of NHK. He joined NHK in 2001. From 2001 to 2005, he was a production engineer at NHK Fukui Station. Ito received B.E. and M.E. degrees in information electronics from Nagoya University.
Wataru IshiharaBroadcast Engineering Department of NHK.
bio
Wataru Ishihara is a computer graphics engineer in the broadcast engineering department of NHK. He joined NHK after receiving B.E. degree from Waseda University in 2001. He currently works on computer graphics for broadcasting programs and he is also engaged in the development of the simulation software of the crowd scene.
Copyright: © 2009 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Hisatomi K. Tomiyama K. Katayama M. Iwadate Y. , “3D Reconstruction using Graph Cut with View-Dependent Polygon Texture Blending,” 5th European Conference on Visual Media Production (CVMP) , London, 2008 . EXTERNAL
2. Seitz S.M. Dyer C.R. , “Photorealistic Scene Reconstruction by Voxel Coloring,” Int. J. of Comp. Vis. , 35 ( 2 ): 1 – 23 , 1999 . EXTERNAL
3. Strack J. Hilton A. , “Model-Based Multiple View Reconstruction of People,” Proc. of IEEE Int. Workshop on Comp. Vis. 915 – 922 , 2003 . EXTERNAL
4. http://r24085.ovh.net/ . EXTERNAL
5. Tsai R. , “An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision,” Proc. of IEEE Conf. on Comp. Vis. and Pattern Recognition , 364 – 374 , 1986 . EXTERNAL
6. Kennmochi Y. Kotani K. Imiya A. , “Marching Cubes Method with Connectivity , Proc. of ICIP , 4 : 361 – 365 , 1999 . EXTERNAL
7. Autodeck Maya, http://usa.autodesk.com/ . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J15983.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Kensuke Hisatomi, Kimihiro Tomiyama, Miwa Katayama, Yuichi Iwadate, Koji Matsunaga, Yoshiyuki Ito, and Wataru Ishihara; A Method of Video Production Using Dynamic 3D Models and Its Application to Making Scenes of a Crowd, SMPTE Motion Imaging Journal ( Volume: 118, Issue: 7, October 2009); SMPTE, 2009. Available at https://doi.org/10.5594/J15983

Snippet:

Kensuke Hisatomi, Kimihiro Tomiyama, Miwa Katayama, Yuichi Iwadate, Koji Matsunaga, Yoshiyuki Ito, and Wataru Ishihara; A Method of Video Production Using Dynamic 3D Models and Its Application to Making Scenes of a Crowd, SMPTE Motion Imaging Journal ( Volume: 118, Issue: 7, October 2009); SMPTE, 2009. Available at https://doi.org/10.5594/J15983

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Kensuke Hisatomi, Kimihiro Tomiyama, Miwa Katayama, Yuichi Iwadate, Koji Matsunaga, Yoshiyuki Ito, and Wataru Ishihara; <cite>A Method of Video Production Using Dynamic 3D Models and Its Application to Making Scenes of a Crowd</cite>, SMPTE Motion Imaging Journal ( Volume: 118, Issue: 7, October 2009); SMPTE, 2009. Available at <a href="https://doi.org/10.5594/J15983" target="_blank" rel="noopener">https://doi.org/10.5594/J15983</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Kensuke Hisatomi, Kimihiro Tomiyama, Miwa Katayama, Yuichi Iwadate, Koji Matsunaga, Yoshiyuki Ito, and Wataru Ishihara; <cite id="bib-10-5594-j15983">A Method of Video Production Using Dynamic 3D Models and Its Application to Making Scenes of a Crowd</cite>, SMPTE Motion Imaging Journal ( Volume: 118, Issue: 7, October 2009); SMPTE, 2009
<span class="doi">10.5594/J15983</span>
</li>