A Free-Viewpoint Video System for Visualization of Sport Scenes

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 116, No. 5-6, pp. 213–219
Abstract: This paper introduces a new approach to using multicamera images of an event to provide a free-viewpoint video visualization of sport scenes. This allows a virtual camera to be moved freely around, and to view the action from any angle. The system is based on 3-D reconstruction techniques previously developed for studio use. A number of different 3-D representations, including billboards, visual hulls, and view-dependent geometry are evaluated for the purpose. First results show the potential of the new approach for action replay and strategy analysis of sport scenes. Current limitations of the 3-D representations are discussed in the context of a practical use of the system.
Publication Date: 2007-05-01
DOI: 10.5594/J11445
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/J11445
Author(s): Oliver Grau
bio
Oliver Grau received a MS and a PhD degree from the University of Hanover, Germany. From 1991–2000 he worked as a research scientist at the University of Hanover. In 2000 he joined the R&D department of the BBC. He worked on a number of national and international projects, including ACTS-Panorama, Link-Prometheus, IST-MetaVision, and IST-Origami and is currently leading the DTI-iview project on 3-D visualization of sport scenes. Grau's research interests are in new innovative tools for visual media production using image processing, computer vision, and computer graphic techniques. He has published a number of research papers and patents on this topic.
Adrian HiltonComputer Vision and Graphics at the University of Surrey, UK.
bio
Adrian Hilton (BSc (hons), DPhil, CEng) is a professor of computer vision and graphics at the University of Surrey, UK. His research interest is robust computer vision to model and understand real-world scenes for entertainment and communication. Hilton's contributions include the first hand-held 3-D scanner and automatic modeling of people. He is an area editor of Computer Vision and Image Understanding (CVIU) and a member of IEE, IEEE, and ACM (a.hilton@surrey.ac.uk).
Joe Kilner
bio
Joe Kilner received a BA in natural and computer sciences from Cambridge University in 1999. He has worked as a software engineer in various roles, both in business software development and the games industry, where he developed both tools and run-time code for Sony and Electronic Arts. He is currently involved in computer vision research at the University of Surrey where he is studying for a PhD.
Gregor Miller
bio
Gregor Miller received a first-class honors in computer science and mathematics from the University of Edinburgh in 2003. Since then, he has been working at the University of Surrey as a PhD researcher on computer vision and graphics, specializing in 3-D scene visualization.
Tim Sargeant
bio
Tim Sargeant joined the BBC after graduating from the University of York, UK, in 1998 with a master's degree in electronic engineering with music technology systems. He has been involved with research and development for broadcast, including interactive applications and metadata delivery standards. More recently, he has been involved in the development and deployment of optical tracking and technologies to aide the insertion of computer graphics into television production environments. In his current role, he provides leadership and analysis of technology needs and systems difficulties to various BBC departments.
Jonathan StarckMultiple-View Scene Analysis and Studio-based 3-D Content Production at Surrey University, UK.
bio
Jonathan Starck is a senior research fellow in multiple-view scene analysis and studio-based 3-D content production at Surrey University, UK. He studied engineering at Cambridge University, and graduated with double-starred first honors. He also received the BMVA Sullivan thesis award for his PhD at Surrey University. Starck's research interests include image-based modeling for computer graphics and animation.
Copyright: © 2007 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. The iview project, http://www.bbc.co.uk/rd/projects/iview . EXTERNAL
2. The Piero Project, http://www.bbc.co.uk/rd/projects/virtual/piero/index.shtml . EXTERNAL
3. Grau O. Price M. Thomas G. A. , “Use of 3-D Techniques for Virtual Production,” Proc. SPIE Conf. Videometrics and Optical Methods for 3D Shape Measurement ′01, pp. 40 – 50 2001 . EXTERNAL
4. Grau O. Prior-Jones M. Thomas G. A. , “3D Modeling and Rendering of Studio and Sport Scenes for TV Applications,” WIAMIS 2005 , Montreaux, Switzerland, Apr. 2005. EXTERNAL
5. Buehler C. Bosse M. McMillan L. Gortler S. Cohen M. , “Unstructured Lumigraph Rendering,” Proc. ACM Siggraph ′01 , pp. 425 – 432 2001 . EXTERNAL
6. Slabaugh G. Culbertson B. Malzbender T. Schafer R. , “A Survey of Methods for Volumetric Scene Reconstruction from Photographs,” Proc. of Intl. Workshop on Vol. Graphics ′01 , pp. 81 – 100 2001 . EXTERNAL
7. Shum H.-Y. Kang S. B. Chan S.-C. , “Survey of Image-based Representations and Compression Techniques,” IEEE Trans. on Circuits and Systems for Video Tech. , 13 ( 11 ): 1020 – 1037 , Nov. 2003 . EXTERNAL
8. Kutulakos K. Seitz S. A , “Theory of Shape by Space Carving,” Intl. J. Computer Vision , 38 ( 3 ): 199 – 218 , July 2000 . EXTERNAL
9. Starck J. Hilton A. , “Model-based Multiple View Reconstruction of People,” IEEE Intl. Conf. on Computer Vision, pp. 915 – 922 , Oct. 2003 . EXTERNAL
10. Starck J. Hilton A. , “Virtual View Synthesis of People from Multiple View Video,” Graphical Models , 67 ( 6 ): 600 – 620 , 2005 . EXTERNAL
11. Miller G. Hilton A. Starck J. , “Interactive Free-Viewpoint Video,” Proc. 2nd Conf. on Visual Media Production (CVMP 2005), London, pp. 50 – 59 2005 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J11445.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Oliver Grau, Adrian Hilton, Joe Kilner, Gregor Miller, Tim Sargeant, and Jonathan Starck; A Free-Viewpoint Video System for Visualization of Sport Scenes, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11445

Snippet:

Oliver Grau, Adrian Hilton, Joe Kilner, Gregor Miller, Tim Sargeant, and Jonathan Starck; A Free-Viewpoint Video System for Visualization of Sport Scenes, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11445

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Oliver Grau, Adrian Hilton, Joe Kilner, Gregor Miller, Tim Sargeant, and Jonathan Starck; <cite>A Free-Viewpoint Video System for Visualization of Sport Scenes</cite>, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007. Available at <a href="https://doi.org/10.5594/J11445" target="_blank" rel="noopener">https://doi.org/10.5594/J11445</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Oliver Grau, Adrian Hilton, Joe Kilner, Gregor Miller, Tim Sargeant, and Jonathan Starck; <cite id="bib-10-5594-j11445">A Free-Viewpoint Video System for Visualization of Sport Scenes</cite>, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 5-6, 2007); SMPTE, 2007
<span class="doi">10.5594/J11445</span>
</li>