Realtime Camera Tracking in the MATRIS Project

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 116, No. 7-8, pp. 266–271
Abstract: In order to insert a virtual object into a television image, the graphics system needs to know precisely how the camera is moving, so that the virtual object can be rendered in the correct place in every frame. Today, this can be achieved relatively easily in post-production, or in a studio equipped with a special tracking system. However, for live shooting on location, or in a studio that is not specially equipped, installing such a system can be difficult or uneconomic. The use of effects such as “on-pitch” sports graphics tend to be restricted to major events, and the generation of virtual graphics on other location shoots (either for live use or for pre-visualization) is rarely attempted. To overcome these limitations, the MATRIS project is developing a realtime system for measuring the movement of a camera. The system uses image analysis to track naturally occurring features in a scene and data from an inertial sensor. No additional sensors, special markers, or camera mounts are required. This paper gives an overview of the system and presents some results.
Publication Date: 2007-07-01
DOI: 10.5594/J11426
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/J11426
Author(s): J. ChandariaBBC Research, U.K.
G. ThomasBBC Research, U.K.
B. BartczakChristian-Albrechts-University Kiel, Germany
K. KoeserChristian-Albrechts-University Kiel, Germany
R. KochChristian-Albrechts-University Kiel, Germany
M. BeckerFraunhofer IGD, Germany
G. BleserFraunhofer IGD, Germany
D. StrickerFraunhofer IGD, Germany
C. WohlleberFraunhofer IGD, Germany
M. FelsbergLinköping University, Sweden
F. GustafssonLinköping University, Sweden
J. D. HolLinköping University, Sweden
T. B. SchonLinköping University, Sweden
J. SkoglundLinköping University, Sweden
P. J. SlyckeXsens, Netherlands
S. SmeitzXsens, Netherlands
Copyright: © 2007 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. www.ist-MATRIS.org/ . EXTERNAL
10. Skoglund J. Felsberg M. “Evaluation of Subpixel Tracking Algorithms,” Proc. of Intl. Symp. of Vis. Comp. (ISVC2006) pp. 374 – 382 2006 . EXTERNAL
11. Skoglund J. Felsberg M. “Covariance Estimation of SAD Matching,” Proc. SCIA 2007, Aalborg , Denmark , 2007 . EXTERNAL
12. Thomas G. A. “Real-Time Camera Pose Estimation for Augmenting Sports Scenes,” Conf. on Visual Media Prod. (CVMP), London, Nov. 2006 . EXTERNAL
13. Hoi J. D. Schön T. B. Gustafsson F. Slycke P. J. , “Sensor Fusion for Augmented Reality,” The 9th International Conference on Information Fusion, Florence, Italy, 2006 . EXTERNAL
14. www.bbc.co.uk/rd/projects/virtual/piero/index.shtml . EXTERNAL
2. Thomas G. A. , “A Versatile Camera Position Measurement System for Virtual Reality TV Production,” Proc. IBC ‘97, pp. 284 – 289 1997 , www.bbc.co.uk/rd/pubs/papers/paper_05/paper_05.html . EXTERNAL
3. Brothers Warner , “Special Visual Effects , A. I. Artificial Intelligence Bonus Disc, DVD , 2002 . EXTERNAL
4. Koeser K. Bartczak B. Koch R. “Drift-free Pose Estimation with Hemispherical Cameras,” Conf. on Visual Media Prod. (CVMP), London, November, 29–30 2006 . EXTERNAL
5. Streckel B. Koch R. , “Lens Model Selection for Visual Tracking.” Proc. DAGM. Symposium ‘05, LNCS 3663, Springer , 2005 . EXTERNAL
6. Koch R. Pollefeys M. van Gool L. , “Multi Viewpoint Stereo from Uncalibrated Video Sequences,” Proc. ECCV'98prime;98 , LNCS 1406, Springer , 1998 . EXTERNAL
7. Lowe D. G. , “Distinctive Image Features from Scale-Invariant Keypoints,” Intl. J. Comp. Vision 60 ( 2 ): 91 – 110 , Jan. 2004 . EXTERNAL
8. Fischler M. A. Bolles R. C. , “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. of the ACM , 24 ( 6 ): 381 – 395 , June 1981 . EXTERNAL
9. Skoglund J. Felsberg M. , “Fast Image Processing using SSE2.” Proc. SSBA Symposium on Image Analysis, March 2005 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J11426.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

J. Chandaria, G. Thomas, B. Bartczak, K. Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, F. Gustafsson, J. D. Hol, T. B. Schon, J. Skoglund, P. J. Slycke, and S. Smeitz; Realtime Camera Tracking in the MATRIS Project, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 7-8, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11426

Snippet:

J. Chandaria, G. Thomas, B. Bartczak, K. Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, F. Gustafsson, J. D. Hol, T. B. Schon, J. Skoglund, P. J. Slycke, and S. Smeitz; Realtime Camera Tracking in the MATRIS Project, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 7-8, 2007); SMPTE, 2007. Available at https://doi.org/10.5594/J11426

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">J. Chandaria, G. Thomas, B. Bartczak, K. Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, F. Gustafsson, J. D. Hol, T. B. Schon, J. Skoglund, P. J. Slycke, and S. Smeitz; <cite>Realtime Camera Tracking in the MATRIS Project</cite>, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 7-8, 2007); SMPTE, 2007. Available at <a href="https://doi.org/10.5594/J11426" target="_blank" rel="noopener">https://doi.org/10.5594/J11426</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
J. Chandaria, G. Thomas, B. Bartczak, K. Koeser, R. Koch, M. Becker, G. Bleser, D. Stricker, C. Wohlleber, M. Felsberg, F. Gustafsson, J. D. Hol, T. B. Schon, J. Skoglund, P. J. Slycke, and S. Smeitz; <cite id="bib-10-5594-j11426">Realtime Camera Tracking in the MATRIS Project</cite>, SMPTE Motion Imaging Journal ( Volume: 116, Issue: 7-8, 2007); SMPTE, 2007
<span class="doi">10.5594/J11426</span>
</li>