Automating Metadata Logging Through Artificial Intelligence

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 128, No. 9, pp. 34–39
Abstract: In 2007, NASCAR designed and implemented a media asset management solution for their sport. Now, in 2018, the library has grown to more than 500,000 hr of content containing video, audio, and still images dating back to 1933—one of the most vast sports libraries in the world. Since the inception of the library, NASCAR has employed a staff to manually apply metadata to each video frame, amassing 10 million entries. While the logging by our staff has been impressive, the incoming data avalanche cannot be addressed by using the current system, let alone the glacier of data hiding in the archive. At present, we have calculated that it would take our existing staff nearly 150 years to log all of the historical content as it stands today. Over the past ten years, we have extensively analyzed open-source and proprietary tools aimed at dealing with the data logging gap and have determined that machine learning is the ideal solution to address metadata logging on large-scale media libraries. As machine learning has become more accessible through the scalability of cloud computing, training data, and implementing convolutional neural networks, it is now within the reach of media production companies and asset stakeholders. NASCAR is on the verge of revolutionizing how all data asset management systems can be restructured in the future to integrate machine learning to harness efficiencies in metadata logging.
Publication Date: 2019-10-01
DOI: 10.5594/JMI.2019.2932163
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2019.2932163
Author(s): Christopher Witmayer
Keyword(s): Artificial Intelligence, CNN, Machine Learning, Metadata Tagging, Tensorflow, Transfer Learning, Video Logging
Copyright: © 2019 SMPTE

Bibliographic Reference(s)

J. McCarthy, M. L. Minsky, N. Rochester, and C. E. Shannon, “A Proposal for the Dartmouth Summer Research Project on Artificial Intelligence,” Aug. 1955. [Online]. Available: http://www-formal.stanford.edu/jmc/history/dartmouth/dartmouth.html EXTERNAL
S. Herculano-Houzel, “The Human Brain in Number: A Linearly Scaled-Up Primate Brain,” Front. Hum. Neurosci., vol. 3, p. 1, Nov. 2009. [Online]. Available: https://ncbi.nlm.nih.gov/pmc/articles/PMC2776484 EXTERNAL
A. L. Samuel, “Some Studies in Machine Learning Using The Game of Checkers,” IBM J. Res. Develop., 44:206–226, 1959. EXTERNAL
D. H. Hubel and T. N. Wiesel, “Receptive Fields, Binocular Interaction and Functional Architecture in the Cat’s Visual Cortex,” The Physiological Society, Jan. 1962. EXTERNAL
Tzutalin, “Github Repository—LabelImg,” 2015. [Online]. Available: https://github.com/tzutalin/labelImg EXTERNAL
O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, A. Berg, and F. Li, “ImageNet Large Scale Visual Recognition Challenge,” Int. J. Comput. Vis., 115(3):211–252, Dec. 2015. EXTERNAL
C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna, “Rethinking the Inception Architecture for Computer Vision,” Dec. 2015. [Online]. Available: https://arxiv.org/abs/1512.00567 EXTERNAL
Google, “Tensorflow GitHub.” [Online]. Available: https://github.com/tensorflow/tensorflow EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2019.2932163.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Christopher Witmayer; Automating Metadata Logging Through Artificial Intelligence, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 9, October 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2019.2932163

Snippet:

Christopher Witmayer; Automating Metadata Logging Through Artificial Intelligence, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 9, October 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2019.2932163

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Christopher Witmayer; <cite>Automating Metadata Logging Through Artificial Intelligence</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 9, October 2019); SMPTE, 2019. Available at <a href="https://doi.org/10.5594/JMI.2019.2932163" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2019.2932163</a></span>

SMPTE's HTML Pub

Preview:

Christopher Witmayer; Automating Metadata Logging Through Artificial Intelligence, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 9, October 2019); SMPTE, 2019
doi: 10.5594/JMI.2019.2932163
url: https://doi.org/10.5594/JMI.2019.2932163

Snippet:

<li>
Christopher Witmayer; <cite id="bib-10-5594-jmi-2019-2932163">Automating Metadata Logging Through Artificial Intelligence</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 9, October 2019); SMPTE, 2019
<span class="doi">10.5594/JMI.2019.2932163</span>
</li>