Automated Video Indexing of Very Large Video Libraries

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE J
Volume: 106, No. 8, pp. 524–529
Abstract: The Informedia Digital Video Library project is implementing full content search and retrieval from digital video, audio, and text libraries through the utilization of integrated speech, image, and language understanding technologies for automated creation and exploration. Image processing analyzes scenes, speech processing transcribes the audio signal, and natural language processing determines word relevance. Together, these generate a meaningful index into the video content. Segment breaks produced by image processing are examined, along with the boundaries identified by the natural language processing of the transcript to partition the video library into sets of segments, or “video paragraphs.” Automating these techniques into a unified collaborative system uniquely enables us to include and search through vast amounts of video data in the library with little to no human intervention.
Publication Date: 1997-08-01
DOI: 10.5594/J04554
ISSN: Print: 0036-1682
Link: https://doi.org/10.5594/J04554
Author(s): H. D. WactlarCarnegie Mellon University, Pittsburgh, PA 15213
A. G. HauptmannCarnegie Mellon University, Pittsburgh, PA 15213
M. A. SmithCarnegie Mellon University, Pittsburgh, PA 15213
K. V. PendyalaCarnegie Mellon University, Pittsburgh, PA 15213
D. GarlingtonISLIP Media Network, Inc., Pittsburgh, PA 15213.
Copyright: © 1997 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Christel M. Stevens S. Wactlar H. , “Informedia Digital Video Library,” Proc. of Second ACM International Conf. on Multimedia, Video Program, New York : ACM , pp. 480 – 481 , Oct. 1994 . EXTERNAL
10. Rudnicky A. , “Language Modeling with Limited Domain Data,” Proc. of the 1995 ARPA Workshop on Spoken Language Technology , in press. EXTERNAL
11. Smith M. Kanade T. , “Video Skimming for Quick Browsing Based on Audio and Image Characterization,” Carnegie Mellon University technical report CMU-CS-95–186, July 1995 . EXTERNAL
2. Stevens S. Christel M. Wactlar H. , “Informedia: Improving Access to Digital Video,” Interactions 1 , pp. 67 – 71 , Oct. 1994 . EXTERNAL
3. Christel M. Kanade T. Mauldin M. ., “Informedia Digital Video Library,” Comnum. of the ACM , 38 : 51 – 58 , Apr. 1994 . EXTERNAL
4. Wactlar H. D. Kanade T. Smith M. A. Stevens S. M. , “Intelligent Access to Digital Video: Informedia Project,” IEEE Computer , 29 : 46 – 52 , May 1996 . EXTERNAL
5. Hauptmann A. G. Smith M. , “Text, Speech, and Vision for Video Segmentation: The Informedia Project,” AAAI Fall 1995 Symposium on Computational Models for Integrating Language and Vision, pp. 90 – 95 , MIT , Cambridge, Mass. , Nov. 1995 . EXTERNAL
6. Mauldin M. , “Information Retrieval by Text Skimming,” Ph.D. Thesis, Carnegie Mellon University , Aug. 1989 . Rev. edition published as Conceptual Information Retrieval: A Case Study in Adaptive Partial Parsing, Kluwer Press, Sept. 1991. EXTERNAL
7. Salton G. McGill M. J. , Introduction to Modern Information Retrieval , McGraw-Hill , New York , 1983 . EXTERNAL
8. Zhang H. Low C. Smoliar S. , “Video Parsing and Indexing of Compressed Data,” Multimedia Tools and Applications , 1 : 89 – 111 , Mar. 1995 . EXTERNAL
9. Hwang M. Rosenfeld R. Thayer E. ., “Improving Speech Recognition Performance via Phone-Dependent VQ Code-books and Adaptive Language Models in SPHINX-II,” ICASSP-94 , vol. I , pp. 549 – 552 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-J04554.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; Automated Video Indexing of Very Large Video Libraries, SMPTE Journal ( Volume: 106, Issue: 8, August 1997); SMPTE, 1997. Available at https://doi.org/10.5594/J04554

Snippet:

H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; Automated Video Indexing of Very Large Video Libraries, SMPTE Journal ( Volume: 106, Issue: 8, August 1997); SMPTE, 1997. Available at https://doi.org/10.5594/J04554

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; <cite>Automated Video Indexing of Very Large Video Libraries</cite>, SMPTE Journal ( Volume: 106, Issue: 8, August 1997); SMPTE, 1997. Available at <a href="https://doi.org/10.5594/J04554" target="_blank" rel="noopener">https://doi.org/10.5594/J04554</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; <cite id="bib-10-5594-j04554">Automated Video Indexing of Very Large Video Libraries</cite>, SMPTE Journal ( Volume: 106, Issue: 8, August 1997); SMPTE, 1997
<span class="doi">10.5594/J04554</span>
</li>