Automated Video Indexing for On-Demand Retrieval from Very Large Video Libraries

Metadata

Publisher: SMPTE — White Plains, NY
Doc Type: Conference Paper
Content Type: Original Research
Volume: 1996, No. 15, pp. 1–9
Abstract: The Informedia Digital Video Library project is implementing full content search and retrieval from digital video, audio and text libraries. This is accomplished through the utilization of integrated speech, image and language understanding technologies for their automated creation and exploration. Image processing analyzes scenes, speech processing transcribes the audio signal, and natural language processing determines word relevance. Together, these generate a meaningful index into the video content. Segment breaks produced by image processing are examined along with the boundaries identified by the natural language processing of the transcript to partition the video library into sets of segments, or “video paragraphs”. Automating these techniques into a unified collaborative system enables us to include and search through vast amounts of video data in the library.
Publication Date: 1996-10-01
DOI: 10.5594/M00103
Link: https://doi.org/10.5594/M00103
Author(s): H. D. WactlarCarnegie Mellon University, Pittsburgh, PA
A. G. HauptmannCarnegie Mellon University, Pittsburgh, PA
M. A. SmithCarnegie Mellon University, Pittsburgh, PA
K. V. PendyalaCarnegie Mellon University, Pittsburgh, PA
D. GarlingtonISLIP Networked Information Technologies, Pittsburgh, PA
Copyright: © 1996 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Christel M. Stevens S. Wactlar H . “Informedia Digital Video Library,” Proceedings of the Second ACM International Conference on Multimedia, Video Program. New York : ACM , October, 1994 , pp. 480 – 481 . EXTERNAL
10. Rudnicky A. , “Language Modeling with Limited Domain Data,” Proceeding of the 1995 ARPA Workshop on Spoken Language Technology, in press. EXTERNAL
11. Smith M. Kanade T. , “Video Skimming for Quick Browsing Based on Audio and Image Characterization,” Carnegie Mellon University technical report CMU-CS-95-186, July 1995. Also submitted to PAMI Journal ( Pattern Analysis and Machine Intelligence ), 1995 . EXTERNAL
2. Stevens S. Christel M. Wactlar H . “Informedia: Improving Access to Digital Video” . Interactions 1 (October 1994 ), pp. 67 – 71 . EXTERNAL
3. Christel M. Kanade T. Mauldin M. Reddy R. Sirbu M. Stevens S. Wactlar H. , “Informedia Digital Video Library” , Communications of the ACM” , 38 ( 4 ), April 1994 , pp. 57 – 58 . EXTERNAL
4. Wactlar H. D. Kanade T. Smith M. A. Stevens S. M . “Intelligent Access to Digital Video: Informedia Project,” IEEE Computer , 29 ( 5 ), May 1996 , pp. 46 – 52 . EXTERNAL
5. Hauptmann A. G. Smith M. , “Text, Speech, and Vision for Video Segmentation: The Informedia Project,” AAAI Fall 1995 Symposium on Computational Models for Integrating Language and Vision, Cambridge, MA : MIT , November 1995 , pp. 90 – 95 . EXTERNAL
6. Mauldin M . “Information Retrieval by Text Skimming,” Ph.D. Thesis, Carnegie Mellon University. August 1989. Revised edition published as “Conceptual Information Retrieval: A Case Study in Adaptive Partial Parsing, Kluwer Press , September 1991 . EXTERNAL
7. Salton G. McGill M. J . “Introduction to Modern Information Retrieval,” McGraw-Hill , New York , McGraw-Hill Computer Science Series, 1983 . EXTERNAL
8. Zhang H. Low C. Smoliar S . “Video Parsing and Indexing of Compressed Data,” Multimedia Tools and Applications 1 (March 1995 ), pp. 89 – 111 . EXTERNAL
9. Hwang M. Rosenfeld R. Thayer E. Mosur R. Chase L. Weide R. Huang X. Alleva F. , “Improving Speech Recognition Performance via Phone-Dependent VQ Codebooks . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M00103.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; Automated Video Indexing for On-Demand Retrieval from Very Large Video Libraries, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996. Available at https://doi.org/10.5594/M00103

Snippet:

H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; Automated Video Indexing for On-Demand Retrieval from Very Large Video Libraries, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996. Available at https://doi.org/10.5594/M00103

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; <cite>Automated Video Indexing for On-Demand Retrieval from Very Large Video Libraries</cite>, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996. Available at <a href="https://doi.org/10.5594/M00103" target="_blank" rel="noopener">https://doi.org/10.5594/M00103</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
H. D. Wactlar, A. G. Hauptmann, M. A. Smith, K. V. Pendyala, and D. Garlington; <cite id="bib-10-5594-m00103">Automated Video Indexing for On-Demand Retrieval from Very Large Video Libraries</cite>, SMPTE Meetings and Conferences ( October 1996); SMPTE, 1996
<span class="doi">10.5594/M00103</span>
</li>