API Build-data JSON Resources
Theme

Choose how MSRBot.io looks on this device.

Auto (match system) Light mode Dark mode

Preference is stored in this browser only.

SMPTE Meetings and Conferences ( October 2009)
[ACTIVE]

Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints

Metadata

Publisher
SMPTE — White Plains, NY
Doc Type
Conference Paper
Content Type
Original Research
Volume
2009, No. 10, pp. 1–24
Abstract
A method for measuring and maintaining time synchronization between an audio and video stream is described. Audio and video fingerprints are used to create a combined audio/video synchronization signature (A/V Sync Signature) at a known reference point. This signature is used at later points to measure audio/video timing synchronization relative to the reference point. This method may be used, for example, to automatically detect and correct audio/video synchronization (i.e. lip-sync) errors in broadcast systems and other applications. Advantages of the method described over other existing methods include that it does not require modification of the audio or video signals, it can respond to dynamically changing synchronization errors, and it is designed to be robust to modifications of the audio/video signals. While the system requires data to be conveyed to the detection point, this data does not need to be synchronized with, or directly attached to, the audio or video streams. As this method uses fingerprints it also enables other fingerprinting applications within systems, such as content identification and verification. In addition, it may be used to maintain synchronization of other metadata associated with audio/video streams.
Publication Date
2009-10-01
DOI
10.5594/M001302
Link
https://doi.org/10.5594/M001302
Author(s)
Kent TerryDolby Laboratories, Inc.
Regunathan RadhakrishnanDolby Laboratories, Inc.
Copyright
© 2009 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

  • 1. Radhakrishnan R. Bauer C. Cheng C. Terry K. , “Audio signature extraction based on projections of spectrograms” , ICME , 2007 . EXTERNAL
  • 10. Fridrich J. Goljan M. , “Robust Hash Functions for Digital Watermarking” , Proc. of ITCC , 2000 . EXTERNAL
  • 2. Radhakrishnan R. Bauer C. , “Content-based video signatures based on projections of difference images” , MMSP , 2007 . EXTERNAL
  • 3. Radhakrishnan R. Terry K. Bauer C. , “Audio and Video Signatures for Synchronization” , Proc. Of ICME , 2008 . EXTERNAL
  • 4. Kozat S.S. Venkatesan R. Mihcak M.K. , “Robust perceptual image hashing via matrix invariants” , ICIP 2004 . EXTERNAL
  • 5. Swaminathan A. Mao Y. Wu Min , “Image Hashing Resilient To Geometric and Filtering Operations” , MMSP 2004 . EXTERNAL
  • 6. Burges Platt C.J.C. Jana J.C. Jana S. , “Distortion discriminant analysis for audio fingerprinting” , IEEE Transactions on Speech and Audio Processing, May 2003 . EXTERNAL
  • 7. Haitsma J. Kalker T. , “A Highly Robust Audio Fingerprinting System” , In Proc. ISMIR 2002 . EXTERNAL
  • 8. Lu Chun-Shien , “Audio fingerprinting based on analyzing time-frequency localization of signals” , IEEE Workshop on Multimedia Signal Processing , 2002 . EXTERNAL
  • 9. Batlle E. Masip J. Guaus E. , “Automatic Song Identification in Noisy Broadcast Audio” , Proc. Of SIP , Aug 2002 . EXTERNAL
Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001302.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree
Reference this Doc

Plain text (ISO 690 compliant)

Preview:
Kent Terry and Regunathan Radhakrishnan; Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints, SMPTE Meetings and Conferences ( October 2009); SMPTE, 2009. Available at https://doi.org/10.5594/M001302
Snippet:
Kent Terry and Regunathan Radhakrishnan; Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints, SMPTE Meetings and Conferences ( October 2009); SMPTE, 2009. Available at https://doi.org/10.5594/M001302

HTML (ISO 690 compliant)

Preview:
Kent Terry and Regunathan Radhakrishnan; Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints, SMPTE Meetings and Conferences ( October 2009); SMPTE, 2009. Available at https://doi.org/10.5594/M001302
Snippet:
<span class="citation">Kent Terry and Regunathan Radhakrishnan; <cite>Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints</cite>, SMPTE Meetings and Conferences ( October 2009); SMPTE, 2009. Available at <a href="https://doi.org/10.5594/M001302" target="_blank" rel="noopener">https://doi.org/10.5594/M001302</a></span>

SMPTE Icon SMPTE's HTML Pub

Preview:
Kent Terry and Regunathan Radhakrishnan; Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints, SMPTE Meetings and Conferences ( October 2009); SMPTE, 2009
doi: 10.5594/M001302
url: https://doi.org/10.5594/M001302
Snippet:
<li>
Kent Terry and Regunathan Radhakrishnan; <cite id="bib-10-5594-m001302">Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprints</cite>, SMPTE Meetings and Conferences ( October 2009); SMPTE, 2009
<span class="doi">10.5594/M001302</span>
</li>