Interoperable AV SYNC Systems in SMPTE 22TV LIP SYNC AHG (Content-Fingerprinting Based Audio-Video Synchronization)

Metadata

Publisher: SMPTE — White Plains, NY
Doc Type: Conference Paper
Content Type: Original Research
Volume: 2010, No. 10, pp. 1–21
Abstract: An end to end interoperable content fingerprint based audio-video synchronization system is described, including audio-video fingerprinting technology overview and current status of the standardization process in SMPTE' 22TV Lip Sync AHG. The system is based on the audio-video fingerprinting technology currently submitted to the SMPTE 22TV Lip Sync AHG by Miranda Corporation. The particular type of signatures are implemented and imbedded in Zeitera Corporation' file based workflow, and in Miranda' real-time SDI-based audio/video synchronization equipment, showing signatures being captured by either vendor's system, and providing results through either vendors application management flow. The example of successful collaboration on an interoperable, mixed vendor solution that can handle both compressed audio/video files and real-time SDI audio/video input is highlighted.
Publication Date: 2010-10-01
DOI: 10.5594/M001364
Link: https://doi.org/10.5594/M001364
Author(s): Mihailo StojancicZeitera, LLC
Daniel EakinsZeitera, LLC
Copyright: © 2010 Society of Motion Picture and Television Engineers, Inc.

Bibliographic Reference(s)

1. Li Chengliang , “Acoustic Speech to Lip Feature Mapping for Multimedia Applications” , Proceedings of the 3rd International Symposium on Image and Signal Processing and Analysis, 2003 . EXTERNAL
10. Stojancic M. , “Digital Video Fingerprinting Based on Resultant Weighted Gradient Orientation Computation” , Patent Application, June 25, 2009 . EXTERNAL
11. Radhakrishnan R. Bauer C. , “Content-based Video Signatures based on Projections of Difference Images” , MMSP 2007 . EXTERNAL
12. MPEG-7 Visual Signature Tools, Bober M. Brasnett P. , Mitsubishi Electric R&D Center Europe (MERCE) , Visual and Sensing Division , Guildford, UK . EXTERNAL
13. Brasnett P. Paschalakis S. Bober M. , “Recent Developments on Standardization of MPEG-7 Visual Signature Tools” , ICME 2010 . EXTERNAL
14. Chien S-Y. , “Fast Video Segmentation Algorithm With Shadow Cancellation, Global Motion Compensation, and Adaptive Threshold Techniques” , IEEE Transactions on Multimedia , Vol. 6 , No. 5 , October 2004 . EXTERNAL
15. Seo J. S. Haitsma J. Kalker T. Yoo C. D. , “A Robust Image Fingerprinting System Using the Radon Transform,” Sig. Proc.: Image Comm. , vol. 19 , pp. 325 – 339 , 2004 . EXTERNAL
16. Lowe David G. , “Distinctive Image Features from Scale-Invariant Keypoints” , International Journal of Computer Vision , 2004 . EXTERNAL
17. Mikolajczyk K. Schmid C. , “Scale & Affine Invariant Interest Point Detectors” , International Journal of Computer Vision 60 ( 1 ), 63 – 86 , 2004 . EXTERNAL
18. Grabner M. Grabner H. Bischof H. , “Fast approximated SIFT” , Institute for Computer Graphics and Vision, Graz University of Technology , Austria . EXTERNAL
19. Bay H. Tuytelaars T. Van Gool L. , “SURF: Speeded Up Robust Features” , ETH Zurich . EXTERNAL
2. Voyatzis G. , “The Use of Watermarks in the Protection of Digital Multimedia Products” , Proceedings of the IEEE , Vol. 87 , No. 7 , July 1999 . EXTERNAL
20. Stojancic M. , “Digital Video Content Fingerprinting Based on Scale Invariant Interest Region Detection with an Array of Anisotropic Filters”, Patent Application, November 05, 2009 . EXTERNAL
21. Burges C.J.C. , “Extracting noise-robust features from audio data” , IEEE International Conference on Acoustics, Speech, and Signal Processing, 2002 . Proceedings. (ICASSP '02). EXTERNAL
22. Radhakrishnan R. , “Audio Signature Extraction Based on Projections of Spectrograms” , ICME 2007 . EXTERNAL
23. Cano P. “A Review of Algorithms for Audio Fingerprinting” , 2002 IEEE Workshop on Multimedia Signal Processing. EXTERNAL
24. Haitsma J. Kalker T. , “A Highly Robust Audio Fingerprinting System” , In Proc. ISMIR 2002 . EXTERNAL
25. Baluja S. Covell M. , “Content fingerprinting using wavelets” , Proc. CVMP, 2006 . EXTERNAL
26. Baluja S. Covell M. , “Audio Fingerprinting: Combining Computer Vision & Data Stream Processing” , Google, Inc. EXTERNAL
27. Ke Y. , “Computer Vision for Music Identification” , Proc. CVPR, 2005 . EXTERNAL
3. Cheung W. N. , “Digital Image Watermarking In Spatial and Transform Domains” , Proceedings of TENCON 2000 Volume: 3 , Pages: 374 – 378 . EXTERNAL
4. Chandra M. , “A DWT Domain Visible Watermarking Techniques for Digital Images” , 2010 International Conference on Electronics and Information Engineering - ICEIE 2010 ). EXTERNAL
5. Megalingam R. K. , “Performance Comparison of Novel, Robust Spatial Domain Digital Image Watermarking with the Conventional Frequency Domain Watermarking” , 2010 International Conference on Signal Acquisition and Processing. EXTERNAL
6. Sharma R. K. , “A Survey Of Watermarking Techniques Applied To Multimedia” , Digimark Corporation . EXTERNAL
7. Terry K. Radhakrishnan R. , “Detection and Correction of Lip-Sync Errors Using Audio and Video Fingerprint” , SMPTE Motion Imaging Journal , April 210. EXTERNAL
8. Radhakrishnan R. Terry K. Bauer C. , “Audio and Video Signatures for Synchronization” , ICME 2008 . EXTERNAL
9. Stojancic M. , “Methods and Apparatus for Providing a Scalable Identification of Digital Video Sequences” , Patent Application, June 18, 2008 . EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-M001364.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Mihailo Stojancic and Daniel Eakins; Interoperable AV SYNC Systems in SMPTE 22TV LIP SYNC AHG (Content-Fingerprinting Based Audio-Video Synchronization), SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at https://doi.org/10.5594/M001364

Snippet:

Mihailo Stojancic and Daniel Eakins; Interoperable AV SYNC Systems in SMPTE 22TV LIP SYNC AHG (Content-Fingerprinting Based Audio-Video Synchronization), SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at https://doi.org/10.5594/M001364

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Mihailo Stojancic and Daniel Eakins; <cite>Interoperable AV SYNC Systems in SMPTE 22TV LIP SYNC AHG (Content-Fingerprinting Based Audio-Video Synchronization)</cite>, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010. Available at <a href="https://doi.org/10.5594/M001364" target="_blank" rel="noopener">https://doi.org/10.5594/M001364</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Mihailo Stojancic and Daniel Eakins; <cite id="bib-10-5594-m001364">Interoperable AV SYNC Systems in SMPTE 22TV LIP SYNC AHG (Content-Fingerprinting Based Audio-Video Synchronization)</cite>, SMPTE Meetings and Conferences ( October 2010); SMPTE, 2010
<span class="doi">10.5594/M001364</span>
</li>