Shot Change and Stuck Pixel Detection of Digital Video Assets

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 127, No. 6, pp. 34–43
Abstract: In this paper, we address two significant components of typical post-production workflows in current entertainment industry: (a) shot change detection and (b) dead- or stuck-pixel detection. The former involves identifying precise temporal boundaries of cinematographic content in order to analyze quality of cuts, while the latter is useful for localizing and correcting spatial anomalies that emerge during the image acquisition step due to faulty sensors. To address the aforementioned, we devise two novel data-driven approaches and demonstrate their portability, scalability, and efficacy through two respective cloud computing-based implementations. Our approaches show promising results on our in-house data set of a large number of movie titles indicating their effectiveness.
Publication Date: 2018-07-01
DOI: 10.5594/JMI.2018.2827278
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2018.2827278
Author(s): Subhabrata Bhattacharya
Adithya Prakash
Rohit Puri
Keyword(s): Quality Control, Dead-pixel Detection, Nonparametric Machine Learning, Outlier Detection, Post Production, Shot-change Detection
Copyright: © 2018 SMPTE

Bibliographic Reference(s)

T. Coughlin, “Storage Trends in Post Production,” Aug. 2017. [Online]. Available: http://goo.gl/M571hv EXTERNAL
K. Weins, “Cloud Computing Trends: 2017 State of the Cloud Survey,” Feb. 2017. [Online]. Available: https://goo.gl/9YPzAY EXTERNAL
K. Zuiderveld, “Graphics Gems IV,” in Contrast Limited Adaptive Histogram Equalization, P. S. Heckbert, Ed., pp. 474–485, Academic Press: Cambridge, MA, 1994. EXTERNAL
J. Mathers, “Are You Ready to Take Advantage of Post Production in the Cloud?,” Apr. 2017. [Online]. Available: https://goo.gl/6zDmiY EXTERNAL
K. Tse, J. Wei, and S. Panchanathan, “A Scene Change Detection Algorithm for MPEG Compressed Video Sequences,” Proc. 1995 Canadian Conf. Elect. Comput. Engineer., vol. 2, pp. 827–830, Sept. 1995. EXTERNAL
S. Streater, “The Cloud and the Evolution of Post-Production,” Aug. 2017. [Online]. Available: https://goo.gl/a3n6x3 EXTERNAL
J. Meng, Y. Juan, and S.-F. Chang, “Scene Change Detection in a MPEG Compressed Video Sequences,” Proc. IS&T/SPIE Symp., vol. 2419, pp. 1–12, Feb. 1995. EXTERNAL
A. E. Mudau, C. J. Willers, D. Griffith, and F. P. J. le Roux, “Non-uniformity Correction and Bad Pixel Replacement on LWIR and MWIR Images,” Proc. 2011 Saudi Int. Electron. Commun. Photon. Conf., pp. 1–5, Apr. 2011. EXTERNAL
G. Pal et al., Video Shot Boundary Detection: A Review, Springer International Publishing: Cham, Switzlerland, 2015. EXTERNAL
W. Ren and S. Singh, Automatic Video Shot Boundary Detection Using Machine Learning, Springer Berlin Heidelberg, 2004. EXTERNAL
S.-C. Chen et al., “Video Scene Change Detection Method Using Unsupervised Segmentation and Object Tracking,” Proc. IEEE Int. Conf. Multimedia Expo., pp. 56–59, Aug. 2001. EXTERNAL
U. Gargi, R. Kasturi, and S. Strayer, “Performance Characterization of Video-Shot-Change Detection Methods,” IEEE Trans. Circ. Syst. Video Technol., 10:1–13, 2000. EXTERNAL
C. R. Huang, H. P. Lee, and C. S. Chen, “Shot Change Detection via Local Keypoint Matching,” IEEE Trans. Multimedia, 10(6):1097–1108, Oct. 2008. EXTERNAL
P. C. Mahalanobis, “On the Generalized Distance in Statistics,” Proc. Nat. Inst. Sci. (Calcutta), vol. 2, pp. 49–55, 1936. EXTERNAL
B. Soibam et al., “Quantitative Comparison of Metrics for Change Detection in Video Patrolling Applications,” Proc. 2009 IEEE 12th Int. Conf. Comput. Vision Workshops, pp. 601–608, Sept. 2009. EXTERNAL
R. Ambrose, “Cutting Cost with Pop-Up Post Facilities,” Jul. 2017. [Online]. Available: https://goo.gl/A5LvEb EXTERNAL
R. Celestre, M. Rosenberger, and G. Notni, “A Novel Algorithm for Bad Pixel Detection and Correction to Improve Quality and Stability of Geometric Measurements,” J Phys. Conf. Ser., 772(1):012002–012008, 2016. EXTERNAL
A. Jacobs et al., “Automatic Shot Boundary Detection Combining Color, Edge, and Motion Features of Adjacent Frames,” Proc. TRECVID 2004 Workshop, pp. 197–206, Nov. 2004. EXTERNAL
C.-W. Ngo et al., “Motion-Based Video Representation for Scene Change Detection,” Proc. 15th Int. Conf. Patt. Recogn., vol. 1, pp. 827–830, 2000. EXTERNAL
M. Brindha and R. Amsaveni, “Shot Change Detection on News Videos Using Color Histogram and Edge Based Approaches,” Proc. 2016 IEEE Int. Conf. Adv. Comput. Appl., pp. 50–54, Oct. 2016. EXTERNAL
C. Harris and M. Stephens, “A Combined Corner and Edge Detector,” Proc. 4th Alvey Vision Conf., pp. 147–151, 1988. EXTERNAL
R. Dugad, K. Ratakonda, and N. Ahuja, “Performance Characterization of Video-Shot-Change Detection Methods,” Proc. IEEE Workshop Multimedia Sig. Process., pp. 376–381, Dec. 1988. EXTERNAL
Y. Abdeljaoued et al., “A New Algorithm for Shot Boundary Detection,” Proc. 10th Euro. Sig. Process. Conf., pp. 1–4, Sept. 2000. EXTERNAL
H. Bay et al., “Speeded-Up Robust Features (SURF),” Comput. Vision Image Und, 110(3):346–359, Jun. 2008. EXTERNAL
T. Kar and P. Kanungo, “A Texture Based Method for Scene Change Detection,” Proc. IEEE Power Commun. Inform. Technol. Conf., pp. 72–77, Oct. 2015. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2018.2827278.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Subhabrata Bhattacharya, Adithya Prakash, and Rohit Puri; Shot Change and Stuck Pixel Detection of Digital Video Assets, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 6, July 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2827278

Snippet:

Subhabrata Bhattacharya, Adithya Prakash, and Rohit Puri; Shot Change and Stuck Pixel Detection of Digital Video Assets, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 6, July 2018); SMPTE, 2018. Available at https://doi.org/10.5594/JMI.2018.2827278

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Subhabrata Bhattacharya, Adithya Prakash, and Rohit Puri; <cite>Shot Change and Stuck Pixel Detection of Digital Video Assets</cite>, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 6, July 2018); SMPTE, 2018. Available at <a href="https://doi.org/10.5594/JMI.2018.2827278" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2018.2827278</a></span>

SMPTE's HTML Pub

Preview:

Subhabrata Bhattacharya, Adithya Prakash, and Rohit Puri; Shot Change and Stuck Pixel Detection of Digital Video Assets, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 6, July 2018); SMPTE, 2018
doi: 10.5594/JMI.2018.2827278
url: https://doi.org/10.5594/JMI.2018.2827278

Snippet:

<li>
Subhabrata Bhattacharya, Adithya Prakash, and Rohit Puri; <cite id="bib-10-5594-jmi-2018-2827278">Shot Change and Stuck Pixel Detection of Digital Video Assets</cite>, SMPTE Motion Imaging Journal ( Volume: 127, Issue: 6, July 2018); SMPTE, 2018
<span class="doi">10.5594/JMI.2018.2827278</span>
</li>