Realtime Semantic Enrichment of Video Streams in the Age of Big Data

Metadata

Publisher: SMPTE — White Plains, NY, USA
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Mot. Imag. J
Volume: 128, No. 1, pp. 1–8
Abstract: This paper describes AgileRAI, a framework for searching, organizing, and accessing multimedia data in a fast and semantic-driven way. AgileRAI supports realtime ingestion of video streams on which different machine-learning techniques (such as global and local visual features extraction and matching) are applied in a parallel and scalable way. Extracted features are matched to a reference database of visual patterns (e.g., faces, logos, and monuments) in order to produce a set of metatags describing the ingested contents. Furthermore, these tags are semantically enriched using open semantic data repositories. The system is designed with a scale-out pattern architecture based on Apache Spark, ensuring high performance in Big Data management environments.
Publication Date: 2019-01-01
DOI: 10.5594/JMI.2018.2880364
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2018.2880364
Author(s): Maurizio Montagnuolo
Paolo Platter
Alessio Bosca
Nicolò Bidotti
Alberto Messina
Keyword(s): Big Data, Content Retrieval, Distributed Systems, Pipeline Processing, Semantic Web
Copyright: © 2018 SMPTE

Bibliographic Reference(s)

ISO.15938-14 — ISO/IEC 15938-14, “Information Technology. Multimedia Content Description Interface. Reference Software, Conformance and Usage Guidelines for Compact Descriptors for Visual Search,” Feb. 2018. EXTERNAL
L.-Y. Duan et al., “Overview of the MPEG-CDVS Standard,” IEEE Trans. Imag. Process, 25:179–194, 2016. EXTERNAL
K. Zhang, W.-L. Chao, F. Sha, and K. Grauman, “Video Summarization with Long Short-Term Memory,” Proc. European Conf. Comput. Vision, pp. 766–782, 2016. EXTERNAL
S. Harris and A. Seaborne. “SPARQL 1.1 Query Language. W3C Recommendation 21 March 2013,” 2013. [Online]. Available: https://www.w3.org/TR/sparql11-query/ EXTERNAL
Agile Lab S.r.L., “Wide Analytics Streaming Platform,” GitHub Repository, 2017, accessed May 2, 2017. [Online]. Available: https://github.com/agile-lab-dev/wasp EXTERNAL
M. Färber, F. Bartscherer, C. Menne, and A. Rettinger, “Linked Data Quality of DBpedia, Freebase, OpenCyc, Wikidata, and YAGO,” Semantic Web J. Special Issue on Quality Management of Semantic Web Assets (Data, Services, and Systems), 2016. EXTERNAL
“Lightbend Akka Toolkit.” (2018). [Online]. Available: http://akka.io EXTERNAL
P. Viana and J. P. Pinto, “A Collaborative Approach for Semantic Time-Based Video Annotation Using Gamification,” Human Centric Comput. Inform. Sci., 7:13, 2017. doi:10.1186/ s13673-017-0094-5 EXTERNAL
F. Pan and J. R. Hobbs, “Time in OWL-S,” Proc. AAAI Spring Symp. Semantic Web Serv., Stanford University, CA, pp. 29–36, 2004. EXTERNAL
“Apache Kafka: A Distributed Streaming Platform.” (2018). [Online]. Available: https://kafka.apache.org EXTERNAL
J. Eggink and Y. Raimond, “Recent Advances in Affective and Semantic Media Applications at the BBC,” Proc. 14th Int. Worksh. Imag. Anal. Multim. Interact. Serv., pp. 1–4, 2013. EXTERNAL
K. Chatfield, R. Arandjelovi´c, O. M. Parkhi, and A. Zisserman, “On-the-Fly Learning for Visual Search of Large-Scale Image and Video Datasets,” Int. J. Multim. Inform. Retrieval, 4(2):75–93, 2015. EXTERNAL
Y. Raimond, C. Lowis, R. Hodgson, and J. Tweed, “Automated Semantic Tagging of Speech Audio,” Proc. 21st Int. Conf. Worldwide Web, pp. 405–408, 2012. EXTERNAL
D. G. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” Int. J. Compt. Vision, 6:91–110, 2004. EXTERNAL

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2018.2880364.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Maurizio Montagnuolo, Paolo Platter, Alessio Bosca, Nicolò Bidotti, and Alberto Messina; Realtime Semantic Enrichment of Video Streams in the Age of Big Data, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 1, 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2018.2880364

Snippet:

Maurizio Montagnuolo, Paolo Platter, Alessio Bosca, Nicolò Bidotti, and Alberto Messina; Realtime Semantic Enrichment of Video Streams in the Age of Big Data, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 1, 2019); SMPTE, 2019. Available at https://doi.org/10.5594/JMI.2018.2880364

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Maurizio Montagnuolo, Paolo Platter, Alessio Bosca, Nicolò Bidotti, and Alberto Messina; <cite>Realtime Semantic Enrichment of Video Streams in the Age of Big Data</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 1, 2019); SMPTE, 2019. Available at <a href="https://doi.org/10.5594/JMI.2018.2880364" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2018.2880364</a></span>

SMPTE's HTML Pub

Preview:

Maurizio Montagnuolo, Paolo Platter, Alessio Bosca, Nicolò Bidotti, and Alberto Messina; Realtime Semantic Enrichment of Video Streams in the Age of Big Data, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 1, 2019); SMPTE, 2019
doi: 10.5594/JMI.2018.2880364
url: https://doi.org/10.5594/JMI.2018.2880364

Snippet:

<li>
Maurizio Montagnuolo, Paolo Platter, Alessio Bosca, Nicolò Bidotti, and Alberto Messina; <cite id="bib-10-5594-jmi-2018-2880364">Realtime Semantic Enrichment of Video Streams in the Age of Big Data</cite>, SMPTE Motion Imaging Journal ( Volume: 128, Issue: 1, 2019); SMPTE, 2019
<span class="doi">10.5594/JMI.2018.2880364</span>
</li>