Leveraging Large Language Models and Knowledge Graphs to Enhance Metadata Extraction for News Media Production

Metadata

Publisher: SMPTE — Hollywood, CA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 00, pp. 1–15
Abstract: This paper introduces a novel procedure for leveraging Large Language Models (LLMs) to create Knowledge Graphs (KGs) from unstructured, multi-language news texts. The approach automates the extraction and disambiguation of entities, relations, and taxonomic hierarchies using iterative few-shot LLM prompting and unsupervised clustering techniques. These KGs are further enriched with additional nodes and edges from external sources like WikiData, enhancing the contextual understanding of the data. To make the KGs accessible to non-technical users, a conversational interface is developed, allowing journalists to interact with the KG via natural language queries, which are translated into database queries for information retrieval. This method shows significant potential for improving digital asset indexing, discovery, and content management in the media industry. Future work will focus on expanding the system's capabilities by incorporating metadata from other media types, integrating with external data sources such as DBpedia and social media, and refining the KG generation process to reduce inconsistencies. The ultimate goal is to create a unified, semantically rich environment for content discovery, enabling more sophisticated, context-aware information retrieval across various media platforms.
Publication Date: 2024-10-21
DOI: 10.5594/MOO/3042
ISBN: [object Object]
Link: https://doi.org/10.5594/MOO/3042
Author(s): Caio Vinicius Dadauto
Daniel Pinheiro Franco
Roger Sacilotto
Rob Gonsalves
Shailendra Mathur
Keyword(s): Large Language Models (LLMs), Knowledge Graphs, Unstructured Text, Language Processing, News Media, Entity Extraction, Relation Extraction, Taxonomy Inference
Copyright: © 2024 SMPTE

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-MOO-3042.json

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Caio Vinicius Dadauto, Daniel Pinheiro Franco, Roger Sacilotto, Rob Gonsalves, and Shailendra Mathur; Leveraging Large Language Models and Knowledge Graphs to Enhance Metadata Extraction for News Media Production, MTS 2024, Article 31 (pp. 1 to 15); SMPTE, 2024, ISBN: [object Object]. Available at https://doi.org/10.5594/MOO/3042

Snippet:

Caio Vinicius Dadauto, Daniel Pinheiro Franco, Roger Sacilotto, Rob Gonsalves, and Shailendra Mathur; Leveraging Large Language Models and Knowledge Graphs to Enhance Metadata Extraction for News Media Production, MTS 2024, Article 31 (pp. 1 to 15); SMPTE, 2024, ISBN: [object Object]. Available at https://doi.org/10.5594/MOO/3042

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Caio Vinicius Dadauto, Daniel Pinheiro Franco, Roger Sacilotto, Rob Gonsalves, and Shailendra Mathur; <cite>Leveraging Large Language Models and Knowledge Graphs to Enhance Metadata Extraction for News Media Production</cite>, MTS 2024, Article 31 (pp. 1 to 15); SMPTE, 2024, ISBN: [object Object]. Available at <a href="https://doi.org/10.5594/MOO/3042" target="_blank" rel="noopener">https://doi.org/10.5594/MOO/3042</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Caio Vinicius Dadauto, Daniel Pinheiro Franco, Roger Sacilotto, Rob Gonsalves, and Shailendra Mathur; <cite id="bib-10-5594-moo-3042">Leveraging Large Language Models and Knowledge Graphs to Enhance Metadata Extraction for News Media Production</cite>, MTS 2024, Article 31 (pp. 1 to 15); SMPTE, 2024, ISBN: [object Object]
<span class="doi">10.5594/MOO/3042</span>
</li>