Standing on Giants' Shoulders: Innovative Metadata Applications without Legacy Burdens

Metadata

Publisher: SMPTE — Hollywood, CA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 00, pp. 1–15
Abstract: Legacy methods for transporting metadata severely limit the type, bandwidth, and utility of the payloads they carry. Initial metadata standards and implementations of metadata transport in the ST 2110 family focused on time to market and backward compatibility and merely acted as wire replacements. This is especially true of ST 2110–40 Ancillary Data and ST 2110–31 AES3 Transparent audio. Using either standard for metadata, particularly for user-defined and novel applications, requires working with specialized encoding and constraints that are otherwise unnecessary. For asynchronous or independent metadata flows, coupling metadata transport to other essence characteristics adds complexity and significantly reduces the operability and monitorability of the system. ST 2110–41, the Fast Metadata Framework, is a departure from legacy workflows, allowing user-defined metadata flows that stand on their own, but are managed and operated in the same ways that video and audio work. SiriusXM has the opportunity to re-imagine our content workflows end-to-end, from contribution through production and origination up to distribution. We are using this combination of greenfield and retrofit build to take the best parts of existing standards and proprietary systems that continue to solve contemporary problems, but modernize aspects of the standards that are strongly tied to legacy transports or unnecessarily bound by media essence constraints. This paper reviews implementations of SCTE DPI triggers and proprietary program associated data within ST 2110–41 flows. The overall architecture of the professional media system is reviewed, as well. The problems identified in legacy systems are reviewed. Also, the limitations of the Fast Metadata Framework are addressed. In particular, the management of heterogeneous essence synchronization with diverse processing pipelines compounds the timing plane issues previously identified in ST 2110 systems. Constraints on the standards-setting process, as they impact the development and implementation of innovative, flexible systems, are also discussed. Areas for further research and development, including storage and replay of metadata, are identified.
Publication Date: 2024-10-21
DOI: 10.5594/MOO/3050
ISBN: Electronic: 978-1-61482-965-2
Link: https://doi.org/10.5594/MOO/3050
Author(s): Michael S. Liebman
Thomas Psipsikas
Keyword(s): Metadata, SCTE, Digital Program Insertion, Fast Metadata Framework, Time & Sync
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

AES3:2009 (r2019) [Active, Reaffirmed]
AES67.2023 — Audio Engineering Society (AES), AES67–2023, “AES standard for audio applications of networks - High-performance streaming audio-over-IP interoperability,” Available: https://www.aes.org/publications/standards/search.cfm?docID=96. EXTERNAL
ANSI/CTA-608-E S-2019 [Active, Stabilized]
IETF draft-bhutton-json-schema-00 [Draft*]
G. Roberts, “Interlude: Virtual Production in Film and Games,” in Production Pipeline Fundamentals for Film and Games, R. Dunlop, Ed., Burlington, MA: Focal Press, 2014. EXTERNAL
X. Sun, “Immersive audio, capture, transport, and rendering: a review,” SIP, vol. 10, no. 1, 2021, doi: 10.1017/ATSIP.2021.12. EXTERNAL
J. Davidson, “The YouTube video recommendation system,” in Proceedings of the fourth ACM conference on Recommender systems, Barcelona Spain: ACM, Sep. 2010, pp. 293–296. doi: 10.1145/1864708.18647.0. EXTERNAL
International Press Telecommunications Council, “Use Cases,” IPTC Sport Schema. Accessed: July 29, 2024. [Online]. Available: https://www.sportschema.org//use-cases/ EXTERNAL
F. Yeung, B. Salahieh, K. Loza, S. Jayaram, and J. Boyce, “Delivering object-based immersive media experiences in sports,” ICT Discoveries, vol. 3, no. 1, May 2020, Accessed: August 26, 2024. [Online]. Available: http://handle.itu.int/11.1002/pub/8153d783-en EXTERNAL
SMPTE Registration Authority, LLC, “SMPTE Ancillary Data ST 291: Data Identification Word Assignments for Registered DIDs.” Accessed: July 10, 2024. [Online]. Available: https://smpte-ra.org/smpte-ancillary-data-smpte-st-291 EXTERNAL
Alliance for IP Media Solutions, “AES67/SMPTE ST 2110 commonalities and constraints.” 2019. Accessed: July 13, 2024. [Online]. Available: https://aimsalliance.org/wp-content/upioads/2019/04/AES67-SMPTE-ST-2110-Commonalities-and-Constraints-Updated-April-2019.pdf EXTERNAL
IEEE 1588-008, “IEEE Standard for a Precision Clock Synchronization Protocol for Networked Measurement and Control Systems,” 07/2008, Available: https://ieeexplore.ieee.org/document/4579760 EXTERNAL
SMPTE, “Time Code Summit,” New York, NY, USA, November 16, 2016. EXTERNAL
P. Briscoe, “32NF-60 ST 2110-42 Metadata for 2110-x streams using ST 2110-41 Fast Metadata (FMX).” Accessed: July 14, 2024. [Online]. Available: https://kws.smpte.org/higherlogic/ws/public/projects/559/details EXTERNAL
Society of Cable Telecommunications Engineers (SCTE), ANSI/SCTE 35 2023r1, “Digital Program Insertion Cueing Message,” Available: https://account.scte.org/standards/library/catalog/scte-35-digital-program-insertion-cueing-message/ EXTERNAL
National Radio Systems Committee, NRSC-G304, “Metadata for Streaming Audio Handbook,” 10/2023, Available: https://www.nrscstandards.org/standards-and-guidelines/documents/guidelines/nrsc-g304.pdf EXTERNAL
M. Allamanis and C. Sutton, “Mining Idioms from Source Code,” in Proceedings of the 22nd ACM SIGSOFT International Symposium on Foundations of Software Engineering, Nov. 2014, pp. 472–483. doi: 10.1145/2635868.26359.1. EXTERNAL
M. Keeling, “Love Unrequited: The Story of Architecture, Agile, and How Architecture Decision Records Brought Them Together,” IEEE Software, vol. 39, no. 4, pp. 90–93, Jul. 2022, doi: 10.1109/MS.2022.3166266. EXTERNAL
M. Nygard, “Documenting Architecture Decisions,” Cognitect.com. Accessed: July 22, 2024. [Online]. Available: https://www.cognitect.com/blog/2011/11/15/documenting-architecture-decisions EXTERNAL
J. P. Henderson, Architecture decision record (ADR). (July 20, 2024). Accessed: July 22 2024. [Online]. Available: https://github.com/joelparkerhenderson/architecture-decision-record EXTERNAL
Anonymous, “Stop SMPTE 2110!” Accessed: August 4, 2024. [Online]. Available: https://www.stop2110.org/ EXTERNAL
E. F. Crawley, B. Cameron, and D. Selva, System architecture: strategy and product development for complex systems. Boston: Pearson, 2016. EXTERNAL
R-REC-BR.780-2 — International Telecommunication Union-Radiocommunication (ITU-R), Recommendation BR.780–2, “Time and control code standards, for production applications in order to facilitate the international exchange of television programmes on magnetic tapes,” 2005. EXTERNAL
IETF RFC 768 [Active*]
IETF RFC 3550 [Active*]
IETF RFC 4566 [Superseded*]
IETF RFC 5905 [Active*]
IETF RFC 8259 [Active*]
IETF RFC 8285 [Active*]
SCTE.104.2023 — Society for Cable Television Engineers (SCTE), ANSI/SCTE 104 2023, “Automation System to Compression System Communications Applications Program Interface (API).” [Online]. Available: https://account.scte.org/standards/library/catalog/scte-104-automation-system-to-compression-system-communications-api/. EXTERNAL
SMPTE RP 215:2009 [Active, Stabilized]
SMPTE ST 259:2008 [Active, Stabilized]
SMPTE ST 291-1:2011 [Active, Reaffirmed*]
SMPTE ST 292:2008 [Superseded*]
SMPTE ST 335:2012 [Active, Amended]
SMPTE ST 2010:2008 [Active*]
SMPTE.ST2110 — SMPTE, ST 2110 Suite of Standards. [Online]. Available: https://www.smpte.org/st-2110 EXTERNAL
SMPTE ST 2110-10:2022 [Active]
SMPTE ST 2110-30:2017 [Superseded]
SMPTE ST 2110-31:2022 [Active]
SMPTE ST 2110-40:2023-12 [Active]
SMPTE ST 2110-41 [Active]
SMPTE ST 2110-43:2021 [Active]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-MOO-3050.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Michael S. Liebman and Thomas Psipsikas; Standing on Giants' Shoulders: Innovative Metadata Applications without Legacy Burdens, MTS 2024, Article 40 (pp. 1 to 15); SMPTE, 2024, ISBN: 978-1-61482-965-2. Available at https://doi.org/10.5594/MOO/3050

Snippet:

Michael S. Liebman and Thomas Psipsikas; Standing on Giants&#x27; Shoulders: Innovative Metadata Applications without Legacy Burdens, MTS 2024, Article 40 (pp. 1 to 15); SMPTE, 2024, ISBN: 978-1-61482-965-2. Available at https://doi.org/10.5594/MOO/3050

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Michael S. Liebman and Thomas Psipsikas; <cite>Standing on Giants&#x27; Shoulders: Innovative Metadata Applications without Legacy Burdens</cite>, MTS 2024, Article 40 (pp. 1 to 15); SMPTE, 2024, ISBN: 978-1-61482-965-2. Available at <a href="https://doi.org/10.5594/MOO/3050" target="_blank" rel="noopener">https://doi.org/10.5594/MOO/3050</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Michael S. Liebman and Thomas Psipsikas; <cite id="bib-10-5594-moo-3050">Standing on Giants&#x27; Shoulders: Innovative Metadata Applications without Legacy Burdens</cite>, MTS 2024, Article 40 (pp. 1 to 15); SMPTE, 2024, ISBN: 978-1-61482-965-2
<span class="doi">10.5594/MOO/3050</span>
</li>