An Introduction to the Supplemental Enhancement Information Message for Coding Video with Constituent Rectangles

Metadata

Publisher: SMPTE
Doc Type: Journal Article
Content Type: Original Research
Abbreviated Title: SMPTE Motion Imaging Jour.
Volume: 134, No. 1, pp. 64–70
Abstract: The Constituent Rectangles Supplemental Enhancement Information (SEI) message is under development by the Joint Video Experts Team (JVET) for coding videos formed from compositing multiple videos as constituent rectangles. Many applications require multiple synchronized videos for multiview content or different types of content, such as alpha channels, depth maps, object masks, or image features. Use cases for the SEI message include VR/AR, 3D, free-viewpoint video, game streaming, and cloud gaming. Pictures containing frame-packed rectangular regions have previously been coded with existing single-layer video codecs/profiles in an ad hoc non-standardized manner, without clear description within the video bitstream. The Constituent Rectangles SEI message provides a standardized way to describe a video containing pictures formed by compositing multiple rectangular videos of one or more types using a single-layer video codec profile such as High-Efficiency Video Encoding (HEVC) Main or Versatile Video Coding (VVC) Main profile. The multiple videos otherwise could have been coded as separate pictures in layers of a multi-layer bitstream, requiring the use of a multi-layer video codec profile. The Constituent Rectangles SEI message is targeted for inclusion in a new version of the Versatile Supplemental Enhancement Information (VSEI) standard, a partner standard to the VVC standard, which defines SEI messages providing in-band metadata targeting a variety of use cases. SEI messages defined in VSEI may also be used with other video coding standards, including Advanced Video Coding (H.264/AVC) and HEVC.
Publication Date: 2025-01-01
DOI: 10.5594/JMI.2025/LZES6606
ISSN: Print: 1545-0279 | Electronic: 2160-2492
Link: https://doi.org/10.5594/JMI.2025/LZES6606
Author(s): Jill Boyce
Miska M. Hannuksela
Keyword(s): SEI, VSEI
Copyright: © 2025 SMPTE

Bibliographic Reference(s)

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-JMI.2025-LZES6606.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Jill Boyce and Miska M. Hannuksela; An Introduction to the Supplemental Enhancement Information Message for Coding Video with Constituent Rectangles, MIJ 2025, Volume 134, Number 1 (pp. 64 to 70); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/LZES6606

Snippet:

Jill Boyce and Miska M. Hannuksela; An Introduction to the Supplemental Enhancement Information Message for Coding Video with Constituent Rectangles, MIJ 2025, Volume 134, Number 1 (pp. 64 to 70); SMPTE, 2025. Available at https://doi.org/10.5594/JMI.2025/LZES6606

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Jill Boyce and Miska M. Hannuksela; <cite>An Introduction to the Supplemental Enhancement Information Message for Coding Video with Constituent Rectangles</cite>, MIJ 2025, Volume 134, Number 1 (pp. 64 to 70); SMPTE, 2025. Available at <a href="https://doi.org/10.5594/JMI.2025/LZES6606" target="_blank" rel="noopener">https://doi.org/10.5594/JMI.2025/LZES6606</a></span>

SMPTE's HTML Pub

Preview:

Jill Boyce and Miska M. Hannuksela; An Introduction to the Supplemental Enhancement Information Message for Coding Video with Constituent Rectangles, MIJ 2025, Volume 134, Number 1 (pp. 64 to 70); SMPTE, 2025
doi: 10.5594/JMI.2025/LZES6606
url: https://doi.org/10.5594/JMI.2025/LZES6606

Snippet:

<li>
Jill Boyce and Miska M. Hannuksela; <cite id="bib-10-5594-jmi-2025-lzes6606">An Introduction to the Supplemental Enhancement Information Message for Coding Video with Constituent Rectangles</cite>, MIJ 2025, Volume 134, Number 1 (pp. 64 to 70); SMPTE, 2025
<span class="doi">10.5594/JMI.2025/LZES6606</span>
</li>