SEI Message for Coding Video Containing Multiple Constituent Rectangles

Metadata

Publisher: SMPTE — Hollywood, CA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 00, pp. 1–14
Abstract: The Constituent Rectangles Supplemental Enhancement Information (SEI) message is under development by the Joint Video Experts Team (JVET) for coding video formed from compositing multiple videos as constituent rectangles. Many applications require the use of multiple synchronized videos, for multi-view content or for different types of content, such as alpha channels, depth maps, objects masks, or image features. Use cases for the SEI message include VR/AR, 3D, free viewpoint video, game streaming, and cloud gaming. Pictures containing frame packed rectangular regions have previously been coded with existing single layer video codecs/profiles in an ad hoc non-standardized manner, without clear description within the video bitstream. The Constituent Rectangles SEI message provides a standardized way to describe a video containing pictures formed by compositing multiple rectangular videos of one or more types, using a single-layer video codec profile such as HEVC Main or VVC Main profile. The multiple videos otherwise could have been coded as separate pictures in layers of a multi-layer bitstream, requiring use of a multi-layer video codec profile. The Constituent Rectangles SEImessage is targeted for inclusion in a new version of the Versatile Supplemental Enhancement Information (VSEI) standard, a partner standard to the Versatile Video Coding (VVC) standard which defines SEI messages providing in-band metadata targeting a variety of use cases. SEI messages defined in VSEI may also be used with other video coding standards, including Advanced Video Coding (H.264/AVC) and High Efficiency Video Coding (HEVC).
Publication Date: 2024-10-21
DOI: 10.5594/MOO/3003
ISBN: [object Object]
Link: https://doi.org/10.5594/MOO/3003
Author(s): Jill Boyce
Miska M. Hannuksela
Keyword(s): SEI, VSEI, Versatile Video Coding, HEVC
Copyright: © 2024 SMPTE

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-MOO-3003.json

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Jill Boyce and Miska M. Hannuksela; SEI Message for Coding Video Containing Multiple Constituent Rectangles, MTS 2024, Article 3 (pp. 1 to 14); SMPTE, 2024, ISBN: [object Object]. Available at https://doi.org/10.5594/MOO/3003

Snippet:

Jill Boyce and Miska M. Hannuksela; SEI Message for Coding Video Containing Multiple Constituent Rectangles, MTS 2024, Article 3 (pp. 1 to 14); SMPTE, 2024, ISBN: [object Object]. Available at https://doi.org/10.5594/MOO/3003

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Jill Boyce and Miska M. Hannuksela; <cite>SEI Message for Coding Video Containing Multiple Constituent Rectangles</cite>, MTS 2024, Article 3 (pp. 1 to 14); SMPTE, 2024, ISBN: [object Object]. Available at <a href="https://doi.org/10.5594/MOO/3003" target="_blank" rel="noopener">https://doi.org/10.5594/MOO/3003</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Jill Boyce and Miska M. Hannuksela; <cite id="bib-10-5594-moo-3003">SEI Message for Coding Video Containing Multiple Constituent Rectangles</cite>, MTS 2024, Article 3 (pp. 1 to 14); SMPTE, 2024, ISBN: [object Object]
<span class="doi">10.5594/MOO/3003</span>
</li>