The new JPEG XS TDC Profile: Perfect Quality at Zero Latency

Metadata

Publisher: SMPTE — Hollywood, CA
Doc Type: Conference Paper
Content Type: Original Research
Volume: 00, pp. 1–14
Abstract: The 3 rd edition of JPEG XS introduces the new Temporal Differential Coding (TDC) profile that adds a temporal differential coding technique on top of XS High to further improve the compression efficiency. TDC adds a temporal prediction block in the wavelet domain that uses a single frame buffer. By doing so, TDC can drastically reduce the correlation of the wavelet coefficients between successive video frames, especially for (semi-)static regions. Because TDC uses deterministic in-place differential coding, there is also no need for motion compensation or other complex algorithms. Thus, it still preserves the original and unique features of JPEG XS: lightweight fast compression with low latency of a few lines, near-lossless quality, low complexity, and low power. Experiments show that TDC works particularly well for graphics, e-sports, gaming, and complex desktop in video sequences, safeguarding details and sharp edges better than ever before, with PSNR improvements of 10 dB or more. On high-motion or fast-changing content, TDC natively falls back to the same performance that is offered by XS High. Like all the XS profiles, TDC facilitates all relevant platforms by design, being CPU, GPU, FPGA and ASIC, making it applicable as the true professional mezzanine video codec in all media and AV workflows. TDC ensures a safe and compatible upgrade path for existing XS ecosystems. This paper explains TDC technically and demonstrates the compression performance improvements, while also showing how latency is not impacted at all and how complexity is kept under control.
Publication Date: 2024-10-21
DOI: 10.5594/MOO/3001
ISBN: Electronic: 978-1-61482-965-2
Link: https://doi.org/10.5594/MOO/3001
Author(s): Tim Bruylants
Ben Runyan
Jean-Baptiste Lorent
Keyword(s): JPEG, XS, Video Compression, Low Complexity, Low Latency, Visually Lossless, Low Power, Open Standard, TDC
Copyright: © 2024 SMPTE

Bibliographic Reference(s)

ISO/IEC 21122-1 [Active]
ISO/IEC 21122-2 [Active]
ISO.29170-2.2015 — International Organization for Standardization/International Electrotechnical Commission (ISO/IEC) 29170-2:2015 Information Technology, “Advanced Image Coding and Evaluation – Part 2: Evaluation Procedure for Nearly Lossless Coding,” Accessed: Apr. 2022. [Online]. Available: https://www.iso.org/standard/66094.html EXTERNAL
ISO/IEC SC 29 WG1, WG1 N100633, “Use Cases and Requirements for JPEG XS v3.2”, November 2023. EXTERNAL
M. Cronk and C. Meyer, “Managing Delay in Live IP Production Systems,” 2016 VSF October Meeting Series, Broomfield, Colorado, USA, 2016. EXTERNAL
M. Kanabus, E. Szelag, E. Rojek, and E. Poppel, “Temporal order judgement for auditory and visual stimuli,” Acta Neurobiologiae Experimentalis, vol. 62, no. 4, pp. 263–270, 2002. EXTERNAL
A. Descampe, “JPEG XS - A New Standard for Visually Lossless Low-Latency Lightweight Image Coding,” in Proceedings of the IEEE, vol. 109, no. 9, pp. 1559–1577, Sept. 2021, doi: 10.1109/JPROC.2021.3080916. EXTERNAL
VSF TR-07: 2022, “Transport of JPEG XS Video in MPEG-2 Transport Stream over IP.” Available: https://vsf.tv/download/technical_recommendations/VSF_TR-07_2022–04-20.pdf. EXTERNAL
VSF TR-08:2022, “Transport of JPEG XS Video in ST 2110-22.” Available: https://vsf.tv/download/technical_recommendations/VSF_TR-08_2022–04-20.pdf. EXTERNAL
AMWA NMOS BCP-006-01, “NMOS With JPEG XS,” v1.0.0. Available: https://specs.amwa.tv/bcp-006–01/releases/v1.0.0/. EXTERNAL
VSF TR-10-7:2022, “Internet protocol Media Experience (IPMX) - Compressed Video.”. EXTERNAL
VSF TR-10–11:2024, “Internet protocol Media Experience (IPMX) - Constant Bit-Rate Compressed Video.”. EXTERNAL
VSF Codecs AG, “Review of CODEC options for AV over IP protocols in Pro-AV applications (IPMX CODECs)”. EXTERNAL
IETF RFC 9134 [Active*]
SMPTE ST 2110-22:2022 [Active]

Source Data (JSON)

Full registry record with provenance metadata. Open directly: /api/doc/10.5594-MOO-3001.json

Reference Tree

Explore all references and references to this document, as a navigable tree.

Open Reference Tree

Reference this Doc

Plain text (ISO 690 compliant)

Preview:

Tim Bruylants, Ben Runyan, and Jean-Baptiste Lorent; The new JPEG XS TDC Profile: Perfect Quality at Zero Latency, MTS 2024, Article 1 (pp. 1 to 14); SMPTE, 2024, ISBN: 978-1-61482-965-2. Available at https://doi.org/10.5594/MOO/3001

Snippet:

Tim Bruylants, Ben Runyan, and Jean-Baptiste Lorent; The new JPEG XS TDC Profile: Perfect Quality at Zero Latency, MTS 2024, Article 1 (pp. 1 to 14); SMPTE, 2024, ISBN: 978-1-61482-965-2. Available at https://doi.org/10.5594/MOO/3001

HTML (ISO 690 compliant)

Preview:

Snippet:

<span class="citation">Tim Bruylants, Ben Runyan, and Jean-Baptiste Lorent; <cite>The new JPEG XS TDC Profile: Perfect Quality at Zero Latency</cite>, MTS 2024, Article 1 (pp. 1 to 14); SMPTE, 2024, ISBN: 978-1-61482-965-2. Available at <a href="https://doi.org/10.5594/MOO/3001" target="_blank" rel="noopener">https://doi.org/10.5594/MOO/3001</a></span>

SMPTE's HTML Pub

Preview:

Snippet:

<li>
Tim Bruylants, Ben Runyan, and Jean-Baptiste Lorent; <cite id="bib-10-5594-moo-3001">The new JPEG XS TDC Profile: Perfect Quality at Zero Latency</cite>, MTS 2024, Article 1 (pp. 1 to 14); SMPTE, 2024, ISBN: 978-1-61482-965-2
<span class="doi">10.5594/MOO/3001</span>
</li>