The new JPEG XS TDC Profile: Perfect Quality at Zero Latency

Tim Bruylants, Ben Runyan, Jean-Baptiste Lorent

The 3rd edition of JPEG XS introduces the new Temporal Differential Coding (TDC) profile that adds a temporal differential coding technique on top of XS High to further improve the compression efficiency. TDC adds a temporal prediction block in the wavelet domain that uses a single frame buffer. By doing so, TDC can drastically reduce the correlation of the wavelet coefficients between successive video frames, especially for (semi-)static regions. Because TDC uses deterministic in-place differential coding, there is also no need for motion compensation or other complex algorithms. Thus, it still preserves the original and unique features of JPEG XS: lightweight fast compression with low latency of a few lines, near-lossless quality, low complexity, and low power. Experiments show that TDC works particularly well for graphics, e-sports, gaming, and complex desktop in video sequences, safeguarding details and sharp edges better than ever before, with PSNR improvements of 10 dB or more. On high-motion or fast-changing content, TDC natively falls back to the same performance that is offered by XS High. Like all the XS profiles, TDC facilitates all relevant platforms by design, being CPU, GPU, FPGA and ASIC, making it applicable as the true professional mezzanine video codec in all media and AV workflows. TDC ensures a safe and compatible upgrade path for existing XS ecosystems. This paper explains TDC technically and demonstrates the compression performance improvements, while also showing how latency is not impacted at all and how complexity is kept under control.

Published
2024-10-21
Content type
Original Research
Keywords
jpeg, xs, video compression, low complexity, low latency, visually lossless, low power, open standard, tdc
DOI
10.5594/MOO/3001
ISBN
978-1-61482-965-2