WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression

summary

Video file (mp4)

The gist

The gist The proposed WaveLLM framework introduces a wavelet-domain LLM entropy model for lossless image compression, demonstrating superior performance across three benchmarks compared to existing

In short

WaveLLM proposes a wavelet-domain Large Language Model (LLM) approach for lossless image compression. It decomposes images into structured wavelet subbands to simplify prediction, then uses a shared LLM with task-adaptive prompting to model entropy across these subbands. This method achieves competitive or superior lossless compression rates on three benchmarks.

Key concepts

Wavelet-Domain Decomposition
The image is broken down into multiple wavelet subbands using a fixed transform. This converts the complex, mixed signal of an image into several simpler, more statistically consistent prediction problems. Coding proceeds by predicting the deepest band first and using its result to reconstruct the next shallower band.
Numerical Interface
This component connects the continuous wavelet coefficients to the LLM's text-based token space. It maps integer wavelet values into a local symbol space, adds trainable embeddings, and uses a prediction head to estimate these values. This ensures that numerical data is processed alongside language semantics effectively.
Task-Adaptive Prompting
Instead of training separate models for every subband, WaveLLM uses one shared LLM. A specific text prompt describes the current subband's statistical properties and context, allowing the single model to adapt its probability estimation strategy optimally for that specific band.

Terminology used across episodes

This episode discusses

The paper

WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression · Read on arXiv

Yue Yu, Bowei Kang, Changsheng Gao, Dong Liu, Xiaoyan Sun

University of Science and Technology of China · Nanyang Technological University Singapore

Lossless image compression fundamentally relies on accurate entropy modeling, driving a recent shift toward large language model (LLM)-based methods. However, existing approaches mainly emphasize the modeling capacity of LLMs while directly serializing images into pixel or residual sequences, leaving heterogeneous signal patterns entangled within a single prediction stream. In this paper, we argue that effective entropy modeling depends not only on model capacity, but also on the predictability of the input representation. Motivated by this insight, we propose WaveLLM, a wavelet-domain LLM-based entropy model for lossless image compression. By decomposing an image into multi-level wavelet subbands, WaveLLM converts a heterogeneous prediction problem into a set of more structured and statistically homogeneous subproblems that are more amenable to autoregressive probability estimation. To bridge numerical coding symbols with the LLM's native text token space, we introduce a dedicated numerical interface featuring value embeddings and a coefficient prediction head. Furthermore, a task-adaptive prompting strategy is designed to enable a single shared model to adapt to diverse subbands within a unified framework. Built on Llama-3.2-3B with LoRA adaptation, WaveLLM achieves 2.51, 2.24, and 2.27 bpsp on Kodak, CLIC.pro, and DIV2K, respectively, outperforming the PixelCNN-based codec using the same wavelet transform by 0.43, 0.36, and 0.46 bpsp, and surpassing recent LLM-based lossless compressors on all three benchmarks.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression".

Jane: The gist The proposed WaveLLM framework introduces a wavelet-domain LLM entropy model for lossless image compression, demonstrating superior performance across three benchmarks compared to existing methods.

Tom: First, who's behind it and why it matters.

Paper summary: Jane: So to wrap up this talk on WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression, the core message is that you need a structured input for an LLM entropy model to perform well. They proved that by using wavelet decomposition, you turn one hard problem into several simpler ones.

Tom: And they showed that this structured approach works because it allows the same shared LLM backbone to adapt its statistical understanding to different parts of the image based on task prompts. The performance numbers—two point five one, two point two four, and two point two seven bpsp on Kodak, CLIC.pro, and DIV2K—show it’s a competitive method for lossless coding rates right now compared to other LLM approaches > Page three — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al <ref:2610.22232#pg1>.

Lu: The authors confirm that wavelet subbands provide a more suitable representation for LLM-based probability modeling than the flat pixel and residual sequences they tested > Page two — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al <ref:2610.22232#pg1>.

Meng: From what I’ve seen so far, the main hurdle for deployment is making sure that this task-adaptive prompting strategy doesn't introduce too much overhead when running continuously on live traffic.

Tom: The authors also point out that they plan to look at distillation and quantization in future work to address that practical side of things > Page three — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al <ref:2610.22232#pg1>.

Jane: It sounds like this paper shows a path forward by combining a numerical interface for the LLM and task prompts to handle the complexity of image signals in a way that actually improves prediction accuracy > Page one — WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression <ref:2610.22232#pg1,WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression>

Conclusion: Tom: So, WaveLLM is about using wavelet decomposition to make large language models better at lossless image compression > Page one — WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression

Jane: It’s basically taking an image, breaking it down into wavelet pieces, and feeding those pieces into an LLM instead of just feeding the raw pixels one by one. But why that specific math structure?

Lu: The core idea is that a single sequence of pixels is really messy, with all these different statistical patterns tangled up in there > Page five — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Meng: So the paper claims that this decomposition turns one huge prediction problem into a bunch of smaller ones that are easier for an autoregressive model to handle > Page four — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Tom: Exactly. They’re not just throwing more parameters at the LLM; they’re changing the input format so the model doesn't have to learn an impossible amount of noise simultaneously > Page five — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Jane: And how do they actually connect those wavelet coefficients—which are just numbers—to the LLM’s language-like tokens? That seems like a huge engineering hurdle > Page six — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Lu: They introduced a numerical interface that maps those coefficients into local value IDs and gives them embeddings so the LLM treats them like text > Page seven — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Meng: That mapping is what lets the model learn something new about the structure of the image data rather than just memorizing pixel sequences > Page seven — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Tom: The results are pretty concrete too. they’re showing rates of two point five one bpsp on Kodak and other benchmarks > Page three — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Jane: That's good to see. So what does this mean for someone who just listens to the show? It means that in the world of lossless compression right now, using a structured representation like wavelets is actually giving LLMs an edge over just looking at raw pixel data > Page one — WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression

Lu: It suggests that for complex signals, reorganizing the input structure to be more statistically regular really helps the probability estimation part of the AI model work better > Page two — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Meng: The authors also mentioned they're still working on making sure this thing runs smoothly when you try to deploy it in a real production environment > Page three — WaveLLM MM ’twenty-six November ten–fourteen two thousand twenty-six Rio de Janeiro, Brazil Yue Yu et al.

Tom: Right. So we've seen the mechanics and the numbers behind WaveLLM. next up we're going to look at what this means for real-world image compression systems and where they might go next > Page one — WaveLLM: Wavelet-Domain LLM Entropy Modeling for Lossless Image Compression

More episodes

← Home