RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation

summary

The gist

The gist: RestoRect proposes a novel Latent Rectified Flow Feature Distillation method for restoring degraded images by reformulating knowledge distillation as a generative process through latent

In short

RestoRect proposes a new method called Latent Rectified Flow Feature Distillation to restore degraded images. It combines Retinex decomposition with learnable diffusion constraints and trigonometric color space polarization. The student network learns to synthesize high-quality features by following learned trajectories in latent space, leading to faster convergence and better restoration quality across various image tasks.

Key concepts

Latent Rectified Flow: This is a generative process where the student network learns to create teacher-quality features by moving along specific paths (trajectories) in a compressed, lower-dimensional latent space. Instead of just matching static features, the flow allows the student to synthesize complex features dynamically based on learned velocity predictions.
Feature Layer Extraction (FLEX) Loss: This loss function ensures robust knowledge transfer between different network architectures. It works by cross-normalizing the teacher and student features using statistics derived from the student network itself, combined with percentile-based outlier detection to align their feature distributions effectively.
Anisotropic Diffusion Constraint: This constraint enforces structural consistency in the restored image. It uses a mathematical operator that calculates how much an image structure should change based on its gradients, allowing the model to maintain sharp details and correct artifacts during the restoration process.
Trigonometric Color Space Polarization: This technique is used to handle color discontinuities, particularly red ones. By transforming the image into a polarized color space using trigonometric parameters, the model can better distinguish between different color components and eliminate unnatural red streaks in the final output.

Terminology used across episodes

Reinforcement Learning (RL) — explained in 25 episodes
Retrieval-Augmented Generation (RAG) — explained in 21 episodes
Sample Complexity — explained in 20 episodes
Flow Matching — explained in 19 episodes
Quantum Fisher Information (QFI) — explained in 19 episodes
Federated Learning — explained in 17 episodes

This episode discusses

The paper

RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation · Read on arXiv

Shourya Verma, Mengbo Wang, Ananth Grama, Nadia Atallah Lanman

Department of Computer Science, Purdue University, USA

Current approaches for restoration of degraded images face a trade-off: high-performance models are slow for practical use, while fast models produce poor results. Knowledge distillation transfers teacher knowledge to students, but existing static feature matching methods cannot capture how modern transformer architectures dynamically generate features. We propose a novel Latent Rectified Flow Feature Distillation method for restoring degraded images called'RestoRect'. We apply rectified flow to reformulate feature distillation as a generative process where students learn to synthesize teacher-quality features through learnable trajectories in latent space. Our framework combines Retinex decomposition with learnable anisotropic diffusion constraints, and trigonometric color space polarization. We introduce a Feature Layer Extraction loss for robust knowledge transfer between different network architectures through cross-normalized transformer feature alignment with percentile-based outlier detection. RestoRect achieves better training stability, and faster convergence and inference while preserving restoration quality, demonstrating superior results across 15 image restoration datasets, covering 4 tasks, on 10 metrics against baselines.

Transcript

Introduction to the show: ident: AI Radio. Generated commentary on the latest Artificial Intelligence papers.

Tom: We're looking at the paper: "RestoRect: Degraded Image Restoration via Latent Rectified Flow & Feature Distillation".

Jane: Here's the gist of the paper. The gist: RestoRect proposes a novel Latent Rectified Flow Feature Distillation method for restoring degraded images by reformulating knowledge distillation as a generative process through latent rectified flow.

Jane: The framework combines Retinex decomposition with learnable anisotropic diffusion constraints and trigonometric color space polarization to eliminate artifacts and boost restoration quality.

Paper summary: Jane: So, we’ve looked at how they did it in "RestoRect: Degraded Image Restoration via Latent Rectified Flow and Feature Distillation," and now we need to talk about what this paper actually is called and what it means for the field.

Tom: It basically takes those big transformer models that are way too slow for real-time use and teaches a smaller student model how to do the same thing really fast, by using this new flow matching idea.

Lu: The core idea is that instead of just copying pixel values or static features, the student learns a path in some latent space. This path connects pure noise to the target restored image features.

Meng: So, what does that mean for deployment? If we can distill those complex teacher models into something faster, it could actually change how quickly we can process images at scale.

Lalam: I’m looking at the results on LOL-v2 and LSUI, where they beat a baseline by one point seven six decibels in PSNR for low-light tasks; that's concrete performance data right there.

Tom: Concrete is good, Lalam, but what about the limitations? Is this flow matching stuff going to be too heavy when we put it into production pipelines?

Jane: Well, the authors mention they used a two-stage training process and some auxiliary constraints like anisotropic diffusion and color space polarization; that’s how they keep things stable during the distillation phase.

Lu: The whole point of using rectified flow is to turn feature distillation into a generative process where we are learning trajectories, which is more dynamic than just matching fixed points between the teacher and student features.

Meng: And from an engineering standpoint, if the training is more stable, that means less time debugging the student network during fine-tuning. That’s a real win for production teams.

Lalam: I'm confident in what they show on those fifteen datasets covering low-light, underwater, and fundus enhancement tasks; they showed solid gains across the board.

Tom: It sounds like this method is really about making the knowledge transfer smarter, not just faster. Where does this leave us when we think about building systems that need to restore images quickly?

Conclusion: Jane: So we’re wrapping up this look at "RestoRect: Degraded Image Restoration via Latent Rectified Flow and Feature Distillation."

Tom: Basically, this paper tackles that slow versus fast problem in image restoration by using a new flow matching idea to transfer knowledge from big teacher models to smaller student ones.

Lu: The core concept is that instead of just copying static features, the student learns a dynamic path in latent space connecting noise to the target image features.

Meng: This could mean we can actually run high-quality restoration on devices with less power than we thought possible because the model gets much lighter and faster.

Lalam: The paper shows solid gains across fifteen datasets covering low-light, underwater, and fundus enhancement tasks.

Tom: So this method makes the knowledge transfer smarter by modeling it as a generative process instead of just a static feature match. Where does this leave us when we think about building systems that need to restore images quickly?

More episodes

← Home