TTTIR: Unlocking Instance-Specific State Evolution via Test-Time Training for Image Restoration
eess.IV, cs.AI, cs.CV, cs.MM
Submitted: 2026-09-15
Updated: 2026-09-15
Comments: TL;DR: TTTIR improves image restoration by framing it as an instance-specific state evolution process. Powered by Test-Time Training (TTT), it dynamically adapts operators to handle real-world degradations, outperforming state-of-the-art models with scalable efficiency. 11 pages, 6 figures, 6 tables
Code: https://github.com/Elysiaaaaaaaa/TTTIR
License: http://creativecommons.org/licenses/by/4.0/
The gist: Image restoration is inherently challenging due to the diverse and highly input-dependent nature of real-world degradations.
Terminology
Abstract
Image restoration is inherently challenging due to the diverse and highly input-dependent nature of real-world degradations. While recent architectures like Transformers and state-space models have advanced the field, they predominantly rely on static, globally shared parameters, which struggle to fully accommodate instance-specific degradation patterns. Test-Time Training (TTT) offers a promising paradigm for generating data-dependent operators, yet its standard self-supervised inner loop lacks the explicit guidance required to transition degraded features toward clean structures. To address this, we propose TTTIR, a novel framework that reformulates image restoration as an instance-specific state evolution process. Specifically, we design Progressive State Sequence Generation (PSSG) to construct complementary spatial-frequency target states (defining what to recover), and State Transition Evolution (STE) to adapt lightweight transition operators via a restoration-oriented TTT inner loop (determining how the features should evolve). Extensive experiments demonstrate that TTTIR consistently outperforms state-of-the-art models across multiple image restoration benchmarks, achieving dynamic instance-specific recovery with favorable computational scalability. The code is available at https://github.com/Elysiaaaaaaaa/TTTIR.git.
Sources
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Test-Time Training with Masked Autoencoders
- Progressive Split Mamba: Effective State Space Modelling for Image Restoration
- Magic ELF: Image Deraining Meets Association Learning and Transformer
- Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement
- Moir'eXNet: Adaptive Multi-Scale Demoir'eing with Linear Attention Test-Time Training and Truncated Flow Matching Prior
- Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Training
- MixDehazeNet : Mix Structure Block For Image Dehazing Network
- Learning to (Learn at Test Time): RNNs with Expressive Hidden States
- Test-Time Training Done Right
Related papers
- Revisiting Integration of Image and Metadata for DICOM Series Classification: Cross-Attention and Dictionary Learning
- VesselSDF: Distance Field Priors for Vascular Network Reconstruction
- cSVR: Convolutional Slice-to-Volume Reconstruction
- NAIMA: Semantics Aware RGB Guided Depth Super-Resolution
- AneumoBench: A Source-Linked Benchmark for Synthetic-Geometry Transfer in Aneurysm CFD
- RETO: A Rotary-Enhanced Transformer Operator for High-Fidelity Prediction of Automotive Aerodynamics