ReSS: Residual-Restoring Sparse Attention for 3D Vision Transformers

arXiv:2609.35593 · cs.CV · Submitted 2026-09-28 · Read on arXiv

cs.CV

Submitted: 2026-09-28

Updated: 2026-09-28

Code: https://github.com/libary753/ReSS

Terminology

• Sparsity — 78× in this paper · explained in 4 episodes
• Sparse Attention — 28× in this paper · explained in 5 episodes
• AUC — 23× in this paper · explained in 2 episodes
• Transformer — 14× in this paper · explained in 2 episodes
• Alignment — 6× in this paper · explained in 1 episode
• KV cache — 6× in this paper · explained in 3 episodes
• Conference on Computer Vision and Pattern Recognition — 5× in this paper
• Benchmark — 4× in this paper · explained in 2 episodes
• Calibration — 3× in this paper · explained in 7 episodes
• Trace — 3× in this paper · explained in 2 episodes
• Ablation — 2× in this paper · explained in 1 episode
• Ablation study — 2× in this paper · explained in 1 episode
• Accuracy — 2× in this paper · explained in 1 episode
• Iterative Refinement — 2× in this paper · explained in 3 episodes
• Pruning — 2× in this paper · explained in 4 episodes
• AI Foundation Model — 1× in this paper · explained in 1 episode
• Attention Mechanism — 1× in this paper · explained in 3 episodes
• Clustering — 1× in this paper · explained in 2 episodes
• Combinatorial Optimization — 1× in this paper · explained in 2 episodes
• F1 Score — 1× in this paper · explained in 3 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Fisher Information — 1× in this paper · explained in 3 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• In International Conference on Machine Learning — 1× in this paper

Sources

• VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequences
• OBCache: Optimal Brain KV Cache Pruning for Efficient Long-Context LLM Inference
• SVG-EAR: Parameter-Free Linear Compensation for Sparse Video Generation via Error-aware Routing

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models