VASC: Value-Aware Sparse Attention with Cross-Layer Memory for Efficient 3D Reconstruction

arXiv:2610.01013 · cs.CV · Submitted 2026-10-01 · Read on arXiv

cs.CV

Submitted: 2026-10-01

Updated: 2026-10-01

Code: https://github.com/kosakayamahoo-design/VASC

Terminology

• Sparsity — 26× in this paper · explained in 4 episodes
• Sparse Attention — 14× in this paper · explained in 5 episodes
• Transformer — 14× in this paper · explained in 2 episodes
• Adaptation — 11× in this paper · explained in 1 episode
• Ablation — 7× in this paper · explained in 1 episode
• Benchmark — 7× in this paper · explained in 2 episodes
• Conference on Computer Vision and Pattern Recognition — 5× in this paper
• Cosine Similarity — 4× in this paper · explained in 3 episodes
• Generalization — 3× in this paper · explained in 13 episodes
• Quantization — 3× in this paper · explained in 12 episodes
• Alignment — 2× in this paper · explained in 1 episode
• Consistency — 2× in this paper · explained in 3 episodes
• 3D Gaussian Splatting — 1× in this paper · explained in 2 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Accuracy — 1× in this paper · explained in 1 episode
• Gaussian Splatting — 1× in this paper · explained in 4 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Redundancy — 1× in this paper · explained in 2 episodes

Sources

• IndexCache: Accelerating Sparse Attention via Cross-Layer Index Reuse
• Longformer: The Long-Document Transformer
• Token Merging: Your ViT But Faster
• GHOST: Geometry-Hierarchical Online Streaming Token Eviction for Efficient 3D Reconstruction
• Generating Long Sequences with Sparse Transformers
• Not All Patches are What You Need: Expediting Vision Transformers via Token Reorganizations
• TokenLearner: What Can 8 Learned Tokens Do for Images and Videos?
• FastVGGT: Training-Free Acceleration of Visual Geometry Transformer
• Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
• InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streams

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models