Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction

arXiv:2609.21437 · cs.CV, cs.AI · Submitted 2026-09-18 · Read on arXiv

cs.CV, cs.AI

Submitted: 2026-09-18

Updated: 2026-09-18

Comments: 9 pages,4 figures

License: http://creativecommons.org/licenses/by/4.0/

The gist: We propose LoG-VGGT, a memory-efficient framework for long-sequence 3D reconstruction that balances local temporal modeling with global camera consistency.

Terminology

Abstract

We propose LoG-VGGT, a memory-efficient framework for long-sequence 3D reconstruction that balances local temporal modeling with global camera consistency. Instead of relying on full global attention, our method introduces cross-window attention at a small subset of transformer blocks, enabling effective information propagation across adjacent temporal windows while keeping memory usage bounded. To mitigate long-term pose drift, we further design a global camera consistency refinement module, where camera tokens interact with compact register tokens via cross-attention to enforce scene-level constraints across the entire sequence. This design enables joint optimization of camera representations and significantly improves long-horizon pose stability without incurring the high cost of sequence-wide attention. Extensive experiments demonstrate that LoG-VGGT achieves improved depth accuracy and robust camera pose estimation across multiple long-sequence benchmarks, while delivering competitive streaming reconstruction performance.

Related papers