InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video

arXiv:2609.35743 · cs.CV · Submitted 2026-09-28 · Read on arXiv

cs.CV

Submitted: 2026-09-28

Updated: 2026-09-28

Project page: https://infinihand.github.io

Terminology

• Alignment — 9× in this paper · explained in 1 episode
• Transformer — 8× in this paper · explained in 2 episodes
• Accuracy — 7× in this paper · explained in 1 episode
• Benchmark — 5× in this paper · explained in 2 episodes
• Feed-forward framework — 5× in this paper · explained in 2 episodes
• Generalization — 5× in this paper · explained in 13 episodes
• Ablation — 3× in this paper · explained in 1 episode
• Consistency — 3× in this paper · explained in 3 episodes
• Fidelity — 3× in this paper · explained in 2 episodes
• Foundation Model — 3× in this paper · explained in 3 episodes
• Generative AI — 3× in this paper · explained in 2 episodes
• Two-stage training — 3× in this paper · explained in 2 episodes
• Ablation study — 2× in this paper · explained in 1 episode
• Decode — 2× in this paper · explained in 2 episodes
• Gaussian Splatting — 2× in this paper · explained in 4 episodes
• Loss Function — 2× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Computational overhead — 1× in this paper · explained in 2 episodes
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Decoupling — 1× in this paper · explained in 2 episodes
• Diffusion Model — 1× in this paper · explained in 8 episodes
• Diffusion Models — 1× in this paper · explained in 6 episodes
• Feature Extraction — 1× in this paper · explained in 2 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Geometric Context Attention — 1× in this paper
• Grounding — 1× in this paper · explained in 3 episodes
• Multimodal Dataset — 1× in this paper · explained in 2 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Segmentation Masks — 1× in this paper · explained in 2 episodes
• Sparsity — 1× in this paper · explained in 4 episodes
• Temporal consistency — 1× in this paper · explained in 2 episodes
• Two-Stage Training Strategy — 1× in this paper · explained in 3 episodes

Sources

• Geometric Context Transformer for Streaming 3D Reconstruction
• Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mamba
• EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Video
• Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimation
• Sapiens2
• EgoWAM: World Action Models Beyond Pixels with In-the-Wild Egocentric Human Data
• EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Tasks
• OmniHands: Towards Robust 4D Hand Mesh Recovery via A Versatile Transformer
• VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifold
• Bringing Inputs to Shared Domains for 3D Interacting Hands Recovery in the Wild
• MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priors
• WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wild
• 3D Hand Pose Estimation in Everyday Egocentric Images
• EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World
• M^3: Dense Matching Meets Multi-View Foundation Models for Monocular Gaussian Splatting SLAM
• The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction
• Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Image
• HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videos
• LoGeR: Long-Context Geometric Reconstruction with Hybrid Memory

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models