Towards Automatic Video Annotation with ASH: Zero-Shot Open-Vocabulary Multi-Object Tracking and Segmentation

arXiv:2610.01022 · cs.CV · Submitted 2026-10-01 · Read on arXiv

cs.CV

Submitted: 2026-10-01

Updated: 2026-10-01

Terminology

• Benchmark — 42× in this paper · explained in 2 episodes
• Instance Segmentation — 21× in this paper · explained in 3 episodes
• Grounding — 14× in this paper · explained in 3 episodes
• Accuracy — 11× in this paper · explained in 1 episode
• Consistency — 11× in this paper · explained in 3 episodes
• Annotation and Segmentation Handler — 9× in this paper
• Generalized Presence Token — 9× in this paper
• Computer Vision and Pattern Recognition — 8× in this paper
• Fine-Tuning — 8× in this paper · explained in 5 episodes
• Model-Agnostic — 8× in this paper · explained in 2 episodes
• Generalization — 7× in this paper · explained in 13 episodes
• Multi-Object Tracking and Segmentation — 6× in this paper
• Multiple Object Tracking — 5× in this paper
• Alignment — 4× in this paper · explained in 1 episode
• Core — 4× in this paper · explained in 2 episodes
• Segmentation Masks — 4× in this paper · explained in 2 episodes
• Transformer — 3× in this paper · explained in 2 episodes
• Video Object Segmentation — 3× in this paper
• Ablation — 2× in this paper · explained in 1 episode
• Adaptation — 2× in this paper · explained in 1 episode
• Decoupling — 2× in this paper · explained in 2 episodes
• Embeddings — 2× in this paper · explained in 2 episodes
• Generative AI — 2× in this paper · explained in 2 episodes
• Memory-attention-based Video Instance Segmentation — 2× in this paper
• Vision-Language Models (VLMs) — 2× in this paper · explained in 6 episodes
• World Model — 2× in this paper · explained in 7 episodes
• Zero-Shot Generalization — 2× in this paper · explained in 5 episodes
• Active Learning — 1× in this paper · explained in 6 episodes
• Aggregation — 1× in this paper · explained in 1 episode
• Data Augmentation — 1× in this paper · explained in 7 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Fidelity — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Higher Order Tracking Accuracy — 1× in this paper
• Pruning — 1× in this paper · explained in 4 episodes
• Pseudo-labeling — 1× in this paper · explained in 3 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Self-Supervised Learning — 1× in this paper · explained in 8 episodes
• Training-Free Framework — 1× in this paper · explained in 2 episodes
• Winter Conference on Applications of Computer Vision — 1× in this paper

Sources

• MOT20: A benchmark for multi object tracking in crowded scenes
• SAM2Auto: Auto Annotation Using FLASH
• Qwen3-VL Technical Report
• Perception Encoder: The best visual embeddings are not at the output of the network
• Addressable Memory for Video World Models
• MOT16: A Benchmark for Multi-Object Tracking
• Seg2Track-SAM2: SAM2-based Multi-object Tracking and Segmentation

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models