Agentic Video Understanding: A Survey

arXiv:2609.31713 · cs.CV, cs.AI · Submitted 2026-09-21 · Read on arXiv

cs.CV, cs.AI

Submitted: 2026-09-21

Updated: 2026-09-21

Code: https://github.com/DXY0711/Awesome-Agentic-Video-Understanding

Terminology

• Benchmark — 37× in this paper · explained in 2 episodes
• Grounding — 32× in this paper · explained in 3 episodes
• Sparsity — 32× in this paper · explained in 4 episodes
• Conference on Computer Vision and Pattern Recognition — 19× in this paper
• Reinforcement Learning — 13× in this paper · explained in 4 episodes
• Trace — 12× in this paper · explained in 2 episodes
• RAG — 7× in this paper · explained in 3 episodes
• Fine-Tuning — 6× in this paper · explained in 5 episodes
• Verification — 6× in this paper · explained in 2 episodes
• Abstraction — 5× in this paper · explained in 1 episode
• International Conference on Computer Vision — 4× in this paper
• Supervised Fine-Tuning — 4× in this paper
• World Model — 4× in this paper · explained in 7 episodes
• Alignment — 3× in this paper · explained in 1 episode
• Distillation — 3× in this paper · explained in 2 episodes
• Foundation Model — 3× in this paper · explained in 3 episodes
• Foundation Models — 3× in this paper · explained in 7 episodes
• GRPO — 3× in this paper · explained in 6 episodes
• Multi-Agent Framework — 3× in this paper · explained in 3 episodes
• Multi-Agent System — 3× in this paper · explained in 6 episodes
• Reasoning Traces — 3× in this paper · explained in 3 episodes
• Accuracy — 2× in this paper · explained in 1 episode
• Agent Memory — 2× in this paper · explained in 1 episode
• Agentic Search — 2× in this paper · explained in 1 episode
• Agentic System — 2× in this paper · explained in 2 episodes
• Hallucination — 2× in this paper · explained in 4 episodes
• Reinforcement Learning (RL) — 2× in this paper · explained in 25 episodes
• Supervised Fine-Tuning (SFT) — 2× in this paper · explained in 8 episodes
• Verifiable Rewards — 2× in this paper · explained in 2 episodes
• Active Perception — 1× in this paper · explained in 2 episodes
• Adversarial Robustness — 1× in this paper · explained in 3 episodes
• Agentic AI — 1× in this paper · explained in 1 episode
• Agentic Approaches — 1× in this paper · explained in 1 episode
• Agentic Reasoning — 1× in this paper · explained in 1 episode
• Agentic Task — 1× in this paper · explained in 1 episode
• Agentic Tasks — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 4 episodes
• Causal Reasoning — 1× in this paper · explained in 2 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Core — 1× in this paper · explained in 2 episodes
• Credit assignment — 1× in this paper · explained in 3 episodes
• Decoupling — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• Modularity — 1× in this paper · explained in 9 episodes
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• Optical Character Recognition — 1× in this paper
• Optical Flow — 1× in this paper · explained in 2 episodes
• Provenance — 1× in this paper · explained in 4 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Task Decomposition — 1× in this paper · explained in 2 episodes
• Temporal Reasoning — 1× in this paper · explained in 2 episodes
• Verifier — 1× in this paper · explained in 2 episodes
• Vision-language models — 1× in this paper · explained in 2 episodes
• Visual Grounding — 1× in this paper · explained in 2 episodes

Sources

• VideoAgent2: Enhancing the LLM-Based Agent System for Long-Form Video Understanding by Uncertainty-Aware CoT
• AViLA: Asynchronous Vision-Language Agent for Streaming Multimodal Data Interaction
• Thinking in Streaming Video
• Foundation Models for Video Understanding: A Survey
• VideoAgentTrek: Computer Use Pretraining from Unlabeled Videos
• Mobile-Agent-V: A Video-Guided Approach for Effortless and Efficient Operational Knowledge Injection in Mobile Automation
• Hierarchical Long Video Understanding with Audiovisual Entity Cohesion and Agentic Search
• Agentic Video Intelligence: A Flexible Framework for Advanced Video Exploration and Understanding
• Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge
• Memory-efficient Streaming VideoLLMs for Real-time Procedural Video Understanding
• MR. Video: "MapReduce" is the Principle for Long Video Understanding
• An Efficient Streaming Video Understanding Framework with Agentic Control
• Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memory
• VideoExplorer: Think With Videos For Agentic Long-Video Understanding
• FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
• Video-MTR: Reinforced Multi-Turn Reasoning for Long Video Understanding
• VideoBrain: Learning Adaptive Frame Sampling for Long Video Understanding
• Native Active Perception as Reasoning for Omni-Modal Understanding
• VideoSEAL: Mitigating Evidence Misalignment in Agentic Long Video Understanding by Decoupling Answer Authority
• Agent-based Video Trimming

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models