SVMemAgent: A Streaming Video Memory Agent for Query-Agnostic Online Frame Selection

arXiv:2609.18540 · cs.CV · Submitted 2026-09-16 · Read on arXiv

cs.CV

Submitted: 2026-09-16

Updated: 2026-09-16

Terminology

• GRPO — 24× in this paper · explained in 6 episodes
• Benchmark — 14× in this paper · explained in 2 episodes
• Pseudo-labels — 8× in this paper · explained in 2 episodes
• Transformer — 5× in this paper · explained in 2 episodes
• Accuracy — 4× in this paper · explained in 1 episode
• Clustering — 4× in this paper · explained in 2 episodes
• Embeddings — 4× in this paper · explained in 2 episodes
• Ablation — 3× in this paper · explained in 1 episode
• Ablation Studies — 3× in this paper · explained in 1 episode
• Diversity-Aware Advantage Discounting — 3× in this paper
• Fine-Tuning — 3× in this paper · explained in 5 episodes
• Group Relative Policy Optimization — 3× in this paper
• Reinforcement Learning — 3× in this paper · explained in 4 episodes
• Group Relative Policy Optimization (GRPO) — 2× in this paper · explained in 5 episodes
• Verifiable Rewards — 2× in this paper · explained in 2 episodes
• alpha — 2× in this paper · explained in 1 episode
• Core — 1× in this paper · explained in 2 episodes
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Embodied AI — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Grounding — 1× in this paper · explained in 3 episodes
• Instruction Tuning — 1× in this paper · explained in 2 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Reinforcement Learning (RL) — 1× in this paper · explained in 25 episodes
• Semantic Understanding — 1× in this paper · explained in 2 episodes
• Temporal Reasoning — 1× in this paper · explained in 2 episodes
• Transferability — 1× in this paper · explained in 4 episodes

Sources

• Qwen3-VL Technical Report
• LongVILA: Scaling Long-Context Visual Language Models for Long Videos
• ViSpeak: Visual Instruction Feedback in Streaming Videos
• VideoChat-Flash: Hierarchical Compression for Long-Context Video Modeling
• StreamChat: Chatting with Streaming Video
• Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reaction
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
• DINOv3
• InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency
• TimeChat-Online: 80% Visual Tokens are Naturally Redundant in Streaming Videos
• VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding
• LLaVA-Video: Video Instruction Tuning With Synthetic Data

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models