NEST: Narrative Event Structures in Time for Long Video Understanding

arXiv:2606.19706 · cs.CV, cs.CL · Submitted 2026-06-18 · Read on arXiv

cs.CV, cs.CL

Submitted: 2026-06-18

Updated: 2026-09-05

Comments: EMNLP 2026 (Main)

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Benchmark — 40× in this paper · explained in 2 episodes
• Grounding — 25× in this paper · explained in 3 episodes
• Event Argument Extraction — 20× in this paper
• Event Relation Extraction — 20× in this paper
• Event Trigger Detection — 20× in this paper
• Audio Description — 18× in this paper
• Event Extraction — 16× in this paper
• Abstraction — 9× in this paper · explained in 1 episode
• Accuracy — 8× in this paper · explained in 1 episode
• Consistency — 8× in this paper · explained in 3 episodes
• Fine-Tuning — 8× in this paper · explained in 5 episodes
• Temporal Reasoning — 8× in this paper · explained in 2 episodes
• Verification — 8× in this paper · explained in 2 episodes
• LLM-as-a-Judge — 7× in this paper · explained in 3 episodes
• Adam — 5× in this paper · explained in 2 episodes
• Semantic Similarity — 5× in this paper · explained in 2 episodes
• Alignment — 3× in this paper · explained in 1 episode
• Failure Modes — 3× in this paper · explained in 3 episodes
• Foundation Model — 3× in this paper · explained in 3 episodes
• Foundation Models — 3× in this paper · explained in 7 episodes
• Ontology — 3× in this paper · explained in 2 episodes
• Adaptation — 2× in this paper · explained in 1 episode
• Benchmarking — 2× in this paper · explained in 3 episodes
• Conference on Computer Vision and Pattern Recognition — 2× in this paper
• Downstream Tasks — 2× in this paper · explained in 2 episodes
• Elias — 2× in this paper · explained in 2 episodes
• Error Taxonomy — 2× in this paper · explained in 2 episodes
• Hallucination — 2× in this paper · explained in 3 episodes
• Instruction Tuning — 2× in this paper · explained in 2 episodes
• Annotator Agreement — 1× in this paper · explained in 1 episode
• Core — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Empirical Methods in Natural Language Processing — 1× in this paper
• F1 Score — 1× in this paper · explained in 3 episodes
• Feature Extraction — 1× in this paper · explained in 2 episodes
• Few-Shot Learning — 1× in this paper · explained in 4 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Knowledge Graph — 1× in this paper · explained in 7 episodes
• Knowledge graphs — 1× in this paper · explained in 2 episodes
• LLM judge — 1× in this paper · explained in 2 episodes
• LoRA Fine-Tuning — 1× in this paper · explained in 3 episodes
• Multimodal Inputs — 1× in this paper · explained in 2 episodes
• Positional Bias — 1× in this paper · explained in 2 episodes
• Scaffolding — 1× in this paper · explained in 3 episodes
• Self-Supervised Learning — 1× in this paper · explained in 7 episodes
• Semantic Understanding — 1× in this paper · explained in 2 episodes
• Vision-Language Models (VLMs) — 1× in this paper · explained in 6 episodes
• Visual Grounding — 1× in this paper · explained in 2 episodes

Sources

• Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone
• InfiniBench: A Benchmark for Large Multi-Modal Models in Long-Form Movies and TV Shows
• Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
• Qwen2.5-VL Technical Report
• LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks
• Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models
• Event Extraction by Answering (Almost) Natural Questions
• CLAP: Learning Audio Concepts From Natural Language Supervision
• Joint Multimedia Event Extraction from Video and Article
• Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis
• ReXTime: A Benchmark Suite for Reasoning-Across-Time in Videos
• Grounded Multi-Hop VideoQA in Long-Form Egocentric Videos
• Extending Context Window of Large Language Models via Positional Interpolation
• The Llama 3 Herd of Models
• Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilities
• A Survey on LLM-as-a-Judge
• FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness
• RULER: What's the Real Context Size of Your Long-Context Language Models?
• LoRA: Low-Rank Adaptation of Large Language Models
• Visual Instruction Tuning

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models