Long Story Short: Story-level Video Understanding from 20K Short Films

arXiv:2406.10221 · cs.CV, cs.AI, cs.CL · Submitted 2024-06-14 · Read on arXiv

cs.CV, cs.AI, cs.CL

Submitted: 2024-06-14

Updated: 2026-08-28

Code: https://github.com/Breakthrough/PySceneDetect

Project page: https://ridouaneg.github.io/sf20k.html

Terminology

Accuracy — 31× in this paper · explained in 1 episode
Benchmark — 26× in this paper · explained in 2 episodes
Instruction Tuning — 15× in this paper · explained in 2 episodes
Open-Ended Question Answering — 7× in this paper
Transformer — 7× in this paper · explained in 2 episodes
Multiple-Choice Question Answering — 6× in this paper
Ablation — 4× in this paper · explained in 1 episode
Actor — 3× in this paper · explained in 3 episodes
Alignment — 2× in this paper · explained in 1 episode
Foundation Model — 2× in this paper · explained in 3 episodes
Grounding — 2× in this paper · explained in 3 episodes
Temporal Reasoning — 2× in this paper · explained in 2 episodes
Abundance — 1× in this paper · explained in 1 episode
Causal Reasoning — 1× in this paper · explained in 2 episodes
Edge AI — 1× in this paper · explained in 2 episodes
Embeddings — 1× in this paper · explained in 2 episodes
Feature Extraction — 1× in this paper · explained in 2 episodes
Fine-Tuning — 1× in this paper · explained in 5 episodes
Foundation Models — 1× in this paper · explained in 7 episodes
Multimodal Reasoning — 1× in this paper · explained in 5 episodes
Regret — 1× in this paper · explained in 3 episodes
Tokenization — 1× in this paper · explained in 2 episodes
Vision-Language Models (VLMs) — 1× in this paper · explained in 6 episodes
alpha — 1× in this paper · explained in 1 episode

Related papers