Token-Level Video Reinforcement Learning

arXiv:2610.01973 · cs.CV · Submitted 2026-10-01 · Read on arXiv

cs.CV

Submitted: 2026-10-01

Updated: 2026-10-01

Terminology

• GRPO — 83× in this paper · explained in 6 episodes
• Ablation — 13× in this paper · explained in 1 episode
• Alignment — 11× in this paper · explained in 1 episode
• Reinforcement Learning — 10× in this paper · explained in 4 episodes
• Diffusion Model — 7× in this paper · explained in 8 episodes
• Diffusion Models — 7× in this paper · explained in 6 episodes
• Aggregation — 5× in this paper · explained in 1 episode
• Token-Level Video Reinforcement Learning — 5× in this paper
• Transformer — 3× in this paper · explained in 2 episodes
• Credit assignment — 2× in this paper · explained in 3 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Flow Matching — 2× in this paper · explained in 7 episodes
• Generative Model — 2× in this paper · explained in 2 episodes
• Generative Models — 2× in this paper · explained in 2 episodes
• Group Relative Policy Optimization — 2× in this paper
• KL Regularization — 2× in this paper · explained in 2 episodes
• Regularization — 2× in this paper · explained in 3 episodes
• Semantic Alignment — 2× in this paper · explained in 3 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Adam — 1× in this paper · explained in 2 episodes
• Benchmark — 1× in this paper · explained in 2 episodes
• Consistency — 1× in this paper · explained in 3 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• GRPO Objective — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Generative Modeling — 1× in this paper · explained in 3 episodes
• Group Relative Policy Optimization (GRPO) — 1× in this paper · explained in 5 episodes
• Latent Diffusion Model — 1× in this paper · explained in 2 episodes
• Latent Diffusion Models — 1× in this paper · explained in 2 episodes
• Pairwise Comparisons — 1× in this paper · explained in 2 episodes
• Reinforcement Learning (RL) — 1× in this paper · explained in 24 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Temporal consistency — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes

Sources

• Qwen2.5-VL Technical Report
• Directly Fine-Tuning Diffusion Models on Differentiable Rewards
• DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
• Improving Dynamic Object Interactions in Text-to-Video Generation with AI Feedback
• VideoScore2: Think before You Score in Generative Video Evaluation
• HunyuanVideo: A Systematic Framework For Large Video Generative Models
• TeleBoost: A Systematic Alignment Framework for High-Fidelity, Controllable, and Robust Video Generation
• Flow-GRPO: Training Flow Matching Models via Online RL
• Improving Video Generation with Human Feedback
• Seeing What Matters: Visual Preference Policy Optimization for Visual Generation
• Movie Gen: A Cast of Media Foundation Models
• Aligning Text-to-Image Diffusion Models with Reward Backpropagation
• Video Diffusion Alignment via Reward Gradients
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
• Wan: Open and Advanced Large-Scale Video Generative Models
• Harness Local Rewards for Global Benefits: Effective Text-to-Video Generation Alignment with Patch-level Reward Models
• Unified Reward Model for Multimodal Understanding and Generation
• Diffusion-DRF: Free, Rich, and Differentiable Reward for Video Diffusion Fine-Tuning
• HunyuanVideo 1.5 Technical Report
• DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Models

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models