Adaptive Reward Routing: Dynamic Multi-Reward Optimization for Joint Audio-Video Diffusion via Forward-Process RL

arXiv:2609.37200 · cs.CV · Submitted 2026-09-29 · Read on arXiv

cs.CV

Submitted: 2026-09-29

Updated: 2026-09-29

Terminology

• Ablation — 13× in this paper · explained in 1 episode
• Consistency — 12× in this paper · explained in 3 episodes
• Diffusion Model — 11× in this paper · explained in 8 episodes
• Diffusion Models — 11× in this paper · explained in 6 episodes
• Aggregation — 6× in this paper · explained in 1 episode
• Reinforcement Learning — 6× in this paper · explained in 4 episodes
• GRPO — 5× in this paper · explained in 6 episodes
• Alignment — 4× in this paper · explained in 1 episode
• Transformer — 4× in this paper · explained in 2 episodes
• Ablation Studies — 3× in this paper · explained in 1 episode
• Adaptation — 3× in this paper · explained in 1 episode
• Audio Quality — 3× in this paper
• Benchmark — 3× in this paper · explained in 2 episodes
• Credit assignment — 3× in this paper · explained in 3 episodes
• Flow Matching — 3× in this paper · explained in 8 episodes
• Semantic Alignment — 3× in this paper · explained in 3 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• Gradient Flow — 2× in this paper · explained in 2 episodes
• Adam — 1× in this paper · explained in 2 episodes
• Benchmarking — 1× in this paper · explained in 4 episodes
• Evaluation Dimensions — 1× in this paper · explained in 3 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Flow Matching Model — 1× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Multi-objective Optimization — 1× in this paper · explained in 4 episodes
• Multimodal Learning — 1× in this paper · explained in 2 episodes
• Reinforcement Learning (RL) — 1× in this paper · explained in 25 episodes
• Visual Quality — 1× in this paper

Sources

• Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets
• DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
• LTX-Video: Realtime Video Latent Diffusion
• LTX-2: Efficient Joint Audio-Visual Foundation Model
• VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation
• HunyuanVideo: A Systematic Framework For Large Video Generative Models
• Wan: Open and Advanced Large-Scale Video Generative Models
• UniVerse-1: Unified Audio-Video Generation via Stitching of Experts
• DanceGRPO: Unleashing GRPO on Visual Generation
• ShotVerse: Advancing Cinematic Camera Control for Text-Driven Multi-Shot Video Creation
• EvalVerse: Pipeline-Aware and Expert-Calibrated Benchmarking for Professional Cinematic Video Generation
• OmniNFT: Modality-wise Omni Diffusion Reinforcement for Joint Audio-Video Generation
• MARBLE: Multi-Aspect Reward Balance for Diffusion RL
• DiffusionNFT: Online Diffusion Reinforcement with Forward Process

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models