VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generation

arXiv:2608.18607 · cs.CV · Submitted 2026-08-19 · Read on arXiv

cs.CV

Submitted: 2026-08-19

Updated: 2026-09-26

Code: https://github.com/ShareLab-SII/VA-Judger

Terminology

• Alignment — 27× in this paper · explained in 1 episode
• Consistency — 22× in this paper · explained in 3 episodes
• Reinforcement Learning — 17× in this paper · explained in 4 episodes
• GRPO — 14× in this paper · explained in 6 episodes
• Accuracy — 9× in this paper · explained in 1 episode
• Benchmark — 7× in this paper · explained in 2 episodes
• Fine-Tuning — 6× in this paper · explained in 5 episodes
• Structured Reasoning — 4× in this paper · explained in 3 episodes
• Conference on Computer Vision and Pattern Recognition — 3× in this paper
• Distillation — 3× in this paper · explained in 2 episodes
• Foundation Model — 3× in this paper · explained in 3 episodes
• Diffusion Model — 2× in this paper · explained in 8 episodes
• Diffusion Models — 2× in this paper · explained in 6 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Generative Model — 2× in this paper · explained in 2 episodes
• Generative Models — 2× in this paper · explained in 2 episodes
• Grounding — 2× in this paper · explained in 3 episodes
• Reward Hacking — 2× in this paper · explained in 8 episodes
• Adam — 1× in this paper · explained in 2 episodes
• Adaptation — 1× in this paper · explained in 1 episode
• Aggregation — 1× in this paper · explained in 1 episode
• CVF International Conference on Computer Vision — 1× in this paper
• Calibration — 1× in this paper · explained in 7 episodes
• Chain-of-Thought Prompting — 1× in this paper · explained in 2 episodes
• Flow Matching — 1× in this paper · explained in 8 episodes
• Flow Matching Model — 1× in this paper · explained in 2 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Online Reinforcement Learning — 1× in this paper · explained in 2 episodes
• Reasoning Traces — 1× in this paper · explained in 3 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Trace — 1× in this paper · explained in 2 episodes
• Transformer — 1× in this paper · explained in 2 episodes

Sources

• LTX-2: Efficient Joint Audio-Visual Foundation Model
• VABench: A Comprehensive Benchmark for Audio-Video Generation
• Kling-Omni Technical Report
• Preference Score Distillation: Leveraging 2D Rewards to Align Text-to-3D Generation with Human Preference
• Flow-GRPO: Training Flow Matching Models via Online RL
• JavisDiT: Joint Audio-Video Diffusion Transformer with Hierarchical Spatio-Temporal Prior Synchronization
• JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generation
• Ovi: Twin Backbone Cross-Modal Fusion for Audio-Video Generation
• OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoning
• Video Diffusion Alignment via Reward Gradients
• SpatialFusion: Endowing Unified Image Generation with Intrinsic 3D Geometric Awareness
• Qwen3.5-Omni Technical Report
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models
• Speed by Simplicity: A Single-Stream Architecture for Fast Audio-Video Generative Foundation Model
• MOVA: Towards Scalable and Synchronized Video-Audio Generation
• Seedance 2.0: Advancing Video Generation for World Complexity
• Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Sound
• MotionFollower: Editing Video Motion via Lightweight Score-Guided Diffusion
• StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation
• StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animation

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models