MoSAT: Human Motion Generation from Spatial Audio and Textual Description

arXiv:2609.23797 · cs.GR, cs.CV, cs.RO, cs.SD · Submitted 2026-09-20 · Read on arXiv

cs.GR, cs.CV, cs.RO, cs.SD

Submitted: 2026-09-20

Updated: 2026-09-20

Terminology

• Flow Matching — 19× in this paper · explained in 8 episodes
• Transformer — 19× in this paper · explained in 2 episodes
• Embeddings — 18× in this paper · explained in 2 episodes
• Ablation — 17× in this paper · explained in 1 episode
• Alignment — 17× in this paper · explained in 1 episode
• Conference on Computer Vision and Pattern Recognition — 9× in this paper
• Diffusion Model — 7× in this paper · explained in 8 episodes
• Flow Matching Model — 7× in this paper · explained in 2 episodes
• Latent Space — 7× in this paper · explained in 7 episodes
• Fidelity — 6× in this paper · explained in 2 episodes
• Semantic Alignment — 5× in this paper · explained in 3 episodes
• Transactions on Graphics — 5× in this paper
• Ablation Studies — 4× in this paper · explained in 1 episode
• CVF International Conference on Computer Vision — 4× in this paper
• Diffusion Models — 4× in this paper · explained in 6 episodes
• Direction of Arrival — 4× in this paper
• Average Pairwise Distance — 3× in this paper
• Cosine Similarity — 3× in this paper · explained in 3 episodes
• Optimal Transport — 3× in this paper · explained in 5 episodes
• Affordance — 2× in this paper · explained in 1 episode
• Attention Mechanism — 2× in this paper · explained in 3 episodes
• Benchmark — 2× in this paper · explained in 2 episodes
• Classifier-Free Guidance — 2× in this paper
• Cross-Attention Mechanism — 2× in this paper · explained in 2 episodes
• Data Augmentation — 2× in this paper · explained in 7 episodes
• Generalization — 2× in this paper · explained in 13 episodes
• Generative Modeling — 2× in this paper · explained in 3 episodes
• Grounding — 2× in this paper · explained in 3 episodes
• Latent Representation — 2× in this paper · explained in 2 episodes
• Multimodal Inputs — 2× in this paper · explained in 2 episodes
• Optimal Transport (OT) — 2× in this paper · explained in 4 episodes
• Quantization — 2× in this paper · explained in 12 episodes
• Representation Learning — 2× in this paper · explained in 2 episodes
• Ablation study — 1× in this paper · explained in 1 episode
• Actor — 1× in this paper · explained in 3 episodes
• Benchmarking — 1× in this paper · explained in 4 episodes
• Composite Loss Function — 1× in this paper · explained in 2 episodes
• Condition-Motion Retrieval — 1× in this paper
• Consistency — 1× in this paper · explained in 3 episodes
• Decode — 1× in this paper · explained in 2 episodes
• Deep Reinforcement Learning — 1× in this paper · explained in 2 episodes
• Diffusion Process — 1× in this paper · explained in 2 episodes
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 3 episodes
• Inverse Problem — 1× in this paper · explained in 2 episodes
• Loss Function — 1× in this paper · explained in 2 episodes
• Motion-Condition Retrieval — 1× in this paper
• Nash Equilibrium — 1× in this paper · explained in 2 episodes
• Normalizing Flow — 1× in this paper · explained in 3 episodes
• Normalizing Flows — 1× in this paper · explained in 4 episodes
• Predictive Coding — 1× in this paper · explained in 2 episodes
• Reconstruction Error — 1× in this paper · explained in 2 episodes
• Rectified Flow — 1× in this paper · explained in 3 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Reinforcement Learning — 1× in this paper · explained in 4 episodes
• Trace — 1× in this paper · explained in 2 episodes
• Variational Autoencoder (VAE) — 1× in this paper · explained in 3 episodes

Sources

• Diffusion Posterior Sampling for General Noisy Inverse Problems
• LaserHuman: Language-guided Scene-aware Human Motion Generation in Free Environment
• Retargeting Matters: General Motion Retargeting for Humanoid Motion Tracking
• Pay Attention and Move Better: Harnessing Attention for Interactive Motion Generation and Training-free Editing
• Decoupled Weight Decay Regularization
• Representation Learning with Contrastive Predictive Coding
• Classifier-Free Diffusion Guidance
• Motion Flow Matching for Human Motion Synthesis and Editing
• InterMask: 3D Human Interaction Generation via Collaborative Masked Modeling
• MotionHiFlow: Text-to-motion via hierarchical flow matching
• Flow Matching for Generative Modeling
• DeepSeek-V3 Technical Report
• Motion Anything: Any to Motion Generation
• Multisample Flow Matching: Straightening Flows with Minibatch Couplings
• Human Motion Diffusion Model
• Improving and generalizing flow-based generative models with minibatch optimal transport

Related papers

• SCRIPT: Scalable Diffusion Policy with Multi-stage Training for Language-driven Physics-Based Humanoid Control
• CADReasoner: Iterative Program Editing for CAD Reverse Engineering
• QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning
• DrawVideo: Grounded and Faithful Multi-Shot Video Generation from Storyboard Keyframe Sketches
• MotionPersona: Real-Time Locomotion Control across Personas, Bodies, and Styles
• MeshSplatBench: A Unified Benchmark for Triangle- and Mesh-Based Neural Rendering