Audible World Models: Spatially Aware Sound Generation for 3D Worlds

arXiv:2609.38444 · cs.CV, cs.SD · Submitted 2026-09-29 · Read on arXiv

cs.CV, cs.SD

Submitted: 2026-09-29

Updated: 2026-09-29

Terminology

• Consistency — 28× in this paper · explained in 3 episodes
• Ablation — 18× in this paper · explained in 1 episode
• Alignment — 13× in this paper · explained in 1 episode
• Accuracy — 9× in this paper · explained in 1 episode
• Grounding — 8× in this paper · explained in 3 episodes
• World Model — 7× in this paper · explained in 7 episodes
• Benchmark — 5× in this paper · explained in 2 episodes
• Semantic Alignment — 5× in this paper · explained in 3 episodes
• ACM Transactions on Graphics — 4× in this paper
• Calibration — 4× in this paper · explained in 7 episodes
• Diffusion Model — 4× in this paper · explained in 8 episodes
• Latent Diffusion Model — 4× in this paper · explained in 2 episodes
• Ablation study — 3× in this paper · explained in 1 episode
• Angular Error — 3× in this paper · explained in 1 episode
• Cosine Similarity — 3× in this paper · explained in 3 episodes
• Diffusion Models — 2× in this paper · explained in 6 episodes
• Embeddings — 2× in this paper · explained in 2 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Latent Diffusion Models — 2× in this paper · explained in 2 episodes
• Segmentation Masks — 2× in this paper · explained in 2 episodes
• Training-Free Framework — 2× in this paper · explained in 2 episodes
• Transformer — 2× in this paper · explained in 2 episodes
• 3D Gaussian Splatting — 1× in this paper · explained in 2 episodes
• Ablation Studies — 1× in this paper · explained in 1 episode
• Adam — 1× in this paper · explained in 2 episodes
• Anchor Source — 1× in this paper · explained in 1 episode
• Core — 1× in this paper · explained in 2 episodes
• Flow Matching — 1× in this paper · explained in 7 episodes
• Gaussian Splatting — 1× in this paper · explained in 4 episodes
• Mask Generation — 1× in this paper · explained in 2 episodes
• Zero-Shot Transfer — 1× in this paper · explained in 3 episodes

Sources

• ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depth
• LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes
• Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities
• TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimization
• ViSAGe: Video-to-Spatial Audio Generation
• AudioGen: Textually Guided Audio Generation
• Neural Acoustic Context Field: Rendering Realistic Room Impulse Response With Neural Fields
• AudioLDM: Text-to-Audio Generation with Latent Diffusion Models
• OmniAudio: Generating Spatial Audio from 360-Degree Video
• DreamFusion: Text-to-3D using 2D Diffusion
• SAM 2: Segment Anything in Images and Videos
• HunyuanVideo-Foley: Multimodal Diffusion with Representation Alignment for High-Fidelity Foley Audio Generation
• Lyra 2.0: Explorable Generative 3D Worlds
• WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
• HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels
• Audiobox: Unified Audio Generation with Natural Language Prompts

Related papers

• Loss Knows Best: Detecting Annotation Errors in Videos via Loss Trajectories
• AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories
• Benchmarking the Robustness of Foundation Models for Mammography under Domain Shift
• MambaX-Net: Dual-Input Mamba-Enhanced Cross-Attention Network for Longitudinal MRI Segmentation
• TeleOCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
• A Survey on Efficient Vision-Language-Action Models