Passing: An Endless Journey through Reconstructed Spacetime with AI-Generated Sound

arXiv:2609.27489 · cs.SD, cs.AI · Submitted 2026-09-23 · Read on arXiv

cs.SD, cs.AI

Submitted: 2026-09-23

Updated: 2026-09-23

Terminology

• Alignment — 8× in this paper · explained in 1 episode
• Transformer — 5× in this paper · explained in 2 episodes
• Adaptation — 4× in this paper · explained in 1 episode
• Actor — 2× in this paper · explained in 3 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• Fine-Tuning — 1× in this paper · explained in 5 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes
• Generative Modeling — 1× in this paper · explained in 3 episodes
• Ontology — 1× in this paper · explained in 2 episodes
• Rectified Flow — 1× in this paper · explained in 3 episodes
• Semantic Understanding — 1× in this paper · explained in 2 episodes
• Steering — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes

Sources

• Read, Watch and Scream! Sound Generation from Text and Video
• FoleyCrafter: Bring Silent Videos to Life with Lifelike and Synchronized Sounds
• Taming Visually Guided Sound Generation
• Vocos: Closing the gap between time-domain and Fourier-based neural vocoders for high-quality audio synthesis

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment