Reconstructing the Vocal Tract with Differentiable Acoustic Simulation

arXiv:2609.36737 · cs.SD, cs.CL, eess.AS · Submitted 2026-09-29 · Read on arXiv

cs.SD, cs.CL, eess.AS

Submitted: 2026-09-29

Updated: 2026-09-29

Code: https://github.com/oogle/brax

Terminology

• Inverse Problem — 12× in this paper · explained in 2 episodes
• Diffusion Model — 9× in this paper · explained in 8 episodes
• Adam — 6× in this paper · explained in 2 episodes
• Time Domain Synthesis — 6× in this paper
• Fidelity — 4× in this paper · explained in 2 episodes
• Frequency Domain Synthesis — 4× in this paper
• Generative Model — 3× in this paper · explained in 2 episodes
• Computer Vision and Pattern Recognition — 2× in this paper
• Diffusion Models — 2× in this paper · explained in 6 episodes
• Diffusion Posterior Sampling — 2× in this paper
• Embeddings — 2× in this paper · explained in 2 episodes
• Gradient Flow — 2× in this paper · explained in 2 episodes
• Grounding — 2× in this paper · explained in 3 episodes
• Latent Space — 2× in this paper · explained in 7 episodes
• Activation Function — 1× in this paper · explained in 1 episode
• Aggregation — 1× in this paper · explained in 1 episode
• Benchmark — 1× in this paper · explained in 2 episodes
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Decode — 1× in this paper · explained in 2 episodes
• International Phonetic Alphabet — 1× in this paper
• Loss Function — 1× in this paper · explained in 2 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Self-Supervised Learning — 1× in this paper · explained in 8 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations
• DDSP: Differentiable Digital Signal Processing
• DiffTaichi: Differentiable Programming for Physical Simulation
• Adam: A Method for Stochastic Optimization
• LibriTTS-R: A Restored Multi-Speaker Text-to-Speech Corpus
• Speech2rtMRI: Speech-Guided Diffusion Model for Real-time MRI Video of the Vocal Tract during Speech
• SwiftF0: Fast and Accurate Monophonic Pitch Detection
• WaveNet: A Generative Model for Raw Audio
• AISHELL-3: A Multi-speaker Mandarin TTS Corpus and the Baselines
• JVS corpus: free Japanese multi-speaker voice corpus

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment