Controllable Dysarthric Speech Synthesis with Patient-Specific Conditioning for Speaker-Diverse ASR Augmentation

arXiv:2602.08696 · cs.SD, cs.CL · Submitted 2026-02-09 · Read on arXiv

cs.SD, cs.CL

Submitted: 2026-02-09

Updated: 2026-09-13

Project page: https://mors20.github.io/ProtoDisent-TTS

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Data Augmentation — 15× in this paper · explained in 7 episodes
• Adaptation — 4× in this paper · explained in 1 episode
• Embeddings — 4× in this paper · explained in 2 episodes
• Automatic Speech Recognition (ASR) — 3× in this paper · explained in 2 episodes
• Fine-Tuning — 3× in this paper · explained in 5 episodes
• Latent Space — 3× in this paper · explained in 7 episodes
• Robustness — 3× in this paper · explained in 5 episodes
• Benchmark — 2× in this paper · explained in 2 episodes
• Diffusion Model — 2× in this paper · explained in 8 episodes
• Latent Diffusion Model — 2× in this paper · explained in 2 episodes
• LoRA Adapters — 2× in this paper · explained in 3 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Adversarial Training — 1× in this paper · explained in 1 episode
• Aggregation — 1× in this paper · explained in 1 episode
• Content-Matched Healthy Reference — 1× in this paper
• Cosine Similarity — 1× in this paper · explained in 3 episodes
• Distillation — 1× in this paper · explained in 2 episodes
• Entanglement — 1× in this paper · explained in 3 episodes
• Knowledge Distillation — 1× in this paper · explained in 11 episodes
• Synthetic Data Generation — 1× in this paper · explained in 5 episodes
• Transfer Learning — 1× in this paper · explained in 10 episodes
• Transformer — 1× in this paper · explained in 2 episodes
• Verification — 1× in this paper · explained in 2 episodes

Sources

• Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech
• Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesis
• DiffDSR: Dysarthric Speech Reconstruction Using Latent Diffusion Model
• IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
• Zero-shot Voice Conversion with Diffusion Transformers

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment