Scalable Direction-Following TTS via Voice Impression-Guided Pseudo Triplet Construction

arXiv:2609.02623 · cs.SD, cs.CL, cs.LG · Submitted 2026-09-02 · Read on arXiv

cs.SD, cs.CL, cs.LG

Submitted: 2026-09-02

Updated: 2026-09-02

Project page: https://ntt-hilab-gensp.github.io/IS2026pseudo

Terminology

• Alignment — 21× in this paper · explained in 1 episode
• Actor — 5× in this paper · explained in 3 episodes
• Consistency — 5× in this paper · explained in 3 episodes
• Embeddings — 5× in this paper · explained in 2 episodes
• Flow Matching — 4× in this paper · explained in 8 episodes
• Benchmark — 3× in this paper · explained in 2 episodes
• Cosine Similarity — 3× in this paper · explained in 3 episodes
• Robustness — 3× in this paper · explained in 5 episodes
• Adam — 2× in this paper · explained in 2 episodes
• Fidelity — 2× in this paper · explained in 2 episodes
• LLM-as-a-Judge — 2× in this paper · explained in 3 episodes
• Rectified Flow — 2× in this paper · explained in 3 episodes
• Alignment Scores — 1× in this paper · explained in 1 episode
• Generative AI — 1× in this paper · explained in 2 episodes
• Generative Model — 1× in this paper · explained in 2 episodes
• Generative Models — 1× in this paper · explained in 3 episodes
• Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
• Latent Space — 1× in this paper · explained in 7 episodes
• Representation Learning — 1× in this paper · explained in 2 episodes
• Transfer Learning — 1× in this paper · explained in 10 episodes

Sources

• SpeechBrain: A General-Purpose Speech Toolkit
• LibriTTS-VI: A Public Corpus and Novel Methods for Efficient Voice Impression Control

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment