VoxMorph: Scalable Zero-shot Voice Identity Morphing via Disentangled Embeddings

arXiv:2601.20883 · cs.SD, cs.CR, cs.LG, eess.AS · Submitted 2026-01-27 · Read on arXiv

Bharath Krishnamurthy, Ajita Rattani

cs.SD, cs.CR, cs.LG, eess.AS

Submitted: 2026-01-27

Updated: 2026-08-24

Comments: Accepted to IEEE ICASSP 2026 (51st International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2026). 5 pages, 1 figure, 3 tables. Project page: https://vcbsl.github.io/VoxMorph/

Journal ref: 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2026

DOI: 10.1109/ICASSP55912.2026.11462383

Code: https://github.com/resemble-ai/chatterbox

Project page: https://vcbsl.github.io/VoxMorph

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Embeddings — 21× in this paper · explained in 2 episodes
• Fidelity — 13× in this paper · explained in 2 episodes
• Verification — 10× in this paper · explained in 2 episodes
• Core — 7× in this paper · explained in 2 episodes
• Fine-Tuning — 5× in this paper · explained in 5 episodes
• Flow Matching — 5× in this paper · explained in 7 episodes
• Voice Identity Morphing — 5× in this paper
• Ablation — 4× in this paper · explained in 1 episode
• Benchmark — 4× in this paper · explained in 2 episodes
• Ablation study — 3× in this paper · explained in 1 episode
• Conditional Flow Matching — 3× in this paper
• Ablation Studies — 1× in this paper · explained in 1 episode
• Aggregation — 1× in this paper · explained in 1 episode
• Consistency — 1× in this paper · explained in 3 episodes
• Diffusion Model — 1× in this paper · explained in 8 episodes
• Feature Extraction — 1× in this paper · explained in 2 episodes
• Generalizability — 1× in this paper · explained in 6 episodes
• IEEE International Joint Conference on Biometrics — 1× in this paper
• Kullback-Leibler Divergence — 1× in this paper
• Latent Space — 1× in this paper · explained in 7 episodes
• Mated Morphed Presentation Match Rate — 1× in this paper
• Morphing Attack Detection — 1× in this paper
• Representation Learning — 1× in this paper · explained in 2 episodes
• Self-Supervised Learning — 1× in this paper · explained in 7 episodes
• Transfer Learning — 1× in this paper · explained in 10 episodes
• Word Error Rate — 1× in this paper

Sources

• CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens
• SoundMorpher: Perceptually-Uniform Sound Morphing with Diffusion Model
• CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models
• CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking
• LLaMA: Open and Efficient Foundation Language Models
• Classifier-Free Diffusion Guidance
• HiFTNet: A Fast High-Quality Neural Vocoder with Harmonic-plus-Noise Filter and Inverse Short Time Fourier Transform
• ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification
• Fr'echet Audio Distance: A Metric for Evaluating Music Enhancement Algorithms
• Morphing Attack Potential

Related papers

• Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
• Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
• AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
• SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
• WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
• Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment