Arti-JEPA: Adapting Video World Model to Real-Time MRI of the Vocal Tract for Speech-Production Analysis
cs.SD, cs.CV
Submitted: 2026-09-09
Updated: 2026-09-16
Terminology
Sources
- V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
- Coding Speech through Vocal Tract Kinematics
- Towards disentangling the contributions of articulation and acoustics in multimodal phoneme recognition
- EchoJEPA: A Latent Predictive Foundation Model for Echocardiography
- Speech2rtMRI: Speech-Guided Diffusion Model for Real-time MRI Video of the Vocal Tract during Speech
- Interpretable Modeling of Articulatory Temporal Dynamics from real-time MRI for Phoneme Recognition
- MRI2Speech: Speech Synthesis from Articulatory Movements Recorded by Real-time MRI
- Deep Speech Synthesis from MRI-Based Articulatory Representations
Related papers
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- AVMeme Exam: A Multimodal Multilingual Multicultural Benchmark for LLMs' Contextual and Cultural Knowledge and Thinking
- SoundWeaver: Compositional Warm-Starting for Text-to-Audio Diffusion Serving
- WASIL: In-the-Wild Arabic Spoken Interactions with LLMs
- Efficient Audiovisual Speech Processing via MUTUD: Multimodal Training and Unimodal Deployment