Interpretable Embeddings of Speech Enhance and Explain Brain Encoding Performance of Audio Models

arXiv:2507.16080 · q-bio.NC, cs.SD, eess.AS · Submitted 2025-07-21 · Read on arXiv

q-bio.NC, cs.SD, eess.AS

Submitted: 2025-07-21

Updated: 2026-10-20

Terminology

• Embeddings — 3× in this paper · explained in 2 episodes
• Foundation Model — 1× in this paper · explained in 3 episodes
• Foundation Models — 1× in this paper · explained in 7 episodes

Related papers

• BrainWave: A Brain Signal Foundation Model for Clinical Applications
• Toward Robust, Reproducible, and Widely Accessible Intracranial Speech Brain-Computer Interfaces: A Comprehensive Narrative Review of Neural Mechanisms, Hardware, Algorithms, Evaluation, Clinical Pathways and Future Directions
• A time-causal and time-recursive scale-covariant scale-space representation of temporal signals and past time
• DRIADA: an open-source Python toolkit for linking single-neuron selectivity and population activity to behavior
• CytoNet: A Foundation Model for the Human Cerebral Cortex at Cellular Resolution
• Decoding Alignment without Encoding Alignment: A critique of similarity analysis in neuroscience