Topology-enhanced machine learning for speech signal processing

arXiv:2311.15210 · cs.LG, math.ST, stat.TH · Submitted 2023-11-26 · Read on arXiv

cs.LG, math.ST, stat.TH

Submitted: 2023-11-26

Updated: 2026-09-16

Journal ref: Nat. Commun. (2026)

DOI: 10.1038/s41467-026-77649-z

Code: https://github.com/AnnFeng233/TDA

Project page: https://giotto-ai.github.io/gtda-docs/0.4.0

License: http://creativecommons.org/licenses/by/4.0/

The gist: In artificial-intelligence-aided signal processing, existing deep learning models often exhibit a black-box structure.

Terminology

Abstract

In artificial-intelligence-aided signal processing, existing deep learning models often exhibit a black-box structure. Here, conceptually beyond spectral analysis, we demonstrate that topological methods not only effectively capture intrinsic and complex structural information but can also enhance neural networks. We provide a transparent methodology, TopCap, to capture topological features inherent in time series for basic machine learning. Compared to prior approaches, we obtain descriptors that probe finer information such as the vibration of a time series. Notably, in classifying voiced and voiceless consonants, TopCap achieves an accuracy consistently standing in comparison with neural network models. Moreover, by integrating TopCap features into those neural networks, our approach improves upon state-of-the-art methods in terms of robustness against noise, as well as accuracy, stability, convergence of loss function, and interpretability.

Related papers