From Retrieval to Recognition:Knowledge-Enhanced Post-training of Time Series Foundation Models for Classification

arXiv:2610.26114 · cs.LG · Submitted 2026-10-19 · Read on arXiv

cs.LG

Submitted: 2026-10-19

Updated: 2026-10-19

Comments: Accepted in NeurIPS 2026

License: http://creativecommons.org/licenses/by/4.0/

The gist: Time series foundation models (TSFMs) have achieved notable progress in classification tasks through large-scale pretraining.

Terminology

Abstract

Time series foundation models (TSFMs) have achieved notable progress in classification tasks through large-scale pretraining. However, their post-training practice mainly focuses on implicit parameter fine-tuning, where task-relevant information is entangled with abundant irrelevant knowledge in vast parameter spaces. This may hinder TSFMs from precisely activating useful knowledge for downstream classification. To this end, we propose Retrieval-to-Recognition (R2R), a plug-and-play post-training paradigm that adapts pretrained TSFMs to time series classification. Rather than pretraining a new foundation model, R2R improves how existing TSFMs are post-trained: it introduces a decoupled query encoder to extract discriminative patterns and retrieve instance-level numerical knowledge from a constructed knowledge base. The retrieved explicit knowledge is then fused with the TSFM's implicit parametric embeddings, enabling joint knowledge transfer at both the parameter and feature levels. In this way, R2R allows TSFMs to recall task-relevant patterns learned during pretraining, improving the efficiency of knowledge utilization in downstream classification transfer. Experiments on 158 time series datasets show that R2R consistently improves the classification performance of state-of-the-art TSFMs. Ablation and knowledge-enhanced studies further validate the effectiveness of the proposed framework.

Related papers