TypiCore: A Hybrid Active Query Strategy for Class-Incremental Learning on Time Series
cs.LG, cs.AI
Submitted: 2026-07-20
Updated: 2026-09-13
License: http://creativecommons.org/licenses/by/4.0/
The gist: Time series data play a pivotal role across numerous domains, including healthcare and manufacturing.
Terminology
Abstract
Time series data play a pivotal role across numerous domains, including healthcare and manufacturing. In real-world environments, models must cope with distribution shifts over time, a challenge commonly addressed through Continual Learning (CL) techniques. However, existing CL methods face a critical limitation: real-world data streams are rarely fully labeled, making annotation cost a major practical constraint. This paper investigates Active Class-Incremental Learning (ACIL) for multivariate time series, where a model must sequentially learn new classes while selectively querying labels under a fixed annotation budget. We present a systematic evaluation of a wide range of query strategies combined with multiple rehearsal-based approaches, assessing their impact on plasticity, stability, and label efficiency across four benchmark datasets. Our analysis reveals the limitations of uncertainty-based and distribution-aware methods in achieving strong performance under constrained labeling budgets. To address these shortcomings, we propose TypiCore, a novel hybrid query strategy that alternates between typicality-based and diversity-based sample selection across active learning cycles, enabling the construction of memory buffers that are both representative and diverse. Evaluated on the TSCIL benchmark, TypiCore delivers significant improvements over all baselines and matches or surpasses fully supervised continual learning performance on multiple datasets while requiring a fraction of the available labels.
Sources
- ACIL: Active Class Incremental Learning for Image Classification
- Distilling the Knowledge in a Neural Network
- PathNet: Evolution Channels Gradient Descent in Super Neural Networks
- Progressive Neural Networks
- On Tiny Episodic Memories in Continual Learning
- Active Learning for Convolutional Neural Networks: A Core-Set Approach
- DUAL: Diversity and Uncertainty Active Learning for Text Summarization
- Active Learning on a Budget: Opposite Strategies Suit High and Low Budgets
- The Multiverse of Time Series Machine Learning: an Archive for Multivariate Time Series Classification
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks