The Sequential Price of Continual Learning
cs.LG, cs.AI
Submitted: 2026-08-30
Updated: 2026-08-30
Terminology
Sources
- Supervised Learning with Evolving Tasks and Performance Guarantees
- Learning Fast, Learning Slow: A General Continual Learning Method based on Complementary Learning System
- Theoretical Insights into Overparameterized Models in Multi-Task and Replay-Based Continual Learning
- Dark Experience for General Continual Learning: a Strong, Simple Baseline
- Last Iterate Convergence of Incremental Methods and Applications in Continual Learning
- Context Channel Capacity: An Information-Theoretic Framework for Understanding Catastrophic Forgetting
- The Method of Alternating Projections
- Analysis of Overparameterization in Continual Learning under a Linear Model
- The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting -- An Analytical Model
- Provable Continual Learning via Sketched Jacobian Approximations
- Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification
- Compact Memory for Continual Logistic Regression
- Optimal L2 Regularization in High-dimensional Continual Linear Regression
- Optimal Rates in Continual Linear Regression via Increasing Regularization
- IF2Net: Innately Forgetting-Free Networks for Continual Learning
- Optimal Task Order for Continual Learning of Multiple Tasks
- Replay Can Provably Increase Forgetting
- LoRanPAC: Low-rank Random Features and Pre-trained Models for Bridging Theory and Practice in Continual Learning
- Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
- Are Greedy Task Orderings Better Than Random in Continual Linear Regression?
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks