Two-Timescale Fine-tuning Provably Learns New Features for Two-Layer ReLU Networks
stat.ML, cs.LG
Submitted: 2026-09-28
Updated: 2026-09-28
Terminology
Sources
- Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime
- Gradient dynamics for low-rank fine-tuning beyond kernels
Related papers
- Behavior of prediction performance metrics with rare events
- Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
- A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
- One Permutation Is All You Need: Fast, Deterministic Feature Importance and Model Stress-Testing
- Online Conformal Prediction for Non-Exchangeable Panel Data
- Deep Time-Series Forecasting in 10 Years: A Survey