Certifying Whether to Adapt: Baseline-Relative PAC-Bayes-MMD Guarantees for Test-Time Adaptation
cs.LG, stat.ML
Submitted: 2026-05-20
Updated: 2026-10-18
Comments: 27 pages, 7 figures
License: http://creativecommons.org/licenses/by/4.0/
The gist: Test-time adaptation (TTA) needs a decision about an update, not only an absolute-risk estimate.
Terminology
Abstract
Test-time adaptation (TTA) needs a decision about an update, not only an absolute-risk estimate. We give PAC-Bayesian certificates for the target excess risk of a candidate relative to a pilot-fixed baseline. A radial certificate uses an MMD ambiguity radius; a direction-sensitive certificate retains the sign of the empirical RKHS shift and can therefore certify target improvement even when source risk increases. For finite binary state spaces we derive statewise marginal and signed conditional-shift refinements, with penalties localized to candidate--baseline disagreements. A source-worsening update with target excess risk-0.576 is accepted in all 1,000 repetitions by the directional certificate and never by the radial certificate; learned finite-state updates with excess risks-0.800 and-0.401 are likewise accepted in every repetition. On Covertype, the certificate safely rejects all updates and blocks geographic-shift adaptations whose unconditional deployment increases risk by up to 2.75 percentage points in prespecified base libraries; an exploratory stress test reaches 5.66 points. A feature-quantized CIFAR-10-C and ImageNet-C study is structurally vacuous and is reported only as a diagnostic limitation, not as a practical neural certificate.
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks