Revisiting Generalization Measures Beyond IID: An Empirical Study under Distributional Shift
Sora Nakai, Youssef Fadhloun, Kacem Mathlouthi, Kotaro Yoshida, Ganesh Talluri, Ioannis Mitliagkas, Hiroki Naganuma
cs.LG
Submitted: 2026-08-21
Updated: 2026-08-24
Terminology
Sources
- Empirical or Invariant Risk Minimization? A Sample Complexity Perspective
- Invariant Risk Minimization
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale
- Averaging Weights Leads to Wider Optima and Better Generalization
- Sharpness-Aware Minimization for Efficiently Improving Generalization
- Measuring Robustness to Natural Distribution Shifts in Image Classification
- Network In Network
- An Empirical Model of Large-Batch Training
- In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learning
- Which Algorithmic Choices Matter at Which Batch Sizes? Insights From a Noisy Quadratic Model
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks