A Sharp Dynamic Haussler Lemma
cs.LG, cs.DS
Submitted: 2026-10-21
Updated: 2026-10-21
License: http://creativecommons.org/licenses/by/4.0/
The gist: Haussler's covering lemma (JCTA 1995) gives the sharp (C/δ) d metric-entropy bound for binary VC classes under normalized 1 distance.
Abstract
Haussler's covering lemma (JCTA 1995) gives the sharp (C/δ) d metric-entropy bound for binary VC classes under normalized 1 distance. We prove a sharp global dynamic analogue for bounded real-valued classes in normalized p, for every 1 p< infinity. Writing d= sfat epsilon/32(F), we obtain a global dynamic cover of size at most (C/epsilon p) d for every horizon and 0< epsilon<1/2. Here a single family of deterministic causal experts, fixed independently of the instance sequence, covers every target on every sequence. For 0< epsilon<1/4, a matching worst-case lower bound (c/epsilon) pd holds already for binary classes on one fixed sequence, even with real-valued experts. The constants are universal, independent of p. For p=2, this resolves the horizon-independent sequential 2 covering problem of Rakhlin, Sridharan, and Tewari (PTRF 2015) in a stronger global form. For p=1, it gives the sharp (C/δ) Ldim(H) global dynamic covering bound for binary classes, resolving questions of Alon, Ben-Eliezer, Dagan, Moran, Naor, and Yogev (STOC 2021) and Malliaris and Moran (Trans. AMS 2024). Our proof combines rank-decreasing correction schedules and accurate sampled prefixes with exact continuations after target identification. Shared-parent routing distributes these continuations among eligible prefixes, eliminating the logarithmic overhead.
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks