Constant regret in general games via higher-order optimism
cs.LG, cs.GT
Submitted: 2026-09-03
Updated: 2026-09-03
Comments: 42 pages, 1 figure
License: http://creativecommons.org/licenses/by/4.0/
The gist: We introduce an uncoupled learning algorithm which, when employed by all players of an arbitrary N-player normal form game with up to K actions per player, guarantees O(N 3 squared K) individual
Terminology
Abstract
We introduce an uncoupled learning algorithm which, when employed by all players of an arbitrary N-player normal form game with up to K actions per player, guarantees O(N 3 squared K) individual regret, uniformly over the horizon of play. The proposed algorithm - which we call higher-order optimism with discounting (HOOD) is a variant of optimistic follow-the-regularized-leader (OptFTRL) that combines a discounted (N+1) -th order predictor with entropic regularization over a suitable "lifting" of the game's strategy space. This combination of ingredients is purposefully designed to dampen large oscillations of the induced sequence of play in a controlled manner, removing in this way a key stumbling block of previous attempts to achieve constant regret in general games. Our approach bears several striking similarities to the concurrent - and completely independent - work of Liu, Farina, and Ozdaglar (arXiv:2608.31166), who very recently derived an O(N 21 4 K) regret bound through the use of higher-order optimism and an exponential moving average estimator.
Sources
- Cautious Optimism: A Meta-Algorithm for Near-Constant Regret in General Games
- Sublogarithmic Swap Regret in Multiplayer General-Sum Games via Hybrid Regularization
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks