A Finite-Sample Analysis of Quantile Temporal-Difference Learning

arXiv:2608.27313 · stat.ML, cs.LG · Submitted 2026-08-27 · Read on arXiv

stat.ML, cs.LG

Submitted: 2026-08-27

Updated: 2026-09-17

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Reinforcement Learning — 11× in this paper · explained in 4 episodes
• Sample Complexity — 4× in this paper · explained in 15 episodes
• Generative Model — 2× in this paper · explained in 2 episodes
• Action Space — 1× in this paper · explained in 1 episode
• Markov Decision Process (MDP) — 1× in this paper · explained in 11 episodes
• Non-asymptotic Analysis — 1× in this paper · explained in 2 episodes

Sources

• Online Inference for Quantile Temporal Difference Learning in Distributional Reinforcement Learning
• Statistical Efficiency and Inference of Quantile Distributional Reinforcement Learning
• A Finite Sample Analysis of Distributional TD Learning with Linear Function Approximation
• An Analysis of Quantile Temporal-Difference Learning

Related papers

• Behavior of prediction performance metrics with rare events
• Optimal Estimation of Generic Dynamics by Path-Dependent Neural Jump ODEs
• A Posterior-Dynamics Framework for Imaging Inverse Problems with Pretrained Diffusion Priors
• One Permutation Is All You Need: Fast, Deterministic Feature Importance and Model Stress-Testing
• Online Conformal Prediction for Non-Exchangeable Panel Data
• Deep Time-Series Forecasting in 10 Years: A Survey