A Comparative Analysis on the Performance of Upper Confidence Bound Algorithms in Adaptive Deep Neural Networks

arXiv:2604.24810 · cs.LG, cs.AI · Submitted 2026-04-27 · Read on arXiv

cs.LG, cs.AI

Submitted: 2026-04-27

Updated: 2026-05-22

Terminology

• Accuracy — 42× in this paper · explained in 1 episode
• Regret — 28× in this paper · explained in 3 episodes
• Reward Function — 6× in this paper · explained in 2 episodes
• Transformer — 5× in this paper · explained in 2 episodes
• Multi-Armed Bandit — 4× in this paper
• Distillation — 3× in this paper · explained in 2 episodes
• Benchmark — 2× in this paper · explained in 2 episodes
• Distribution Shift — 2× in this paper · explained in 5 episodes
• Sparsity — 2× in this paper · explained in 4 episodes
• Action Space — 1× in this paper · explained in 1 episode
• Activation Function — 1× in this paper · explained in 1 episode
• Computational overhead — 1× in this paper · explained in 2 episodes
• Conformal Prediction — 1× in this paper · explained in 5 episodes
• Contextual Bandits — 1× in this paper · explained in 3 episodes
• Edge Devices — 1× in this paper · explained in 2 episodes
• Knowledge Distillation — 1× in this paper · explained in 11 episodes
• Loss Function — 1× in this paper · explained in 2 episodes
• Pruning — 1× in this paper · explained in 4 episodes
• Quantifying Uncertainty — 1× in this paper · explained in 5 episodes
• Resource Constraints — 1× in this paper · explained in 3 episodes
• Robustness — 1× in this paper · explained in 5 episodes
• Self-distillation — 1× in this paper · explained in 6 episodes
• Transformer Architecture — 1× in this paper · explained in 2 episodes

Sources

• Mixtral of Experts
• Beyond Greedy Exits: Improved Early Exit Decisions for Risk Control and Reliability
• Unsupervised Early Exit in DNNs with Multiple Exits
• DeeBERT: Dynamic Early Exiting for Accelerating BERT Inference
• MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer
• Do CIFAR-10 Classifiers Generalize to CIFAR-10?

Related papers

• Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
• AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
• Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
• Convergence issues in Relational Concept Analysis based on AOC-posets
• Beliefs Beyond Posteriors: Local-Consistency Optimisation for Bayesian Neural Networks
• Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks