Two-Timescale Reinforcement Learning for Real-Time Optimization and Economic NMPC: Experimental Validation

arXiv:2609.35141 · eess.SY, cs.SY · Submitted 2026-09-28 · Read on arXiv

eess.SY, cs.SY

Submitted: 2026-09-28

Updated: 2026-09-28

Code: https://github.com/saketadhau/rl-rto

Terminology

• Adaptation — 25× in this paper · explained in 1 episode
• Real-Time Optimization — 15× in this paper
• Reinforcement Learning — 10× in this paper · explained in 4 episodes
• Ablation — 4× in this paper · explained in 1 episode
• Consistency — 3× in this paper · explained in 3 episodes
• Q-learning — 3× in this paper · explained in 3 episodes
• Reinforcement Learning (RL) — 3× in this paper · explained in 25 episodes
• Accuracy — 2× in this paper · explained in 1 episode
• Generalization — 2× in this paper · explained in 13 episodes
• Regularization — 2× in this paper · explained in 3 episodes
• Calibration — 1× in this paper · explained in 7 episodes
• Closed-Loop Control — 1× in this paper · explained in 2 episodes
• Economic Nonlinear Model Predictive Control — 1× in this paper
• Frozen model — 1× in this paper · explained in 2 episodes
• Generative AI — 1× in this paper · explained in 2 episodes
• Interpretability — 1× in this paper · explained in 15 episodes
• Objective Function — 1× in this paper · explained in 2 episodes
• System Identification — 1× in this paper · explained in 3 episodes

Related papers

• One Request, Multiple Experts: LLM Orchestrates Domain Specific Models via Adaptive Task Routing
• A Geometric Decision Procedure for STL Feasibility and Repair
• Submodular Multi-Agent Policy Learning for Online Distributed Task Allocation in Open Multi-Agent Systems
• Policy-Level Recursive Self-Improvement for Embodied AI with a Criticality World Model
• Minimal Experiments for Robust Stabilization: Information, Spectral Geometry, and Duration
• Decentralized Power-Optimal Coordination for Spacecraft Swarms Using Time-Varying Magnetorquer Actuation