Deep RL for Fast Long-Horizon Operations Scheduling on NASA's Carruthers Geocorona Observatory Mission

arXiv:2606.22159 · astro-ph.IM, astro-ph.EP, cs.LG · Submitted 2026-06-20 · Read on arXiv

Alex Zhang, Jackson Craig, Lara Waldrop

astro-ph.IM, astro-ph.EP, cs.LG

Submitted: 2026-06-20

Comments: Preprint, peer-reviewed, will be part of ICAPS 2026 conference proceedings

Journal ref: Proceedings of the International Conference on Automated Planning and Scheduling, 36(1), 538-546, (2026)

DOI: 10.1609/icaps.v36i1.42871

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Calibration — 17× in this paper · explained in 7 episodes
• Reinforcement Learning — 11× in this paper · explained in 4 episodes
• Abstraction — 9× in this paper · explained in 1 episode
• Deep Reinforcement Learning — 7× in this paper · explained in 2 episodes
• Action Space — 4× in this paper · explained in 1 episode
• Action Masking — 3× in this paper · explained in 1 episode
• Robustness — 3× in this paper · explained in 5 episodes
• Accuracy — 2× in this paper · explained in 1 episode
• Alignment — 2× in this paper · explained in 1 episode
• Combinatorial Optimization — 2× in this paper · explained in 2 episodes
• Signal-to-Noise Ratio — 2× in this paper
• Signal-to-noise ratio (SNR) — 2× in this paper · explained in 2 episodes
• Verification — 2× in this paper · explained in 2 episodes
• Ablation — 1× in this paper · explained in 1 episode
• Ablation Studies — 1× in this paper · explained in 1 episode
• Deep Reinforcement Learning (DRL) — 1× in this paper · explained in 2 episodes
• Fisher Information — 1× in this paper · explained in 3 episodes
• Information Gain — 1× in this paper · explained in 2 episodes
• Markov Decision Process (MDP) — 1× in this paper · explained in 11 episodes
• Regularization — 1× in this paper · explained in 3 episodes
• Reward Shaping — 1× in this paper · explained in 2 episodes
• Targets of Opportunity — 1× in this paper

Sources

• A Closer Look at Invalid Action Masking in Policy Gradient Algorithms
• Earth Observation Satellite Scheduling with Graph Neural Networks and Monte Carlo Tree Search
• Proximal Policy Optimization Algorithms
• Gymnasium: A Standard Interface for Reinforcement Learning Environments

Related papers

• A signal dedispersion algorithm for imaging-based transient searches
• AVICA: A fully automated CASA pipeline for large volume VLBI data calibration
• Spectral Map Making with SPHEREx
• Long-Integration Magnetar Burst Observatory (LIMBO): Instrument Summary and Early FRB Rate Constraints
• Towards independent event horizon imaging of the supermassive black holes in M87 and the Milky Way
• A PINK update: Improvements to the CELEBI fast radio burst data reduction and analysis pipeline