A Finite-State Controller Based Offline Solver for Deterministic POMDPs

arXiv:2505.00596 · cs.RO, cs.AI, cs.LG · Submitted 2025-05-01 · Read on arXiv

cs.RO, cs.AI, cs.LG

Submitted: 2025-05-01

Updated: 2025-05-01

Comments: 9 pages, 6 figures. Appendix attached. To be published in Proceedings of IJCAI 2025. For code see http://github.com/ori-goals/DetMCVI

Journal ref: Proceedings of the Thirty-Fourth International Joint Conference on Artificial Intelligence Main Track. Pages 8617-8625. (2025)

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Monte Carlo Value Iteration — 7× in this paper
Adaptation — 5× in this paper · explained in 1 episode
Regret — 5× in this paper · explained in 3 episodes
Multi-Agent System — 3× in this paper · explained in 6 episodes
Convergence Guarantees — 2× in this paper · explained in 3 episodes
IEEE International Conference on Robotics and Automation — 2× in this paper
Benchmark — 1× in this paper · explained in 2 episodes
Canadian Traveller Problem — 1× in this paper
Heuristic Search Value Iteration — 1× in this paper
Markov Decision Process (MDP) — 1× in this paper · explained in 11 episodes
Partially observable Markov decision process (POMDP) — 1× in this paper · explained in 2 episodes
Q-learning — 1× in this paper · explained in 3 episodes
Resource Constraints — 1× in this paper · explained in 3 episodes
Reward Function — 1× in this paper · explained in 2 episodes