Goodput Maximization for Large Language Model Edge Inference: A Two-Phase Maskable PPO Approach

arXiv:2608.25543 · eess.SY, cs.AI, cs.SY · Submitted 2026-08-26 · Read on arXiv

eess.SY, cs.AI, cs.SY

Submitted: 2026-08-26

Updated: 2026-08-26

DOI: 10.1109/LWC.2026.3718001

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

Action Masking — 7× in this paper · explained in 1 episode
Action Space — 7× in this paper · explained in 1 episode
Benchmark — 6× in this paper · explained in 2 episodes
Transformer — 5× in this paper · explained in 2 episodes
KV cache — 4× in this paper · explained in 3 episodes
Actor — 3× in this paper · explained in 3 episodes
Active Inference — 2× in this paper · explained in 1 episode
Speculative Decoding — 2× in this paper · explained in 2 episodes
Edge Deployment — 1× in this paper · explained in 2 episodes
Generative AI — 1× in this paper · explained in 2 episodes
Generative Model — 1× in this paper · explained in 2 episodes
Generative Models — 1× in this paper · explained in 2 episodes
In-Context Learning — 1× in this paper · explained in 4 episodes
Large Language Model (LLM) — 1× in this paper · explained in 3 episodes
Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
Pruning — 1× in this paper · explained in 4 episodes
Quantization — 1× in this paper · explained in 12 episodes
Reinforcement Learning — 1× in this paper · explained in 4 episodes
Time-to-First Token — 1× in this paper
Transformer Architecture — 1× in this paper · explained in 2 episodes

Related papers