LangSelect: Cost-Aware Target-Language Routing for LLM Code Generation

arXiv:2609.18959 · cs.CL · Submitted 2026-07-15 · Read on arXiv

cs.CL

Submitted: 2026-07-15

Updated: 2026-07-15

License: http://creativecommons.org/licenses/by/4.0/

The gist: LLM code-generation systems usually choose a target programming language before decoding and treat that choice as fixed.

Terminology

Abstract

LLM code-generation systems usually choose a target programming language before decoding and treat that choice as fixed. We show that, for language-flexible programming tasks -- tasks where several target languages are acceptable and checkable by the same tests -- this choice is a measurable cost lever: verified implementations of the same task can differ substantially in generated-token length. We introduce LangSelect, a verification-aware router that selects the target language before generation and falls back when the first attempt fails. To separate offline routing opportunity from end-to-end behavior, we evaluate verified-solution replay, which chooses among already accepted corpus solutions, and live GPT-5 generation, which charges every generation attempt, including failures and fallbacks. On MultiLang-Bench, a 3,000-task, 8-language verified corpus, replay shows substantial language-routing headroom. In live evaluation on 450 held-out tasks, a train-split Domain heuristic baseline reduces harness-proxy tokens, which include wrapper and entrypoint overhead, by 50.3% at 92.9% pass after fallback, while a learned CodeBERT+metadata selector reaches the highest pass after fallback, 93.8%, with a 3.7% token increase. These results show that output-language routing can define a practical cost-correctness frontier for unit-test-verifiable code generation.

Related papers