Evaluating Language Models on Cross-Language Code Functional Equivalence

arXiv:2608.23961 · cs.SE, cs.AI, cs.CL · Submitted 2026-08-25 · Read on arXiv

cs.SE, cs.AI, cs.CL

Submitted: 2026-08-25

Updated: 2026-08-25

Code: https://github.com/dflook/python-min

Terminology

Accuracy — 26× in this paper · explained in 1 episode
Benchmark — 19× in this paper · explained in 2 episodes
Abstraction — 16× in this paper · explained in 1 episode
Failure Modes — 4× in this paper · explained in 3 episodes
Semantic Understanding — 4× in this paper · explained in 2 episodes
Benchmarking — 2× in this paper · explained in 3 episodes
Foundation Model — 2× in this paper · explained in 3 episodes
Foundation Models — 2× in this paper · explained in 7 episodes
Large Language Models (LLMs) — 2× in this paper · explained in 6 episodes
Multi-Agent System — 2× in this paper · explained in 6 episodes
Symposium on Empirical Software Engineering and Measurement — 2× in this paper
Systematic Bias — 2× in this paper · explained in 3 episodes
Trace — 2× in this paper · explained in 2 episodes
Verification — 2× in this paper · explained in 2 episodes
AI Foundation Model — 1× in this paper · explained in 1 episode
Acceptance Bias — 1× in this paper · explained in 1 episode
Chain-of-Thought (CoT) — 1× in this paper · explained in 4 episodes
Fingerprinting — 1× in this paper · explained in 2 episodes
Generative AI — 1× in this paper · explained in 2 episodes
Hallucination — 1× in this paper · explained in 3 episodes
Human-in-the-Loop — 1× in this paper · explained in 3 episodes
Semantic Similarity — 1× in this paper · explained in 2 episodes

Sources

Related papers