KernelOPT: Dispatch-Aware Agentic Search for GPU Kernel Optimization

arXiv:2609.30059 · cs.DC, cs.AI, cs.LG · Submitted 2026-09-24 · Read on arXiv

cs.DC, cs.AI, cs.LG

Submitted: 2026-09-24

Updated: 2026-09-24

Code: https://github.com/TorchedHat/KernelOPT

Terminology

• Verification — 24× in this paper · explained in 2 episodes
• Benchmark — 9× in this paper · explained in 2 episodes
• Ablation — 8× in this paper · explained in 1 episode
• Core — 7× in this paper · explained in 2 episodes
• Ablation study — 4× in this paper · explained in 1 episode
• Symposium on Operating Systems Design and Implementation — 3× in this paper
• Trace — 3× in this paper · explained in 2 episodes
• Alignment — 2× in this paper · explained in 1 episode
• Multi-Agent System — 2× in this paper · explained in 6 episodes
• World Model — 2× in this paper · explained in 7 episodes
• Abstraction — 1× in this paper · explained in 1 episode
• Adam — 1× in this paper · explained in 2 episodes
• Agentic Search — 1× in this paper · explained in 1 episode
• Agentic System — 1× in this paper · explained in 2 episodes
• Algorithmic Improvements — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Decoupling — 1× in this paper · explained in 2 episodes
• Kernel decomposition — 1× in this paper · explained in 2 episodes
• Large Language Model (LLM) — 1× in this paper · explained in 3 episodes

Sources

• OptiML: An End-to-End Framework for Program Synthesis and CUDA Kernel Optimization
• K-Search: LLM Kernel Generation via Co-Evolving Intrinsic World Model
• cuDNN: Efficient Primitives for Deep Learning
• AutoKernel: Autonomous GPU Kernel Optimization via Iterative Agent-Driven Search
• ElasticAST: An Audio Spectrogram Transformer for All Length and Resolutions
• ThunderKittens: Simple, Fast, and Adorable AI Kernels
• Astra: A Multi-Agent System for GPU Kernel Performance Optimization
• CudaForge: An Agent Framework with Hardware Feedback for CUDA Kernel Optimization

Related papers

• iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
• SAMM: Sharded Automated Market Maker
• InferScale: GPU-Native KV Injection for Personalized LLM Serving
• Vigil: Accountable Liveness against Selective Silence
• Steelhead: Interleaving Partially Synchronous and Asynchronous Commit Rules on a Shared DAG
• Pushing CPU Speech Synthesis to the Wall: Extreme Inference Tuning under Serverless Architecture and Billing