MeanField Surrogate Modeling for Scalable Runtime Scheduling of Concurrent Heterogeneous AI Inference on Shared GPUs
cs.DC, cs.AI
Submitted: 2026-09-02
Updated: 2026-09-02
Terminology
Sources
- Miriam: Exploiting Elastic Kernels for Real-time Multi-DNN Inference on Edge GPU
- DVFS-Aware DNN Inference on GPUs: Latency Modeling and Performance Analysis
Related papers
- iScheduler: Reinforcement Learning-Driven Continual Optimization for Large-Scale Resource Investment Problems
- SAMM: Sharded Automated Market Maker
- InferScale: GPU-Native KV Injection for Personalized LLM Serving
- Vigil: Accountable Liveness against Selective Silence
- Steelhead: Interleaving Partially Synchronous and Asynchronous Commit Rules on a Shared DAG
- Pushing CPU Speech Synthesis to the Wall: Extreme Inference Tuning under Serverless Architecture and Billing