MOSAIC: Multi-Objective Search for Allocating Inference Cache Across LLM Decoder Layers

arXiv:2610.25431 · cs.LG, cs.AI · Submitted 2026-10-18 · Read on arXiv

cs.LG, cs.AI

Submitted: 2026-10-18

Updated: 2026-10-18

Terminology

Related papers