LadderEdit: Edit-Level Residual Compression for Memory-Efficient Lifelong Editing of LLMs

arXiv:2610.11160 · cs.CL, cs.CV, cs.LG, cs.MM · Submitted 2026-10-08 · Read on arXiv

cs.CL, cs.CV, cs.LG, cs.MM

Submitted: 2026-10-08

Updated: 2026-10-08

Code: https://github.com/VisualReasoner/LadderEdit

Terminology

• Generalization — 43× in this paper · explained in 13 episodes
• Benchmark — 13× in this paper · explained in 2 episodes
• Fidelity — 13× in this paper · explained in 2 episodes
• Quantization — 8× in this paper · explained in 12 episodes
• Ablation — 6× in this paper · explained in 1 episode
• Adaptation — 5× in this paper · explained in 1 episode
• Accuracy — 3× in this paper · explained in 1 episode
• Transformer — 3× in this paper · explained in 2 episodes
• Continual Learning — 2× in this paper · explained in 2 episodes
• Fine-Tuning — 2× in this paper · explained in 5 episodes
• LoRA Adapters — 2× in this paper · explained in 3 episodes
• Mixture of Experts — 2× in this paper · explained in 2 episodes
• Provenance — 2× in this paper · explained in 4 episodes
• Contrastive Learning — 1× in this paper · explained in 5 episodes
• Core — 1× in this paper · explained in 2 episodes
• Embeddings — 1× in this paper · explained in 2 episodes
• Failure Modes — 1× in this paper · explained in 3 episodes
• Frozen model — 1× in this paper · explained in 3 episodes
• In-Context Learning — 1× in this paper · explained in 4 episodes
• Robustness — 1× in this paper · explained in 5 episodes

Sources

• Qwen3-VL Technical Report
• The Llama 3 Herd of Models
• Unsupervised Dense Information Retrieval with Contrastive Learning
• Mistral 7B
• ELDER: Enhancing Lifelong Model Editing with Mixture-of-LoRA
• DoRA: Weight-Decomposed Low-Rank Adaptation
• S-LoRA: Serving Thousands of Concurrent LoRA Adapters
• WikiBigEdit: Understanding the Limits of Lifelong Knowledge Editing in LLMs
• Text Embeddings by Weakly-Supervised Contrastive Pre-training
• WISE: Rethinking the Knowledge Memory for Lifelong Model Editing of Large Language Models
• EasyEdit: An Easy-to-use Knowledge Editing Framework for Large Language Models
• LEMoE: Advanced Mixture of Experts Adaptor for Lifelong Model Editing of Large Language Models
• MEMoE: Enhancing Model Editing with Mixture of Experts Adaptors
• Knowledge Editing for Large Language Models: A Survey
• Continual Learning for Large Language Models: A Survey
• Qwen3 Technical Report
• Qwen2.5 Technical Report
• Editing Large Language Models: Problems, Methods, and Opportunities
• MELO: Enhancing Model Editing with Neuron-Indexed Dynamic LoRA
• A Comprehensive Study of Knowledge Editing for Large Language Models

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering