REMORY: Learning Residual Memory for Context Compaction

arXiv:2610.11287 · cs.CL, cs.AI · Submitted 2026-10-08 · Read on arXiv

cs.CL, cs.AI

Submitted: 2026-10-08

Updated: 2026-10-08

Code: https://github.com/zapier/AutomationBench

Terminology

• Actor — 21× in this paper · explained in 3 episodes
• Benchmark — 5× in this paper · explained in 2 episodes
• Transformer — 2× in this paper · explained in 2 episodes
• Verifier — 2× in this paper · explained in 2 episodes
• Adam — 1× in this paper · explained in 2 episodes
• Agent Memory — 1× in this paper · explained in 1 episode
• Benchmarking — 1× in this paper · explained in 3 episodes
• Block Diffusion — 1× in this paper · explained in 2 episodes
• Distribution Matching — 1× in this paper · explained in 2 episodes
• Multimodal Reasoning — 1× in this paper · explained in 5 episodes
• RAG — 1× in this paper · explained in 3 episodes
• Speculative Decoding — 1× in this paper · explained in 2 episodes
• Trace — 1× in this paper · explained in 2 episodes

Sources

• DFlash: Block Diffusion for Flash Speculative Decoding
• End-to-End Context Compression at Scale
• JobBench: Aligning Agent Work With Human Will
• MMFineReason: Closing the Multimodal Reasoning Gap via Open Data-Centric Methods
• Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
• MemGPT: Towards LLMs as Operating Systems
• AutomationBench
• BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agents
• ReSum: Unlocking Long-Horizon Search Intelligence via Context Summarization
• AgentFold: Long-Horizon Web Agents with Proactive Context Management
• WebAnchor: Anchoring Agent Planning to Stabilize Long-Horizon Web Reasoning

Related papers

• Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
• Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
• Subliminal Steering: Stronger Encoding of Hidden Signals
• MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
• The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
• Untangling the Mechanisms of Misleading Context in Medical Question Answering