Beyond Retrieval: Learning Compact User Representations for Scalable LLM Personalization

arXiv:2606.04547 · cs.IR, cs.CL · Submitted 2026-06-03 · Read on arXiv

cs.IR, cs.CL

Submitted: 2026-06-03

Updated: 2026-09-02

Comments: EMNLP 2026 Findings

License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/

Terminology

• Personalization — 52× in this paper · explained in 2 episodes
• RAG — 31× in this paper · explained in 3 episodes
• Adaptation — 19× in this paper · explained in 1 episode
• Embeddings — 8× in this paper · explained in 2 episodes
• Benchmark — 7× in this paper · explained in 2 episodes
• Hypernetwork — 7× in this paper · explained in 3 episodes
• Transformer — 7× in this paper · explained in 2 episodes
• Ablation — 6× in this paper · explained in 1 episode
• Accuracy — 6× in this paper · explained in 1 episode
• Online Adaptation — 4× in this paper · explained in 3 episodes
• Fine-Tuning — 3× in this paper · explained in 5 episodes
• Robustness — 3× in this paper · explained in 5 episodes
• One PEFT Per User — 2× in this paper
• Parameter-Efficient Fine-Tuning — 2× in this paper · explained in 2 episodes
• Adam — 1× in this paper · explained in 2 episodes
• Alignment — 1× in this paper · explained in 1 episode
• Attention Mechanism — 1× in this paper · explained in 3 episodes
• Clustering — 1× in this paper · explained in 2 episodes
• Commentary — 1× in this paper · explained in 2 episodes
• Generalization — 1× in this paper · explained in 13 episodes
• Large Language Models (LLMs) — 1× in this paper · explained in 6 episodes
• LoRA Adaptation — 1× in this paper · explained in 2 episodes
• LoRA Adapters — 1× in this paper · explained in 3 episodes
• Low-Rank Adaptation (LoRA) — 1× in this paper · explained in 9 episodes
• Mean Absolute Error — 1× in this paper
• Parameter Efficiency — 1× in this paper · explained in 3 episodes
• Parameter-Efficient Fine-Tuning (PEFT) — 1× in this paper · explained in 4 episodes
• Prompt Engineering — 1× in this paper · explained in 4 episodes
• RAG (Retrieval-Augmented Generation) — 1× in this paper · explained in 2 episodes
• Redundancy — 1× in this paper · explained in 2 episodes
• Retrieval-Augmented Generation — 1× in this paper
• Root Mean Squared Error — 1× in this paper
• Transfer Learning — 1× in this paper · explained in 10 episodes

Sources

• The Llama 3 Herd of Models
• Integrating Summarization and Retrieval for Enhanced Personalization via Large Language Models
• Teach LLMs to Personalize -- An Approach inspired by Writing Education
• A Survey of Personalized Large Language Models: Progress and Future Directions
• Instant Personalized Large Language Model Adaptation via Hypernetwork
• CURP: Codebook-based Continuous User Representation for Personalized Generation with LLMs
• Qwen3 Technical Report

Related papers

• The Price of Isolation: Estimating the Ecosystem Cost of Symmetric Two-Sided A/B Testing
• SCAR: Semantic Continuity-Aware Retrieval for Efficient Context Expansion in RAG
• MixLoRA-DSI: Dynamically Expandable Mixture-of-LoRA Experts for Rehearsal-Free Generative Retrieval over Dynamic Corpora
• RRCM: Ranking-Driven Retrieval over Collaborative and Meta Memories for LLM Recommendation
• Right Family, Wrong Skill: Evaluating Risk Exposure in Agent Skill Retrieval
• UltRAG: a Universal Simple Scalable Recipe for Knowledge Graph RAG