Skill Training with Corruption and Reconstruction Loop
cs.CL
Submitted: 2026-07-30
Updated: 2026-09-26
Terminology
Sources
- Training language models to follow instructions with human feedback
- Language Models are Few-Shot Learners
- Learning to Commit: Generating Organic Pull Requests via Online Repository Memory
- One Sentence, One Drama: Personalized Short-Form Drama Generation via Multi-Agent Systems
- The Unlocking Spell on Base LLMs: Rethinking Alignment via In-Context Learning
- Scaling Laws for Reward Model Overoptimization
- Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation
- Voyager: An Open-Ended Embodied Agent with Large Language Models
- ExpeL: LLM Agents Are Experiential Learners
- Denoising Diffusion Probabilistic Models
- BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension
- Representation Learning with Contrastive Predictive Coding
- Skill-Based Mixture-of-Experts: Adaptive Routing for Heterogeneous Reasoning via Inferred Skills
- On the Opportunities and Risks of Foundation Models
- LoRA: Low-Rank Adaptation of Large Language Models
- An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
- Cognitive Architectures for Language Agents
- Memento: Fine-tuning LLM Agents without Fine-tuning LLMs
- ReasoningBank: Scaling Agent Self-Evolving with Reasoning Memory
- Large Language Models Cannot Self-Correct Reasoning Yet
Related papers
- Exploring Solution Divergence and Its Effect on Large Language Model Problem Solving
- Ishigaki-IDS-Bench: A Benchmark for Generating Information Delivery Specification from BIM Information Requirements
- Subliminal Steering: Stronger Encoding of Hidden Signals
- MedStruct-S: A Benchmark for Key Discovery, Key-Conditioned QA and Semi-Structured Extraction from OCR Clinical Reports
- The End of Transformers? On Challenging Attention and the Rise of Sub-Quadratic Architectures
- Untangling the Mechanisms of Misleading Context in Medical Question Answering