Tunable Tool-Call Rates in LLM Agents via Representation Steering
cs.AI
Submitted: 2026-08-25
Updated: 2026-08-25
Code: https://github.com/YuqiChen4188/Steering-Tool-Use-Propensity
License: http://creativecommons.org/licenses/by/4.0/
The gist: Deciding whether to call a tool is a core competence of an LLM agent, and a costly one to get wrong: needless calls add latency, accrue cost, and may trigger irreversible side effects, while missing
Terminology
Abstract
Deciding whether to call a tool is a core competence of an LLM agent, and a costly one to get wrong: needless calls add latency, accrue cost, and may trigger irreversible side effects, while missing calls leave the model confidently wrong on questions it could only answer through tool-calls. Models manage this balance poorly, both over-using and under-using tools. Existing methods such as post-training and prompt engineering are expensive and difficult to modify at inference time. We show that whether an instruction-tuned model calls a tool can be controlled by a single linear direction in its residual stream, extracted without any training from the model's own tool-use preference signal and turned into an inference-time intervention with no prompt change. Adding the direction with strength α moves the call rate monotonically from near 0% to over 90% while keeping calls well-formed. The steering works in both directions: dialing it down suppresses calls, and dialing it up induces new calls that land precisely on the questions the model cannot answer from its own knowledge. We also show that the direction generalizes to unseen tools with strength comparable to each tool's own direction and without favoring any specific tool choice. With live tool execution, a single sweep of the steering traces a cost/accuracy Pareto frontier and nearly doubles open-domain QA accuracy (0.29 ! to ! 0.56); the same recipe transfers across a diverse range of models spanning dense, MoE, and multimodal architectures, without any training. Our code is publicly available at https://github.com/YuqiChen4188/Steering-Tool-Use-Propensity.
Sources
- MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use
- ToolACE: Winning the Points of LLM Function Calling
- Augmented Language Models: a Survey
- WTU-EVAL: A Whether-or-Not Tool Usage Evaluation Benchmark for Large Language Models
- gpt-oss-120b & gpt-oss-20b Model Card
- CREATOR: Tool Creation for Disentangling Abstract and Concrete Reasoning of Large Language Models
- Investigate-Consolidate-Exploit: A General Strategy for Inter-Task Agent Self-Evolution
- Toolink: Linking Toolkit Creation and Using through Chain-of-Solving on Open-Source Model
- ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs
- LLM With Tools: A Survey
- SteeringSafety: Benchmarking Representation Steering in LLMs Across Safety Perspectives
- RepIt: Steering Language Models with Concept-Specific Refusal Vectors
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
- Gemma 4 Technical Report
- The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independence
- Tool Calling is Linearly Readable and Steerable in Language Models
- Qwen3 Technical Report
- ReAct: Synergizing Reasoning and Acting in Language Models
Related papers
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- The Clinician's Veto: Navigating Trust, Liability, and Uncertainty in Autonomous AI Prescribing
- MindHelper: Closed-Loop Embodied Mental-State Reasoning for Precision Intervention
- Incumbent Advantage: Brand Bias and Cognitive Manipulation Dynamics in LLM Recommendation Systems
- VSAL: A Vision Solver with Adaptive Layouts for Graph Property Detection