Localizing RL-Induced Tool Use to a Single Crosscoder Feature
Abstract
Fine-tuning through RL reshapes the internal representations of language models to enable agentic behaviors such as tool use, yet the mechanistic basis of these changes remains poorly understood. While RL substantially improves structured tool-call generation, it is unclear which features emerge, which are preserved, and whether identified features can be leveraged for retraining-free behavioral control. In this work, we show that isolate a compact set of RL-specific features that mediate tool-calling capability in . Across a -crosscoder hyperparameter sweep, encode-decode reconstruction improves the RL model's tool correctness by pp and passively transfers tool-calling ability to the frozen base model by pp which we call a . Our findings show that DFC partitioning concentrates RL-introduced capability into a minimal, steerable feature set that enables runtime behavioral control of agentic LLMs.
Cite
@article{arxiv.2606.26474,
title = {Localizing RL-Induced Tool Use to a Single Crosscoder Feature},
author = {Andrii Shportko and Shubham Bhokare and Ahmed Zeyad A Alzahrani and Bowen Cheng and Gustavo Mercier and Jessica Hullman},
journal= {arXiv preprint arXiv:2606.26474},
year = {2026}
}
Comments
Accepted as a spotlight at the ICML 2026 Mechanistic Interpretability Workshop