English

Where Do Reasoning Models Refuse?

Computation and Language 2026-05-14 v4 Artificial Intelligence Machine Learning

Abstract

Chat models without chain-of-thought (CoT) reasoning must decide whether to refuse a harmful request before generating their first response token. Reasoning models, by contrast, produce extended chains of thought before their final output, raising a natural question: where in this process does the decision to refuse occur? We investigate this across four open-source reasoning models. We first show that the CoT causally influences refusal outcomes; fixing a specific reasoning trace substantially reduces variance in whether the model ultimately refuses or complies. Zooming into the reasoning trace, we find that in distilled models, subtle differences in the opening sentence of the CoT can fully determine the model's refusal decision, and that these patterns transfer across models distilled from the same teacher. Finally, we extract linear refusal directions from model activations and show that ablating them increases harmful compliance, though less reliably than the same technique achieves on non-reasoning models, and with non-negligible degradation to general capabilities.

Keywords

Cite

@article{arxiv.2507.03167,
  title  = {Where Do Reasoning Models Refuse?},
  author = {Kureha Yamaguchi and Benjamin Etheridge and Andy Arditi},
  journal= {arXiv preprint arXiv:2507.03167},
  year   = {2026}
}

Comments

v1 accepted to the ICML 2025 Workshop on Reliable and Responsible Foundation Models (R2FM). 20 pages, 12 figures

R2 v1 2026-07-01T03:45:59.291Z