English

Finding RELIEF: Shaping Reasoning Behavior without Reasoning Supervision via Belief Engineering

Artificial Intelligence 2026-01-21 v1 Computation and Language

Abstract

Large reasoning models (LRMs) have achieved remarkable success in complex problem-solving, yet they often suffer from computational redundancy or reasoning unfaithfulness. Current methods for shaping LRM behavior typically rely on reinforcement learning or fine-tuning with gold-standard reasoning traces, a paradigm that is both computationally expensive and difficult to scale. In this paper, we reveal that LRMs possess latent \textit{reasoning beliefs} that internally track their own reasoning traits, which can be captured through simple logit probing. Building upon this insight, we propose Reasoning Belief Engineering (RELIEF), a simple yet effective framework that shapes LRM behavior by aligning the model's self-concept with a target belief blueprint. Crucially, RELIEF completely bypasses the need for reasoning-trace supervision. It internalizes desired traits by fine-tuning on synthesized, self-reflective question-answering pairs that affirm the target belief. Extensive experiments on efficiency and faithfulness tasks demonstrate that RELIEF matches or outperforms behavior-supervised and preference-based baselines while requiring lower training costs. Further analysis validates that shifting a model's reasoning belief effectively shapes its actual behavior.

Keywords

Cite

@article{arxiv.2601.13752,
  title  = {Finding RELIEF: Shaping Reasoning Behavior without Reasoning Supervision via Belief Engineering},
  author = {Chak Tou Leong and Dingwei Chen and Heming Xia and Qingyu Yin and Sunbowen Lee and Jian Wang and Wenjie Li},
  journal= {arXiv preprint arXiv:2601.13752},
  year   = {2026}
}

Comments

Working in progress

R2 v1 2026-07-01T09:12:06.907Z