English

Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs

Computation and Language 2025-06-24 v1

Abstract

While Large Language Models (LLMs) demonstrate impressive reasoning capabilities, growing evidence suggests much of their success stems from memorized answer-reasoning patterns rather than genuine inference. In this work, we investigate a central question: are LLMs primarily anchored to final answers or to the textual pattern of reasoning chains? We propose a five-level answer-visibility prompt framework that systematically manipulates answer cues and probes model behavior through indirect, behavioral analysis. Experiments across state-of-the-art LLMs reveal a strong and consistent reliance on explicit answers. The performance drops by 26.90\% when answer cues are masked, even with complete reasoning chains. These findings suggest that much of the reasoning exhibited by LLMs may reflect post-hoc rationalization rather than true inference, calling into question their inferential depth. Our study uncovers the answer-anchoring phenomenon with rigorous empirical validation and underscores the need for a more nuanced understanding of what constitutes reasoning in LLMs.

Keywords

Cite

@article{arxiv.2506.17630,
  title  = {Answer-Centric or Reasoning-Driven? Uncovering the Latent Memory Anchor in LLMs},
  author = {Yang Wu and Yifan Zhang and Yiwei Wang and Yujun Cai and Yurong Wu and Yuran Wang and Ning Xu and Jian Cheng},
  journal= {arXiv preprint arXiv:2506.17630},
  year   = {2025}
}

Comments

14 pages, 8 figures

R2 v1 2026-07-01T03:27:43.077Z