English
Related papers

Related papers: Improving LLM Reasoning through Interpretable Role…

200 papers

Large language models (LLMs) excel at handling human queries, but they can occasionally generate flawed or unexpected responses. Understanding their internal states is crucial for understanding their successes, diagnosing their failures,…

Computation and Language · Computer Science 2025-02-24 Xuansheng Wu , Jiayi Yuan , Wenlin Yao , Xiaoming Zhai , Ninghao Liu

Role-play in large language models (LLMs) enhances their ability to generate contextually relevant and high-quality responses by simulating diverse cognitive perspectives. However, our study identifies significant risks associated with this…

Computation and Language · Computer Science 2025-02-04 Jinman Zhao , Zifan Qian , Linbo Cao , Yining Wang , Yitian Ding , Yulan Hu , Zeyu Zhang , Zeyong Jin

Large language models (LLMs) have demonstrated remarkable performance across various real-world tasks. However, they often struggle to fully comprehend and effectively utilize their input contexts, resulting in responses that are unfaithful…

Computation and Language · Computer Science 2024-09-18 Qingru Zhang , Xiaodong Yu , Chandan Singh , Xiaodong Liu , Liyuan Liu , Jianfeng Gao , Tuo Zhao , Dan Roth , Hao Cheng

Reasoning-enhanced large language models (LLMs) explicitly generate intermediate reasoning steps prior to generating final answers, helping the model excel in complex problem-solving. In this paper, we demonstrate that this emerging…

Machine Learning · Computer Science 2025-05-22 Tong Wu , Chong Xiang , Jiachen T. Wang , G. Edward Suh , Prateek Mittal

High-quality prompts are crucial for eliciting outstanding performance from large language models (LLMs) on complex tasks. Existing research has explored model-driven strategies for prompt optimization. However, these methods often suffer…

Computation and Language · Computer Science 2025-06-04 Yifan Duan , Yihong Tang , Kehai Chen , Liqiang Nie , Min Zhang

Spatial reasoning is a crucial component of both biological and artificial intelligence. In this work, we present a comprehensive study of the capability of current state-of-the-art large language models (LLMs) on spatial reasoning. To…

Computation and Language · Computer Science 2024-06-10 Md Imbesat Hassan Rizvi , Xiaodan Zhu , Iryna Gurevych

Reasoning can significantly enhance the performance of Large Language Models. While recent studies have exploited behavior-related prompts adjustment to enhance reasoning, these designs remain largely intuitive and lack a systematic…

Artificial Intelligence · Computer Science 2026-02-13 Xiuping Wu , Zhao Yu , Yuxin Cheng , Ngai Wong , Liangjun Ke , Tapas Mishra , Konstantinos V. Katsikopoulos

Recent advancements in large language models (LLMs) have resulted in increasingly anthropomorphic language concerning the ability of LLMs to reason. Whether reasoning in LLMs should be understood to be inherently different is, however,…

Machine Learning · Computer Science 2025-07-28 Bertram Højer , Oliver Jarvis , Stefan Heinrich

Large Language Models (LLMs) have made significant strides in both scientific research and practical applications. Existing studies have demonstrated the state-of-the-art (SOTA) performance of LLMs in various natural language processing…

Computation and Language · Computer Science 2024-01-09 Yajing Wang , Zongwei Luo

We study self-rewarding reasoning large language models (LLMs), which can simultaneously generate step-by-step reasoning and evaluate the correctness of their outputs during the inference time-without external feedback. This integrated…

Artificial Intelligence · Computer Science 2025-02-28 Wei Xiong , Hanning Zhang , Chenlu Ye , Lichang Chen , Nan Jiang , Tong Zhang

Recently, large language models (LLMs) have achieved widespread application across various fields. Despite their impressive capabilities, LLMs suffer from a lack of structured reasoning ability, particularly for complex tasks requiring…

Artificial Intelligence · Computer Science 2025-09-03 Boqi Chen , Kua Chen , José Antonio Hernández López , Gunter Mussbacher , Dániel Varró , Amir Feizpour

Large reasoning models (LRMs) have recently shown promise in solving complex math problems when optimized with Reinforcement Learning (RL). But conventional approaches rely on outcome-only rewards that provide sparse feedback, resulting in…

Machine Learning · Computer Science 2025-08-01 Tao He , Rongchuan Mu , Lizi Liao , Yixin Cao , Ming Liu , Bing Qin

Recent work in Mechanistic Interpretability (MI) has enabled the identification and intervention of internal features in Large Language Models (LLMs). However, a persistent challenge lies in linking such internal features to the reliable…

Computation and Language · Computer Science 2026-04-08 Ruikang Zhang , Shuo Wang , Qi Su

Recent advancements in Large Language Models (LLMs) have significantly improved their problem-solving capabilities. However, these models still struggle when faced with complex multi-step reasoning tasks. In this paper, we propose the…

Computation and Language · Computer Science 2025-12-04 André de Souza Loureiro , Jorge Valverde-Rebaza , Julieta Noguez , David Escarcega , Ricardo Marcacini

Sparse Autoencoders (SAEs) are widely used to steer large language models (LLMs), based on the assumption that their interpretable features naturally enable effective model behavior steering. Yet, a fundamental question remains unanswered:…

Machine Learning · Computer Science 2025-10-07 Xu Wang , Yan Hu , Benyou Wang , Difan Zou

Recent advancements in LLMs have showcased their remarkable role-playing capabilities, able to accurately simulate the dialogue styles and cognitive processes of various roles based on different instructions and contexts. Studies indicate…

Computation and Language · Computer Science 2024-07-15 Aobo Kong , Shiwan Zhao , Hao Chen , Qicheng Li , Yong Qin , Ruiqi Sun , Xin Zhou , Jiaming Zhou , Haoqin Sun

Recent advances in large language models (LLMs) have led to the development of thinking language models that generate extensive internal reasoning chains before producing responses. While these models achieve improved performance,…

Machine Learning · Computer Science 2025-10-23 Constantin Venhoff , Iván Arcuschin , Philip Torr , Arthur Conmy , Neel Nanda

Large language models (LLMs) have gained significant traction in medical decision support systems, particularly in the context of medical question answering and role-playing simulations. A common practice, Prompt-Based Role Playing (PBRP),…

Computation and Language · Computer Science 2025-10-29 Xun Liang , Huayi Lai , Hanyu Wang , Wentao Zhang , Linfeng Zhang , Yanfang Chen , Feiyu Xiong , Zhiyu Li

As the development and application of Large Language Models (LLMs) continue to advance rapidly, enhancing their trustworthiness and aligning them with human preferences has become a critical area of research. Traditional methods rely…

Computation and Language · Computer Science 2024-11-06 Yuxin Xiao , Chaoqun Wan , Yonggang Zhang , Wenxiao Wang , Binbin Lin , Xiaofei He , Xu Shen , Jieping Ye

Recent advancements in large language models (LLMs) have shown promise in multi-step reasoning tasks, yet their reliance on extensive manual labeling to provide procedural feedback remains a significant impediment. To address this…

Computation and Language · Computer Science 2024-02-20 Zhaorun Chen , Zhuokai Zhao , Zhihong Zhu , Ruiqi Zhang , Xiang Li , Bhiksha Raj , Huaxiu Yao