English
Related papers

Related papers: Reflection Before Action: Designing a Framework fo…

200 papers

Large language models (LLMs) have shown exceptional performance as general-purpose assistants, excelling across a variety of reasoning tasks. This achievement represents a significant step toward achieving artificial general intelligence…

Artificial Intelligence · Computer Science 2024-08-13 Xiaoyu Tan , Yongxin Deng , Xihe Qiu , Weidi Xu , Chao Qu , Wei Chu , Yinghui Xu , Yuan Qi

Humans do not just find mistakes after the fact -- we often catch them mid-stream because 'reflection' is tied to the goal and its constraints. Today's large language models produce reasoning tokens and 'reflective' text, but is it…

Artificial Intelligence · Computer Science 2025-10-24 Sion Weatherhead , Flora Salim , Aaron Belbasis

A language model's ability to reflect on its own reasoning provides a key advantage for solving complex problems. While most recent research has focused on how this ability develops during reinforcement learning, we show that it actually…

Reasoning is a fundamental aspect of human intelligence that plays a crucial role in activities such as problem solving, decision making, and critical thinking. In recent years, large language models (LLMs) have made significant progress in…

Computation and Language · Computer Science 2023-05-29 Jie Huang , Kevin Chen-Chuan Chang

LLMs can act as an impartial other, drawing on vast knowledge, or as personalized self-reflecting user prompts. These personalized LLMs, or Digital Humans, occupy an intermediate position between self and other. This research explores the…

Human-Computer Interaction · Computer Science 2025-11-18 Ichiro Matsuda , Komichi Takezawa , Katsuhito Muroi , Kensuke Katori , Ryosuke Hyakuta , Jingjing Li , Yoichi Ochiai

Large language models have recently demonstrated significant gains in reasoning ability, often attributed to their capacity to generate longer chains of thought and engage in reflective reasoning. However, the contribution of reflections to…

Artificial Intelligence · Computer Science 2025-10-10 Liwei Kang , Yue Deng , Yao Xiao , Zhanfeng Mo , Wee Sun Lee , Lidong Bing

Despite the growing reasoning capabilities of recent large language models (LLMs), their internal mechanisms during the reasoning process remain underexplored. Prior approaches often rely on human-defined concepts (e.g., overthinking,…

Computation and Language · Computer Science 2026-01-01 Zhenyu Zhang , Shujian Zhang , John Lambert , Wenxuan Zhou , Zhangyang Wang , Mingqing Chen , Andrew Hard , Rajiv Mathews , Lun Wang

Deep research agents increasingly automate complex information-seeking tasks, producing evidence-grounded reports via multi-step reasoning, tool use, and synthesis. Their growing role demands scalable, reliable evaluation, positioning…

Computation and Language · Computer Science 2026-05-20 Leyao Wang , Yanan He , Peng Chen , Asaf Yehudai , Yixin Liu , Rex Ying , Michal Shmueli-Scheuer , Arman Cohan

Large language models (LLMs) solve complex problems by generating multi-step reasoning traces. Yet these traces are typically analyzed from only one of two perspectives: the sequence of tokens across different reasoning steps in the…

Computation and Language · Computer Science 2026-03-25 Ruidi Chang , Jiawei Zhou , Hanjie Chen

Large Reasoning Models (LRMs) excel at multi-step reasoning but often suffer from inefficient reasoning processes like overthinking and overshoot, where excessive or misdirected reasoning increases computational cost and degrades…

Artificial Intelligence · Computer Science 2026-01-19 Qianyue Wang , Jinwu Hu , Yufeng Wang , Huanxiang Lin , Bolin Chen , Zhiquan Wen , Yaofo Chen , Mingkui Tan

Large language models (LLMs) have demonstrated impressive capability in reasoning and planning when integrated with tree-search-based prompting methods. However, since these methods ignore the previous search experiences, they often make…

Computation and Language · Computer Science 2024-07-19 Wenyang Hui , Kewei Tu

Recent generations of language models have introduced Large Reasoning Models (LRMs) that generate detailed thinking processes before providing answers. While these models demonstrate improved performance on reasoning benchmarks, their…

Artificial Intelligence · Computer Science 2025-11-21 Parshin Shojaee , Iman Mirzadeh , Keivan Alizadeh , Maxwell Horton , Samy Bengio , Mehrdad Farajtabar

Recent advancements in Large Language Models (LLMs) have significantly improved their problem-solving capabilities. However, these models still struggle when faced with complex multi-step reasoning tasks. In this paper, we propose the…

Computation and Language · Computer Science 2025-12-04 André de Souza Loureiro , Jorge Valverde-Rebaza , Julieta Noguez , David Escarcega , Ricardo Marcacini

We present a novel pipeline, ReflectEvo, to demonstrate that small language models (SLMs) can enhance meta introspection through reflection learning. This process iteratively generates self-reflection for self-training, fostering a…

Artificial Intelligence · Computer Science 2025-05-23 Jiaqi Li , Xinyi Dong , Yang Liu , Zhizhuo Yang , Quansen Wang , Xiaobo Wang , SongChun Zhu , Zixia Jia , Zilong Zheng

Recent studies suggest that self-reflective prompting can significantly enhance the reasoning capabilities of Large Language Models (LLMs). However, the use of external feedback as a stop criterion raises doubts about the true extent of…

Computation and Language · Computer Science 2024-04-16 Yanhong Li , Chenghao Yang , Allyson Ettinger

This study quantitively examines which features of AI-generated text lead humans to perceive subjective consciousness in large language model (LLM)-based AI systems. Drawing on 99 passages from conversations with Claude 3 Opus and focusing…

Human-Computer Interaction · Computer Science 2025-12-10 Bongsu Kang , Jundong Kim , Tae-Rim Yun , Hyojin Bae , Chang-Eop Kim

Large language models (LLMs) have rapidly evolved from text generators into powerful problem solvers. Yet, many open tasks demand critical thinking, multi-source, and verifiable outputs, which are beyond single-shot prompting or standard…

Embodied LLMs endow robots with high-level task reasoning, but they cannot reflect on what went wrong or why, turning deployment into a sequence of independent trials where mistakes repeat rather than accumulate into experience. Drawing…

Machine Learning · Computer Science 2026-05-26 Yining Hong , Huang Huang , Manling Li , Li Fei-Fei , Leonidas Guibas , Jiajun Wu , Yejin Choi

Personalization is a critical task in modern intelligent systems, with applications spanning diverse domains, including interactions with large language models (LLMs). Recent advances in reasoning capabilities have significantly enhanced…

Computation and Language · Computer Science 2025-05-26 Sichun Luo , Guanzhi Deng , Jian Xu , Xiaojie Zhang , Hanxu Hou , Linqi Song

Large language models (LLMs) often generate inaccurate or fabricated information and generally fail to indicate their confidence, which limits their broader applications. Previous work elicits confidence from LLMs by direct or…

Computation and Language · Computer Science 2024-10-07 Tianyang Xu , Shujin Wu , Shizhe Diao , Xiaoze Liu , Xingyao Wang , Yangyi Chen , Jing Gao