English
Related papers

Related papers: Self-Reflection in LLM Agents: Effects on Problem-…

200 papers

This paper surveys the development of large language model (LLM)-based agents for question answering (QA). Traditional agents face significant limitations, including substantial data requirements and difficulty in generalizing to new…

Computation and Language · Computer Science 2025-03-26 Murong Yue

Writing well requires not only expressing ideas but also refining them through revision, a process facilitated by reflection. Prior research suggests that feedback delivered through dialogues, such as those in writing center tutoring…

Human-Computer Interaction · Computer Science 2025-04-14 Jiho Kim , Philippe Laban , Xiang 'Anthony' Chen , Kenneth C. Arnold

Large Language Model (LLM)-based agents are increasingly employed to automate complex software engineering tasks, such as program repair and issue resolution. These agents operate by autonomously generating natural language thoughts,…

Software Engineering · Computer Science 2025-10-09 Islem Bouzenia , Michael Pradel

Large language models (LLMs) provide detailed and impressive responses to queries in English. However, are they really consistent at responding to the same query in other languages? The popular way of evaluating for multilingual performance…

Computation and Language · Computer Science 2025-05-29 Ashim Gupta , Maitrey Mehta , Zhichao Xu , Vivek Srikumar

Complex tasks involving tool integration pose significant challenges for Large Language Models (LLMs), leading to the emergence of multi-agent workflows as a promising solution. Reflection has emerged as an effective strategy for correcting…

Artificial Intelligence · Computer Science 2025-06-06 Zikang Guo , Benfeng Xu , Xiaorui Wang , Zhendong Mao

Large Language Models (LLMs) are known to process information using a proficient internal language consistently, referred to as latent language, which may differ from the input or output languages. However, how the discrepancy between the…

Large Language Models (LLMs) often produce explicit reflective traces during complex reasoning, accompanied by anthropomorphic markers such as wait, hmm, and alternatively. Although these markers are commonly used as visible indicators of…

Computation and Language · Computer Science 2026-05-28 Yahan Yu , Noa Nakanishi , Fei Cheng

Large language models (LLMs) are revolutionizing education, with LLM-based agents playing a key role in simulating student behavior. A major challenge in student simulation is modeling the diverse learning patterns of students at various…

Machine Learning · Computer Science 2025-08-12 Tao Wu , Jingyuan Chen , Wang Lin , Mengze Li , Yumeng Zhu , Ang Li , Kun Kuang , Fei Wu

Although large language models (LLMs) have transformed AI, they still make mistakes and can explore unproductive reasoning paths. Self-correction capability is essential for deploying LLMs in safety-critical applications. We uncover a…

Computation and Language · Computer Science 2025-10-07 Ken Tsui

Designing good reflection questions is pedagogically important but time-consuming and unevenly supported across teachers. This paper introduces a reflection-in-reflection framework for automated generation of reflection questions with large…

Machine Learning · Computer Science 2026-01-22 Ondřej Holub , Essi Ryymin , Rodrigo Alves

Traditional interventions for academic procrastination often fail to capture the nuanced, individual-specific factors that underlie them. Large language models (LLMs) hold immense potential for addressing this gap by permitting open-ended…

Large Language Models (LLMs) are able to improve their responses when instructed to do so, a capability known as self-correction. When instructions provide only the task's goal without specific details about potential issues in the…

Computation and Language · Computer Science 2024-11-11 Guangliang Liu , Haitao Mao , Bochuan Cao , Zhiyu Xue , Xitong Zhang , Rongrong Wang , Jiliang Tang , Kristen Johnson

Large Language Models (LLMs) have been shown to exhibit various biases and stereotypes in their generated content. While extensive research has investigated biases in LLMs, prior work has predominantly focused on explicit bias, with minimal…

Computation and Language · Computer Science 2025-06-04 Yachao Zhao , Bo Wang , Yan Wang , Dongming Zhao , Ruifang He , Yuexian Hou

Recent studies show that LLMs possess different skills and specialize in different tasks. In fact, we observe that their varied performance occur in several levels of granularity. For example, in the code optimization task, code LLMs excel…

Artificial Intelligence · Computer Science 2025-10-24 Yuanzhe Liu , Ryan Deng , Tim Kaler , Xuhao Chen , Charles E. Leiserson , Yao Ma , Jie Chen

Influence functions are important for quantifying the impact of individual training data points on a model's predictions. Although extensive research has been conducted on influence functions in traditional machine learning models, their…

Computation and Language · Computer Science 2024-12-23 Zhe Li , Wei Zhao , Yige Li , Jun Sun

Reasoning is a fundamental capability of large language models (LLMs), enabling them to comprehend, analyze, and solve complex problems. In this paper, we introduce TextGames, an innovative benchmark specifically crafted to assess LLMs…

Computation and Language · Computer Science 2025-02-26 Frederikus Hudi , Genta Indra Winata , Ruochen Zhang , Alham Fikri Aji

Deep research agents increasingly automate complex information-seeking tasks, producing evidence-grounded reports via multi-step reasoning, tool use, and synthesis. Their growing role demands scalable, reliable evaluation, positioning…

Computation and Language · Computer Science 2026-05-20 Leyao Wang , Yanan He , Peng Chen , Asaf Yehudai , Yixin Liu , Rex Ying , Michal Shmueli-Scheuer , Arman Cohan

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing complex cognitive tasks. However, their complexity and lack of transparency have raised several trustworthiness concerns, including the propagation of…

Machine Learning · Computer Science 2023-11-07 Satyapriya Krishna

Large language models (LLMs) have brought autonomous agents closer to artificial general intelligence (AGI) due to their promising generalization and emergent capabilities. There is, however, a lack of studies on how LLM-based agents…

Artificial Intelligence · Computer Science 2024-08-13 Yanan Chen , Ali Pesaranghader , Tanmana Sadhu , Dong Hoon Yi

Teachers' growth mindset supportive language (GMSL)--rhetoric emphasizing that one's skills can be improved over time--has been shown to significantly reduce disparities in academic achievement and enhance students' learning outcomes.…

Computation and Language · Computer Science 2023-10-17 Kunal Handa , Margaret Clapper , Jessica Boyle , Rose E Wang , Diyi Yang , David S Yeager , Dorottya Demszky