English
Related papers

Related papers: Failure Makes the Agent Stronger: Enhancing Accura…

200 papers

Recent advances in large language models (LLMs) have enabled the development of autonomous agents capable of complex reasoning and multi-step problem solving. However, these agents struggle to adapt to specialized environments and do not…

Machine Learning · Computer Science 2026-04-02 Marc-Antoine Allard , Arnaud Teinturier , Victor Xing , Gautier Viaud

Large language model (LLM) agents achieve impressive single-task performance but commonly exhibit repeated failures, inefficient exploration, and limited cross-task adaptability. Existing reflective strategies (e.g., Reflexion, ReAct)…

Artificial Intelligence · Computer Science 2025-09-09 Chunlong Wu , Ye Luo , Zhibo Qu , Min Wang

Training large language models (LLMs) as autonomous agents often begins with imitation learning, but it only teaches agents what to do without understanding why: agents never contrast successful actions against suboptimal alternatives and…

Artificial Intelligence · Computer Science 2026-03-10 Weize Liu , Minghui Liu , Sy-Tuyen Ho , Souradip Chakraborty , Xiyao Wang , Furong Huang

Large Language Models (LLMs) are emerging as promising approaches to enhance session-based recommendation (SBR), where both prompt-based and fine-tuning-based methods have been widely investigated to align LLMs with SBR. However, the former…

Artificial Intelligence · Computer Science 2024-04-22 Ziyan Wang , Yingpeng Du , Zhu Sun , Haoyan Chua , Kaidong Feng , Wenya Wang , Jie Zhang

Medical problem-solving demands expert knowledge and intricate reasoning. Recent studies of large language models (LLMs) attempt to ease this complexity by introducing external knowledge verification through retrieval-augmented generation…

Computation and Language · Computer Science 2026-01-19 Yue Huang , Yanyuan Chen , Dexuan Xu , Chenzhuo Zhao , Weihua Yue , Yu Huang

Large language model-based multi-agent systems have shown great abilities across various tasks due to the collaboration of expert agents, each focusing on a specific domain. However, the impact of clumsy or even malicious agents--those who…

Artificial Intelligence · Computer Science 2025-05-30 Jen-tse Huang , Jiaxu Zhou , Tailin Jin , Xuhui Zhou , Zixi Chen , Wenxuan Wang , Youliang Yuan , Michael R. Lyu , Maarten Sap

Large Reasoning Models (LRMs) have recently shown impressive performance on complex reasoning tasks, often by engaging in self-reflective behaviors such as self-critique and backtracking. However, not all reflections are beneficial-many are…

Artificial Intelligence · Computer Science 2026-01-21 Hanbin Wang , Jingwei Song , Jinpeng Li , Qi Zhu , Fei Mi , Ganqu Cui , Yasheng Wang , Lifeng Shang

Large Language Models (LLMs) have demonstrated remarkable capabilities in knowledge acquisition, reasoning, and tool use, making them promising candidates for autonomous agent applications. However, training LLM agents for complex…

Machine Learning · Computer Science 2025-12-09 Hanjiang Hu , Changliu Liu , Na Li , Yebin Wang

Reinforcement learning has become the central approach for language models (LMs) to learn from environmental reward or feedback. In practice, the environmental feedback is usually sparse and delayed. Learning from such signals is…

Machine Learning · Computer Science 2026-02-17 Taiwei Shi , Sihao Chen , Bowen Jiang , Linxin Song , Longqi Yang , Jieyu Zhao

Large language models (LLMs) have demonstrated remarkable reasoning capability in solving mathematical problems. However, existing approaches primarily focus on improving the quality of correct training data, e.g., distilling high-quality…

Machine Learning · Computer Science 2025-06-02 Zhuoshi Pan , Yu Li , Honglin Lin , Qizhi Pei , Zinan Tang , Wei Wu , Chenlin Ming , H. Vicky Zhao , Conghui He , Lijun Wu

Self-reflection on learning experiences constitutes a fundamental cognitive process, essential for the consolidation of knowledge and the enhancement of learning efficacy. However, traditional methods to facilitate reflection often face…

We study what actually works and what doesn't for training large language models as agents via multi-turn reinforcement learning. Despite rapid progress, existing frameworks and definitions are fragmented, and there is no systematic…

Machine Learning · Computer Science 2025-12-09 Ruiyi Wang , Prithviraj Ammanabrolu

Recent studies suggest that self-reflective prompting can significantly enhance the reasoning capabilities of Large Language Models (LLMs). However, the use of external feedback as a stop criterion raises doubts about the true extent of…

Computation and Language · Computer Science 2024-04-16 Yanhong Li , Chenghao Yang , Allyson Ettinger

We explore the use of Large Language Models (LLMs) for automated assessment of open-text student reflections and prediction of academic performance. Traditional methods for evaluating reflections are time-consuming and may not scale…

Machine Learning · Computer Science 2025-06-19 Gen Li , Li Chen , Cheng Tang , Valdemar Švábenský , Daisuke Deguchi , Takayoshi Yamashita , Atsushi Shimada

Multimodal Large Language Models (MLLMs) have shown great potential in revolutionizing Graphical User Interface (GUI) automation. However, existing GUI models mostly rely on learning from nearly error-free offline trajectories, thus lacking…

Artificial Intelligence · Computer Science 2025-06-10 Penghao Wu , Shengnan Ma , Bo Wang , Jiaheng Yu , Lewei Lu , Ziwei Liu

Recent advancements in Large Language Models (LLMs) have expanded the horizons of natural language understanding and generation. Notably, the output control and alignment with the input of LLMs can be refined through instruction tuning.…

Computation and Language · Computer Science 2023-10-19 Ming Li , Lichang Chen , Jiuhai Chen , Shwai He , Heng Huang , Jiuxiang Gu , Tianyi Zhou

Large language models (LLMs) have shown increasing capacity at planning and executing a high-level goal in a live computer environment (e.g. MiniWoB++). To perform a task, recent works often require a model to learn from trace examples of…

Computation and Language · Computer Science 2023-10-24 Tao Li , Gang Li , Zhiwei Deng , Bryan Wang , Yang Li

Low-resource languages such as isiZulu and isiXhosa face persistent challenges in machine translation due to limited parallel data and linguistic resources. Recent advances in large language models suggest that self-reflection, prompting a…

Computation and Language · Computer Science 2026-01-28 Nicholas Cheng

Self-reflection enables language agents to iteratively refine solutions, yet often produces repetitive outputs that limit reasoning performance. Recent studies have attempted to address this limitation through various approaches, among…

Machine Learning · Computer Science 2026-03-02 Tianjun Yao , Yongqiang Chen , Yujia Zheng , Pan Li , Zhiqiang Shen , Kun Zhang

In the aftermath of COVID-19, many universities implemented supplementary "reinforcement" roles to support students in demanding courses. Although the name for such roles may differ between institutions, the underlying idea of providing…

Computers and Society · Computer Science 2025-11-05 Noa Izsak