English
Related papers

Related papers: Training LLM-Based Agents with Synthetic Self-Refl…

200 papers

Large Language Models (LLMs) agents are increasingly pivotal for addressing complex tasks in interactive environments. Existing work mainly focuses on enhancing performance through behavior cloning from stronger experts, yet such approaches…

Artificial Intelligence · Computer Science 2025-03-25 Siyu Yuan , Zehui Chen , Zhiheng Xi , Junjie Ye , Zhengyin Du , Jiecao Chen

The popularity of Large Language Models (LLMs) have unleashed a new age ofLanguage Agents for solving a diverse range of tasks. While contemporary frontier LLMs are capable enough to power reasonably good Language agents, the closed-API…

Computation and Language · Computer Science 2024-10-11 Priyanshu Gupta , Shashank Kirtania , Ananya Singha , Sumit Gulwani , Arjun Radhakrishna , Sherry Shi , Gustavo Soares

While large language models (LLMs) show impressive decision-making abilities, current methods lack a mechanism for automatic self-improvement from errors during task execution. We propose LEAP, an iterative fine-tuning framework that…

Machine Learning · Computer Science 2024-10-10 Sanjiban Choudhury , Paloma Sodhi

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Large language model (LLM)-based agents have shown promise in tackling complex tasks by interacting dynamically with the environment. Existing work primarily focuses on behavior cloning from expert demonstrations or preference learning…

Machine Learning · Computer Science 2025-05-30 Hanlin Wang , Jian Wang , Chak Tou Leong , Wenjie Li

Tool-augmented large language models (LLMs) are usually trained with supervised imitation or coarse-grained reinforcement learning that optimizes single tool calls. Current self-reflection practices rely on heuristic prompts or one-way…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Junhao Su , Yuanliang Wan , Junwei Yang , Hengyu Shi , Tianyang Han , Junfeng Luo , Yurui Qiu

Reflection, the ability of large language models (LLMs) to evaluate and revise their own reasoning, has been widely used to improve performance on complex reasoning tasks. Yet, most prior works emphasizes designing reflective prompting…

Machine Learning · Computer Science 2025-12-12 Fu-Chieh Chang , Yu-Ting Lee , Pei-Yuan Wu

We explore the use of Large Language Models (LLMs) for automated assessment of open-text student reflections and prediction of academic performance. Traditional methods for evaluating reflections are time-consuming and may not scale…

Machine Learning · Computer Science 2025-06-19 Gen Li , Li Chen , Cheng Tang , Valdemar Švábenský , Daisuke Deguchi , Takayoshi Yamashita , Atsushi Shimada

Finetuning language agents with reasoning-action trajectories is effective, but obtaining these trajectories from human annotations or stronger models is costly and sometimes impractical. In this paper, we investigate the use of…

Computation and Language · Computer Science 2025-05-08 Zi-Yi Dou , Cheng-Fu Yang , Xueqing Wu , Kai-Wei Chang , Nanyun Peng

Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent. However, effectively integrating these capabilities with collaborative signals while…

Information Retrieval · Computer Science 2026-02-13 Yang Wu , Haoze Wang , Qian Li , Jun Zhang , Huan Yu , Jie Jiang

Despite the rapid advancements in LLM agents, they still face the challenge of generating meaningful reflections due to inadequate error analysis and a reliance on rare successful trajectories, especially in complex tasks. In this work, we…

Artificial Intelligence · Computer Science 2025-09-26 Yubin Ge , Salvatore Romeo , Jason Cai , Monica Sunkara , Yi Zhang

Large language models (LLMs) have exhibited remarkable performance in various natural language processing tasks. Techniques like instruction tuning have effectively enhanced the proficiency of LLMs in the downstream task of machine…

Computation and Language · Computer Science 2024-06-13 Yutong Wang , Jiali Zeng , Xuebo Liu , Fandong Meng , Jie Zhou , Min Zhang

In this study, we investigated the effects of self-reflection in large language models (LLMs) on problem-solving performance. We instructed nine popular LLMs to answer a series of multiple-choice questions to provide a performance baseline.…

Computation and Language · Computer Science 2025-03-17 Matthew Renze , Erhan Guven

Large Language Model (LLM)-based agents have recently shown impressive capabilities in complex reasoning and tool use via multi-step interactions with their environments. While these agents have the potential to tackle complicated tasks,…

Artificial Intelligence · Computer Science 2025-11-04 Jiaye Lin , Yifu Guo , Yuzhen Han , Sen Hu , Ziyi Ni , Licheng Wang , Mingguang Chen , Hongzhang Liu , Ronghao Chen , Yangfan He , Daxin Jiang , Binxing Jiao , Chen Hu , Huacan Wang

The emergence of large language model (LLM)-based agents has significantly advanced the development of autonomous machine learning (ML) engineering. However, the dominant prompt-based paradigm exhibits limitations: smaller models lack the…

Computation and Language · Computer Science 2026-05-04 Zexi Liu , Jingyi Chai , Xinyu Zhu , Shuo Tang , Rui Ye , Bo Zhang , Lei Bai , Siheng Chen

Large language models (LLMs) have been increasingly used to interact with external environments (e.g., games, compilers, APIs) as goal-driven agents. However, it remains challenging for these language agents to quickly and efficiently learn…

Artificial Intelligence · Computer Science 2023-10-11 Noah Shinn , Federico Cassano , Edward Berman , Ashwin Gopinath , Karthik Narasimhan , Shunyu Yao

Large Language Model (LLM) agents are increasingly improved through interaction, yet most self-evolution methods adapt either the policy or the learning environment in isolation. We identify this structural gap as \emph{Agent-Environment…

Computation and Language · Computer Science 2026-05-26 Yihao Hu , Zhihao Wen , Xiujin Liu , Pan Wang , Xin Zhang , Wei Wu

Large Language Models (LLMs) deployed in agentic environments must exercise multiple capabilities across different task instances, where a capability is performing one or more actions in a trajectory that are necessary for successfully…

Artificial Intelligence · Computer Science 2026-04-08 Hangoo Kang , Tarun Suresh , Jon Saad-Falcon , Azalia Mirhoseini

Recent advancements in Large Language Models (LLMs) have spurred interest in deploying LLM agents to undertake tasks in the world. LLMs are often deployed in agent systems: code that orchestrates LLM calls and provides them with tools. We…

Artificial Intelligence · Computer Science 2025-05-20 Maxime Robeyns , Martin Szummer , Laurence Aitchison

Large language models (LLMs) have shown increasing capacity at planning and executing a high-level goal in a live computer environment (e.g. MiniWoB++). To perform a task, recent works often require a model to learn from trace examples of…

Computation and Language · Computer Science 2023-10-24 Tao Li , Gang Li , Zhiwei Deng , Bryan Wang , Yang Li
‹ Prev 1 2 3 10 Next ›