English
Related papers

Related papers: Training LLM-Based Agents with Synthetic Self-Refl…

200 papers

Retrieval-Augmented Language Models (RALMs) represent a classic paradigm where models enhance generative capabilities using external knowledge retrieved via a specialized module. Recent advancements in Agent techniques enable Large Language…

Computation and Language · Computer Science 2025-05-28 Weiqi Wu , Xin Guan , Shen Huang , Yong Jiang , Pengjun Xie , Fei Huang , Jiuxin Cao , Hai Zhao , Jingren Zhou

The performance gap between closed-source and open-source large language models (LLMs) is largely attributed to disparities in access to high-quality training data. To bridge this gap, we introduce a novel framework for the automated…

Language agents can adapt from experience in interactive environments, but current reflection-based methods can only self-correct within a single task instance. Whether such experience can be distilled into reusable lessons that improve…

Machine Learning · Computer Science 2026-05-21 Yuval Shalev , Zifeng Ding , Mateja Jamnik

Large language models (LLMs) have significantly advanced in various fields and intelligent agent applications. However, current LLMs that learn from human or external model supervision are costly and may face performance ceilings as task…

Computation and Language · Computer Science 2024-06-04 Zhengwei Tao , Ting-En Lin , Xiancai Chen , Hangyu Li , Yuchuan Wu , Yongbin Li , Zhi Jin , Fei Huang , Dacheng Tao , Jingren Zhou

In autonomic computing, self-adaptation has been proposed as a fundamental paradigm to manage the complexity of multiagent systems (MASs). This achieved by extending a system with support to monitor and adapt itself to achieve specific…

Multiagent Systems · Computer Science 2023-07-13 Nathalia Nascimento , Paulo Alencar , Donald Cowan

Agents powered by large language models (LLMs) have demonstrated strong planning and decision-making capabilities in complex embodied environments. However, such agents often suffer from inefficiencies in multi-turn interactions, frequently…

Computation and Language · Computer Science 2025-09-23 Qingyu Lu , Liang Ding , Siyi Cao , Xuebo Liu , Kanjian Zhang , Jinxia Zhang , Dacheng Tao

Search agents powered by Large Language Models (LLMs) have demonstrated significant potential in tackling knowledge-intensive tasks. Reinforcement learning (RL) has emerged as a powerful paradigm for training these agents to perform…

Computation and Language · Computer Science 2026-05-11 Shiyu Li , Yang Tang , Yifan Wang , Peiming Li , Xi Chen

Large Language Models (LLMs) have shown tremendous potential as agents, excelling at tasks that require multiple rounds of reasoning and interactions. Rejection Sampling Fine-Tuning (RFT) has emerged as an effective method for finetuning…

Artificial Intelligence · Computer Science 2025-04-22 Li-Cheng Lan , Andrew Bai , Minhao Cheng , Cho-Jui Hsieh , Tianyi Zhou

Task planning, the problem of sequencing actions to reach a goal from an initial state, is a core capability requirement for autonomous robotic systems. Whether large language models (LLMs) can serve as viable planners alongside classical…

Artificial Intelligence · Computer Science 2026-03-09 Kai Göbel , Pierrick Lorang , Patrik Zips , Tobias Glück

Large language models (LLMs) possess extensive knowledge bases and strong reasoning capabilities, making them promising tools for complex, multi-agent planning in embodied environments. However, despite LLMs' advanced abilities and the…

Multiagent Systems · Computer Science 2025-06-10 Xinran Li , Chenjia Bai , Zijian Li , Jiakun Zheng , Ting Xiao , Jun Zhang

This paper introduces the innovative "LLMs-as-Instructors" framework, which leverages the advanced Large Language Models (LLMs) to autonomously enhance the training of smaller target models. Inspired by the theory of "Learning from Errors",…

Computation and Language · Computer Science 2024-07-02 Jiahao Ying , Mingbao Lin , Yixin Cao , Wei Tang , Bo Wang , Qianru Sun , Xuanjing Huang , Shuicheng Yan

Extending the capabilities of Large Language Models (LLMs) with functions or tools for environment interaction has led to the emergence of the agent paradigm. In industry, training an LLM is not always feasible because of the scarcity of…

Computation and Language · Computer Science 2025-01-14 Saptarshi Sengupta , Harsh Vashistha , Kristal Curtis , Akshay Mallipeddi , Abhinav Mathur , Joseph Ross , Liang Gou

With the power of large language models (LLMs), open-ended embodied agents can flexibly understand human instructions, generate interpretable guidance strategies, and output executable actions. Nowadays, Multi-modal Language Models~(MLMs)…

Artificial Intelligence · Computer Science 2024-04-11 Zhonghan Zhao , Ke Ma , Wenhao Chai , Xuan Wang , Kewei Chen , Dongxu Guo , Yanting Zhang , Hongwei Wang , Gaoang Wang

Skills provide an effective mechanism for improving LLM agents on complex tasks, yet in existing agent frameworks, their creation, refinement, and selection are typically governed by external teachers, hand-designed rules, or auxiliary…

Artificial Intelligence · Computer Science 2026-05-13 Min Yang , Jinghua Piao , Xu Xia , Xiaochong Lan , Jiaju Chen , Yongshun Gong , Yong Li

In order to be deployed safely, Large Language Models (LLMs) must be capable of dynamically adapting their behavior based on their level of knowledge and uncertainty associated with specific topics. This adaptive behavior, which we refer to…

Computation and Language · Computer Science 2024-07-04 Alexandre Piché , Aristides Milios , Dzmitry Bahdanau , Chris Pal

Reinforcement learning (RL) trains agents to accomplish complex tasks through environmental interaction data, but its capacity is also limited by the scope of the available data. To obtain a knowledgeable agent, a promising approach is to…

Machine Learning · Computer Science 2024-04-16 Jing-Cheng Pang , Si-Hang Yang , Kaiyuan Li , Jiaji Zhang , Xiong-Hui Chen , Nan Tang , Yang Yu

Large language models (LLMs) demonstrate strong reasoning abilities across mathematical, strategic, and linguistic tasks, yet little is known about how well they reason in dynamic, real-time, multi-agent scenarios, such as collaborative…

Multiagent Systems · Computer Science 2026-01-01 Shaurya Mallampati , Rashed Shelim , Walid Saad , Naren Ramakrishnan

The rise of large language models (LLMs) has prompted increasing interest in their use as in-context learning agents. At the core of agentic behavior is the capacity for exploration, or the ability to actively gather information about the…

Computation and Language · Computer Science 2024-10-14 Nate Rahn , Pierluca D'Oro , Marc G. Bellemare

Open large language models (LLMs) have significantly advanced the field of natural language processing, showcasing impressive performance across various tasks.Despite the significant advancements in LLMs, their effective operation still…

Computation and Language · Computer Science 2025-04-16 Xuechen Liang , Yangfan He , Meiling Tao , Yinghui Xia , Jianhui Wang , Tianyu Shi , Jun Wang , JingSong Yang

Since the advent of Large Language Models (LLMs), various research based on such models have maintained significant academic attention and impact, especially in AI and robotics. In this paper, we propose a multi-agent framework with LLMs to…

Robotics · Computer Science 2025-05-12 Junhong Chen , Ziqi Yang , Haoyuan G Xu , Dandan Zhang , George Mylonas