English
Related papers

Related papers: Watch Every Step! LLM Agent Learning via Iterative…

200 papers

Existing research on large language models (LLMs) shows that they can solve information extraction tasks through multi-step planning. However, their extraction behavior on complex sentences and tasks is unstable, emerging issues such as…

Computation and Language · Computer Science 2024-08-30 Zepeng Ding , Ruiyang Ke , Wenhao Huang , Guochao Jiang , Yanda Li , Deqing Yang , Jiaqing Liang

Large language model (LLM)-based search agents have proven promising for addressing knowledge-intensive problems by incorporating information retrieval capabilities. Existing works largely focus on optimizing the reasoning paradigms of…

Artificial Intelligence · Computer Science 2026-01-09 Tongyu Wen , Guanting Dong , Zhicheng Dou

In recent years, instruction fine-tuning (IFT) on large language models (LLMs) has garnered considerable attention to enhance model performance on unseen tasks. Attempts have been made on automatic construction and effective selection for…

Computation and Language · Computer Science 2024-10-25 Renhao Li , Minghuan Tan , Derek F. Wong , Min Yang

Large Language Models (LLMs) have achieved strong performance on a wide range of complex reasoning tasks, yet further gains are often possible by leveraging the complementary strengths of multiple models. While multi-agent frameworks can…

Multiagent Systems · Computer Science 2025-07-15 Andrew Estornell , Jean-Francois Ton , Muhammad Faaiz Taufiq , Hang Li

We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte…

Artificial Intelligence · Computer Science 2024-06-19 Yuxi Xie , Anirudh Goyal , Wenyue Zheng , Min-Yen Kan , Timothy P. Lillicrap , Kenji Kawaguchi , Michael Shieh

Existing multi-agent learning approaches have developed interactive training environments to explicitly promote collaboration among multiple Large Language Models (LLMs), thereby constructing stronger multi-agent systems (MAS). However,…

Artificial Intelligence · Computer Science 2026-04-14 Hehai Lin , Shilei Cao , Sudong Wang , Haotian Wu , Minzhi Li , Linyi Yang , Juepeng Zheng , Chengwei Qin

Information retrieval (IR) systems have traditionally been designed and trained for human users, with learning-to-rank methods relying heavily on large-scale human interaction logs such as clicks and dwell time. With the rapid emergence of…

Information Retrieval · Computer Science 2026-04-08 Yuqi Zhou , Sunhao Dai , Changle Qu , Liang Pang , Jun Xu , Ji-Rong Wen

Process Reward Models (PRMs) provide step-level supervision to large language models (LLMs), but scaling up training data annotation remains challenging for both humans and LLMs. To address this limitation, we propose an active learning…

Machine Learning · Computer Science 2025-04-16 Keyu Duan , Zichen Liu , Xin Mao , Tianyu Pang , Changyu Chen , Qiguang Chen , Michael Qizhe Shieh , Longxu Dou

Agents significantly enhance the capabilities of standalone Large Language Models (LLMs) by perceiving environments, making decisions, and executing actions. However, LLM agents still face challenges in tasks that require multiple…

Artificial Intelligence · Computer Science 2024-09-17 Yuanzhao Zhai , Tingkai Yang , Kele Xu , Feng Dawei , Cheng Yang , Bo Ding , Huaimin Wang

With the development of large language models, their ability to follow simple instructions has significantly improved. However, adhering to complex instructions remains a major challenge. Current approaches to generating complex…

Computation and Language · Computer Science 2025-02-28 Wei Liu , Yancheng He , Hui Huang , Chengwei Hu , Jiaheng Liu , Shilong Li , Wenbo Su , Bo Zheng

While Large Language Models (LLMs) have evolved into tool-using agents, they remain brittle in long-horizon interactions. Unlike mathematical reasoning where errors are often rectifiable via backtracking, tool-use failures frequently induce…

Artificial Intelligence · Computer Science 2026-03-17 Shengda Fan , Xuyan Ye , Yupeng Huo , Zhi-Yuan Chen , Yiju Guo , Shenzhi Yang , Wenkai Yang , Shuqi Ye , Jingwen Chen , Haotian Chen , Xin Cong , Yankai Lin

Leveraging multiple large language models (LLMs) to build collaborative multi-agentic workflows has demonstrated significant potential. However, most previous studies focus on prompting the out-of-the-box LLMs, relying on their innate…

Artificial Intelligence · Computer Science 2025-07-15 Chanwoo Park , Seungju Han , Xingzhi Guo , Asuman Ozdaglar , Kaiqing Zhang , Joo-Kyung Kim

The rapid adoption of Large Language Models (LLMs) in interactive systems has enabled the creation of dynamic, open-ended Role-Playing Agents (RPAs). However, evaluating these agents remains a significant challenge, as standard NLP metrics…

Computation and Language · Computer Science 2026-04-14 Riccardo Rosati , Edoardo Colucci , Massimiliano Bolognini , Adriano Mancini , Paolo Sernani

Practical deployment of multi-agent systems (MAS) demands strong performance at test time, motivating methods that guide search during inference and selectively spend compute to improve quality. We present the Multi-Agent System Process…

Multiagent Systems · Computer Science 2026-02-16 Milad Yazdani , Mahdi Mostajabdaveh , Zirui Zhou , Ying Xiong

Large Language Models (LLMs) increasingly rely on external tools such as search engines to solve complex agentic tasks that require reasoning and external knowledge retrieval. Recently, reinforcement learning with verifiable rewards (RLVR)…

Artificial Intelligence · Computer Science 2025-10-01 Peiran Xu , Zhuohao Li , Xiaoying Xing , Guannan Zhang , Debiao Li , Kunyu Shi

Multi-step planning has been widely employed to enhance the performance of large language models (LLMs) on downstream natural language processing (NLP) tasks, which decomposes the original task into multiple subtasks and guide LLMs to solve…

Computation and Language · Computer Science 2025-05-20 Zepeng Ding , Dixuan Wang , Ziqin Luo , Guochao Jiang , Deqing Yang , Jiaqing Liang

Large Language Models (LLMs) offer a promising basis for creating agents that can tackle complex tasks through iterative environmental interaction. Existing methods either require these agents to mimic expert-provided trajectories or rely…

Computation and Language · Computer Science 2024-12-02 Dihong Gong , Pu Lu , Zelong Wang , Meng Zhou , Xiuqiang He

Training large language models is a computationally intensive process that often requires substantial resources to achieve state-of-the-art results. Incremental layer-wise training has been proposed as a potential strategy to optimize the…

Computation and Language · Computer Science 2024-12-02 Miles Q. Li , Benjamin C. M. Fung , Shih-Chia Huang

Reinforcement learning (RL) holds significant promise for training LLM agents to handle complex, goal-oriented tasks that require multi-step interactions with external environments. However, a critical challenge when applying RL to these…

Computation and Language · Computer Science 2025-05-28 Hanlin Wang , Chak Tou Leong , Jiashuo Wang , Jian Wang , Wenjie Li

Recent advancements in large language models (LLMs) have demonstrated that progressive refinement, rather than providing a single answer, results in more accurate and thoughtful outputs. However, existing methods often rely heavily on…

Computation and Language · Computer Science 2024-10-18 Chengyu Du , Jinyi Han , Yizhou Ying , Aili Chen , Qianyu He , Haokun Zhao , Sirui Xia , Haoran Guo , Jiaqing Liang , Zulong Chen , Liangyue Li , Yanghua Xiao