English
Related papers

Related papers: Reinforcement Learning for LLM-based Multi-Agent S…

200 papers

Feature transformation enhances downstream task performance by generating informative features through mathematical feature crossing. Despite the advancements in deep learning, feature transformation remains essential for structured data,…

Machine Learning · Computer Science 2026-03-02 Tao Zhe , Huazhen Fang , Kunpeng Liu , Qian Lou , Tamzidul Hoque , Dongjie Wang

Recent work, spanning from autonomous vehicle coordination to in-space assembly, has shown the importance of learning collaborative behavior for enabling robots to achieve shared goals. A common approach for learning this cooperative…

Multiagent Systems · Computer Science 2025-02-25 Kartik Nagpal , Dayi Dong , Jean-Baptiste Bouvier , Negar Mehr

Large Language Models (LLMs) have emerged as integral tools for reasoning, planning, and decision-making, drawing upon their extensive world knowledge and proficiency in language-related tasks. LLMs thus hold tremendous potential for…

Artificial Intelligence · Computer Science 2024-05-24 Xudong Guo , Kaixuan Huang , Jiale Liu , Wenhui Fan , Natalia Vélez , Qingyun Wu , Huazheng Wang , Thomas L. Griffiths , Mengdi Wang

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer…

Machine Learning · Computer Science 2022-03-08 Xiaobai Ma , David Isele , Jayesh K. Gupta , Kikuo Fujimura , Mykel J. Kochenderfer

The emergence of agentic reinforcement learning (Agentic RL) marks a paradigm shift from conventional reinforcement learning applied to large language models (LLM RL), reframing LLMs from passive sequence generators into autonomous,…

Reinforcement learning can train LLM agents from sparse task rewards, but long-horizon credit assignment remains challenging: a single success-or-failure signal must be distributed across many actions. Existing methods rely on…

Artificial Intelligence · Computer Science 2026-05-20 Xiaozhe Li , Tianyi Lyu , Yang Li , Yichuan Ma , Peiji Li , Linyang Li , Qipeng Guo , Dahua Lin , Kai Chen

Designing effective reward functions remains a fundamental challenge in reinforcement learning (RL), as it often requires extensive human effort and domain expertise. While RL from human feedback has been successful in aligning agents with…

Machine Learning · Computer Science 2025-06-17 Tung Minh Luu , Younghwan Lee , Donghoon Lee , Sunho Kim , Min Jun Kim , Chang D. Yoo

We present Agent Lightning, a flexible and extensible framework that enables Reinforcement Learning (RL)-based training of Large Language Models (LLMs) for any AI agent. Unlike existing methods that tightly couple RL training with agent or…

Artificial Intelligence · Computer Science 2025-08-06 Xufang Luo , Yuge Zhang , Zhiyuan He , Zilong Wang , Siyun Zhao , Dongsheng Li , Luna K. Qiu , Yuqing Yang

We present a decentralized reinforcement learning (RL) approach to address the multi-agent shepherding control problem, departing from the conventional assumption of cohesive target groups. Our two-layer control architecture consists of a…

Systems and Control · Electrical Eng. & Systems 2026-01-29 Italo Napolitano , Andrea Lama , Francesco De Lellis , Mario di Bernardo

Large Language Models (LLMs) often struggle when prompted to generate content under specific constraints. However, in such cases it is often easy to check whether these constraints are satisfied or violated. Recent works have shown that…

Computation and Language · Computer Science 2024-11-07 Liat Bezalel , Eyal Orgad , Amir Globerson

Reward design plays a pivotal role in aligning large language models (LLMs) with human values, serving as the bridge between feedback signals and model optimization. This survey provides a structured organization of reward modeling and…

Computation and Language · Computer Science 2025-09-03 Miaomiao Ji , Yanqiu Wu , Zhibin Wu , Shoujin Wang , Jian Yang , Mark Dras , Usman Naseem

Reinforcement learning (RL) holds significant promise for training LLM agents to handle complex, goal-oriented tasks that require multi-step interactions with external environments. However, a critical challenge when applying RL to these…

Computation and Language · Computer Science 2025-05-28 Hanlin Wang , Chak Tou Leong , Jiashuo Wang , Jian Wang , Wenjie Li

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

We address the problem of teaching a deep reinforcement learning (RL) agent to follow instructions in multi-task environments. Instructions are expressed in a well-known formal language -- linear temporal logic (LTL) -- and can specify a…

Artificial Intelligence · Computer Science 2021-07-07 Pashootan Vaezipoor , Andrew Li , Rodrigo Toro Icarte , Sheila McIlraith

Reinforcement Learning (RL) has emerged as a powerful paradigm in Artificial Intelligence (AI), enabling agents to learn optimal behaviors through interactions with their environments. Drawing from the foundations of trial and error, RL…

Artificial Intelligence · Computer Science 2025-02-04 Majid Ghasemi , Amir Hossein Moosavi , Dariush Ebrahimi

Recent advancements in large language models (LLMs) have enabled understanding webpage contexts, product details, and human instructions. Utilizing LLMs as the foundational architecture for either reward models or policies in reinforcement…

Machine Learning · Computer Science 2024-08-30 Shuang Feng , Grace Feng

Reward models (RMs) have become essential for aligning large language models (LLMs), serving as scalable proxies for human evaluation in both training and inference. However, existing RMs struggle on knowledge-intensive and long-form tasks,…

Computation and Language · Computer Science 2025-10-30 Ziyou Hu , Zhengliang Shi , Minghang Zhu , Haitao Li , Teng Sun , Pengjie Ren , Suzan Verberne , Zhaochun Ren

Reinforcement Learning (RL) has emerged as a powerful paradigm for training LLM-based agents, yet remains limited by low sample efficiency, stemming not only from sparse outcome feedback but also from the agent's inability to leverage prior…

Machine Learning · Computer Science 2026-03-19 Dilxat Muhtar , Jiashun Liu , Wei Gao , Weixun Wang , Shaopan Xiong , Ju Huang , Siran Yang , Wenbo Su , Jiamang Wang , Ling Pan , Bo Zheng

Reinforcement Learning (RL) offers a powerful framework for optimizing dynamic treatment regimes (DTRs). However, clinical RL is fundamentally bottlenecked by reward engineering: the challenge of defining signals that safely and effectively…

Machine Learning · Computer Science 2026-02-05 Qianyi Xu , Gousia Habib , Feng Wu , Yanrui Du , Zhihui Chen , Swapnil Mishra , Dilruk Perera , Mengling Feng

Online question-and-answer (Q\&A) systems based on the Large Language Model (LLM) have progressively diverged from recreational to professional use. This paper proposed a Multi-Agent framework with environmentally reinforcement learning…

Software Engineering · Computer Science 2024-09-05 Jiapeng Yu , Yuqian Wu , Yajing Zhan , Wenhao Guo , Zhou Xu , Raymond Lee