English
Related papers

Related papers: Higher Replay Ratio Empowers Sample-Efficient Mult…

200 papers

Analysing learning in Multi-Agent Reinforcement Learning (MARL) environments is challenging, in particular with respect to \textit{individual} decision-making. Practitioners frequently struggle to compare training runs due to the inherent…

Multiagent Systems · Computer Science 2026-05-29 James Rudd-Jones , María Pérez-Ortiz , Mirco Musolesi

Reinforcement Learning (RL) has shown promise for aligning Large Language Models (LLMs) to follow instructions with various constraints. Despite the encouraging results, RL improvement inevitably relies on sampling successful, high-quality…

Artificial Intelligence · Computer Science 2025-12-30 Kongcheng Zhang , Qi Yao , Shunyu Liu , Wenjian Zhang , Min Cen , Yang Zhou , Wenkai Fang , Yiru Zhao , Baisheng Lai , Mingli Song

Multi-agent reinforcement learning (MARL) methods have achieved state-of-the-art results on a range of multi-agent tasks. Yet, MARL algorithms typically require significantly more environment interactions than their single-agent…

Systems and Control · Electrical Eng. & Systems 2026-03-17 Tom Danino , Nahum Shimkin

A major challenge of reinforcement learning (RL) in real-world applications is the variation between environments, tasks or clients. Meta-RL (MRL) addresses this issue by learning a meta-policy that adapts to new tasks. Standard MRL methods…

Machine Learning · Computer Science 2023-10-03 Ido Greenberg , Shie Mannor , Gal Chechik , Eli Meirom

Reinforcement learning (RL) has increasingly become a pivotal technique in the post-training of large language models (LLMs). The effective exploration of the output space is essential for the success of RL. We observe that for complex…

Machine Learning · Computer Science 2025-07-08 Shihan Dou , Muling Wu , Jingwen Xu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Multi-agent reinforcement learning (MARL) methods often suffer from high sample complexity, limiting their use in real-world problems where data is sparse or expensive to collect. Although latent-variable world models have been employed to…

Machine Learning · Computer Science 2024-02-15 Aravind Venugopal , Stephanie Milani , Fei Fang , Balaraman Ravindran

Autonomous vehicles (AV) offer a cost-effective solution for scientific missions such as underwater tracking. Recently, reinforcement learning (RL) has emerged as a powerful method for controlling AVs in complex marine environments.…

Robotics · Computer Science 2025-10-20 Matteo Gallici , Ivan Masmitja , Mario Martín

Deep reinforcement learning (RL) methods have significant potential for dialogue policy optimisation. However, they suffer from a poor performance in the early stages of learning. This is especially problematic for on-line learning with…

Computation and Language · Computer Science 2017-07-06 Pei-Hao Su , Pawel Budzianowski , Stefan Ultes , Milica Gasic , Steve Young

Reinforcement learning (RL) has emerged as a promising strategy for finetuning small language models (SLMs) to solve targeted tasks such as math and coding. However, RL algorithms tend to be resource-intensive, taking a significant amount…

Machine Learning · Computer Science 2025-10-07 Lianghuan Huang , Sagnik Anupam , Insup Lee , Shuo Li , Osbert Bastani

Replaying past experiences has proven to be a highly effective approach for averting catastrophic forgetting in supervised continual learning. However, some crucial factors are still largely ignored, making it vulnerable to serious failure,…

Machine Learning · Computer Science 2023-11-21 Tiantian Zhang , Kevin Zehua Shen , Zichuan Lin , Bo Yuan , Xueqian Wang , Xiu Li , Deheng Ye

A long-standing problem in online reinforcement learning (RL) is of ensuring sample efficiency, which stems from an inability to explore environments efficiently. Most attempts at efficient exploration tackle this problem in a setting where…

Machine Learning · Computer Science 2025-07-08 Aman Mehra , Alexandre Capone , Jeff Schneider

Multi-agent reinforcement learning (MARL) has been gaining extensive attention from academia and industries in the past few decades. One of the fundamental problems in MARL is how to evaluate different approaches comprehensively. Most…

Multiagent Systems · Computer Science 2022-06-22 Zhiuxan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Jinlin Chen , Huafeng Xu

Model-based reinforcement learning uses models to plan, where the predictions and policies of an agent can be improved by using more computation without additional data from the environment, thereby improving sample efficiency. However,…

Machine Learning · Computer Science 2023-02-22 Animesh Kumar Paul , Videh Raj Nema

Multi-Agent Reinforcement Learning (MARL) struggles with sample inefficiency and poor generalization [1]. These challenges are partially due to a lack of structure or inductive bias in the neural networks typically used in learning the…

Machine Learning · Computer Science 2024-10-23 Joshua McClellan , Naveed Haghani , John Winder , Furong Huang , Pratap Tokekar

Significant advances have recently been achieved in Multi-Agent Reinforcement Learning (MARL) which tackles sequential decision-making problems involving multiple participants. However, MARL requires a tremendous number of samples for…

Multiagent Systems · Computer Science 2024-12-30 Xihuai Wang , Zhicheng Zhang , Weinan Zhang

Deep Reinforcement Learning (RL) algorithms can solve complex sequential decision tasks successfully. However, they have a major drawback of having poor sample efficiency which can often be tackled by knowledge reuse. In Multi-Agent…

Multiagent Systems · Computer Science 2019-05-30 Ercüment İlhan , Jeremy Gow , Diego Perez-Liebana

Sample inefficiency is a long-lasting challenge in deep reinforcement learning (DRL). Despite dramatic improvements have been made, the problem is far from being solved and is especially challenging in environments with sparse or delayed…

Machine Learning · Computer Science 2025-06-17 Federico Malato , Ville Hautamaki

While reinforcement learning (RL) methods that learn an internal model of the environment have the potential to be more sample efficient than their model-free counterparts, learning to model raw observations from high dimensional sensors…

Machine Learning · Computer Science 2023-06-27 Raj Ghugare , Homanga Bharadhwaj , Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer…

Machine Learning · Computer Science 2022-03-08 Xiaobai Ma , David Isele , Jayesh K. Gupta , Kikuo Fujimura , Mykel J. Kochenderfer

The multi-robot adaptive sampling problem aims at finding trajectories for a team of robots to efficiently sample the phenomenon of interest within a given endurance budget of the robots. In this paper, we propose a robust and scalable…

Robotics · Computer Science 2023-03-02 Lishuo Pan , Sandeep Manjanna , M. Ani Hsieh