English
Related papers

Related papers: Coordinated Exploration in Concurrent Reinforcemen…

200 papers

We consider an extended notion of reinforcement learning in which the environment can simulate the agent and base its outputs on the agent's hypothetical behavior. Since good performance usually requires paying attention to whatever things…

Artificial Intelligence · Computer Science 2022-07-21 Samuel Allen Alexander , Michael Castaneda , Kevin Compher , Oscar Martinez

We study the problem of imitation learning from demonstrations of multiple coordinating agents. One key challenge in this setting is that learning a good model of coordination can be difficult, since coordination is often implicit in the…

Machine Learning · Computer Science 2018-05-28 Hoang M. Le , Yisong Yue , Peter Carr , Patrick Lucey

Deep Reinforcement Learning (DRL) and Deep Multi-agent Reinforcement Learning (MARL) have achieved significant successes across a wide range of domains, including game AI, autonomous vehicles, robotics, and so on. However, DRL and deep MARL…

Artificial Intelligence · Computer Science 2023-02-03 Jianye Hao , Tianpei Yang , Hongyao Tang , Chenjia Bai , Jinyi Liu , Zhaopeng Meng , Peng Liu , Zhen Wang

Reinforcement learning defines the problem facing agents that learn to make good decisions through action and observation alone. To be effective problem solvers, such agents must efficiently explore vast worlds, assign credit from delayed…

Machine Learning · Computer Science 2022-03-02 David Abel

One of the challenges in online reinforcement learning (RL) is that the agent needs to trade off the exploration of the environment and the exploitation of the samples to optimize its behavior. Whether we optimize for regret, sample…

Machine Learning · Computer Science 2021-11-19 Jean Tarbouriech , Matteo Pirotta , Michal Valko , Alessandro Lazaric

The ability to combine known skills to create new ones may be crucial in the solution of complex reinforcement learning problems that unfold over extended periods. We argue that a robust way of combining skills is to define and manipulate…

We develop a general problem setting for training and testing the ability of agents to gather information efficiently. Specifically, we present a collection of tasks in which success requires searching through a partially-observed…

Machine Learning · Computer Science 2016-12-09 Philip Bachman , Alessandro Sordoni , Adam Trischler

Training robots for operation in the real world is a complex, time consuming and potentially expensive task. Despite significant success of reinforcement learning in games and simulations, research in real robot applications has not been…

Artificial Intelligence · Computer Science 2017-09-28 Markus Wulfmeier , Ingmar Posner , Pieter Abbeel

This paper presents a cloud-based learning model predictive controller that integrates three interacting components: a set of agents, which must learn to perform a finite set of tasks with the minimum possible local cost; a coordinator,…

Systems and Control · Electrical Eng. & Systems 2022-12-01 Paula Chanfreut , José María Maestre , Eduardo F. Camacho , Francesco Borrelli

Sparse reward environments pose significant challenges in reinforcement learning, especially within multi-agent systems (MAS) where feedback is delayed and shared across agents, leading to suboptimal learning. We propose Collaborative…

Artificial Intelligence · Computer Science 2025-05-14 Yufei Lin , Chengwei Ye , Huanzhen Zhang , Kangsheng Wang , Linuo Xu , Shuyan Liu , Zeyu Zhang

Single-agent reinforcement learning algorithms in a multi-agent environment are inadequate for fostering cooperation. If intelligent agents are to interact and work together to solve complex problems, methods that counter non-cooperative…

Machine Learning · Computer Science 2022-03-09 Ted Fujimoto , Arthur Paul Pedersen

Reinforcement learning has become a powerful paradigm for improving the capability of intelligent systems, but its practical deployment faces two central challenges. First, reinforcement learning must scale efficiently in distributed…

Machine Learning · Computer Science 2026-05-12 Guangchen Lan

We study the problem of online model selection in reinforcement learning, where the selector has access to a class of reinforcement learning agents and learns to adaptively select the agent with the right configuration. Our goal is to…

Machine Learning · Computer Science 2025-12-03 Aida Afshar , Aldo Pacchiano

Learning complex robot behavior through interactions with the environment necessitates principled exploration. Effective strategies should prioritize exploring regions of the state-action space that maximize rewards, with optimistic…

Machine Learning · Computer Science 2025-03-12 Jasmine Bayrooti , Carl Henrik Ek , Amanda Prorok

Reasoning-augmented search agents, such as Search-R1, are trained to reason, search, and generate the final answer iteratively. Nevertheless, due to their limited capabilities in reasoning and search, their performance on multi-hop QA…

Computation and Language · Computer Science 2025-10-14 Shu Zhao , Tan Yu , Anbang Xu

Reinforcement learning algorithms can train agents that solve problems in complex, interesting environments. Normally, the complexity of the trained agent is closely related to the complexity of the environment. This suggests that a highly…

Artificial Intelligence · Computer Science 2018-03-16 Trapit Bansal , Jakub Pachocki , Szymon Sidor , Ilya Sutskever , Igor Mordatch

When a game involves many agents or when communication between agents is not possible, it is useful to resort to distributed learning where each agent acts in complete autonomy without any information on the other agents' situations.…

Optimization and Control · Mathematics 2025-09-24 Jérôme Taupin , Xavier Leturc , Christophe J. Le Martret

State of the art reinforcement learning has enabled training agents on tasks of ever increasing complexity. However, the current paradigm tends to favor training agents from scratch on every new task or on collections of tasks with a view…

Machine Learning · Computer Science 2023-02-09 Jacob Walker , Eszter Vértes , Yazhe Li , Gabriel Dulac-Arnold , Ankesh Anand , Théophane Weber , Jessica B. Hamrick

Exploration in decentralized cooperative multi-agent reinforcement learning faces two challenges. One is that the novelty of global states is unavailable, while the novelty of local observations is biased. The other is how agents can…

Multiagent Systems · Computer Science 2024-08-13 Haobin Jiang , Ziluo Ding , Zongqing Lu

Almost all multi-agent reinforcement learning algorithms without communication follow the principle of centralized training with decentralized execution. During centralized training, agents can be guided by the same signals, such as the…

Multiagent Systems · Computer Science 2022-12-08 Zhiwei Xu , Bin Zhang , Dapeng Li , Zeren Zhang , Guangchong Zhou , Hao Chen , Guoliang Fan