English
Related papers

Related papers: Multi-agent Off-policy Actor-Critic Reinforcement …

200 papers

In offline reinforcement learning (RL) agents are trained using a logged dataset. It appears to be the most natural route to attack real-life applications because in domains such as healthcare and robotics interactions with the environment…

Machine Learning · Computer Science 2020-12-15 Ksenia Konyushkova , Konrad Zolna , Yusuf Aytar , Alexander Novikov , Scott Reed , Serkan Cabi , Nando de Freitas

We formulate computation offloading as a decentralized decision-making problem with autonomous agents. We design an interaction mechanism that incentivizes agents to align private and system goals by balancing between competition and…

Multiagent Systems · Computer Science 2022-06-22 Jing Tan , Ramin Khalili , Holger Karl , Artur Hecker

[Zhang, ICML 2018] provided the first decentralized actor-critic algorithm for multi-agent reinforcement learning (MARL) that offers convergence guarantees. In that work, policies are stochastic and are defined on finite action spaces. We…

Machine Learning · Computer Science 2021-02-22 Antoine Grosnit , Desmond Cai , Laura Wynter

Modeling of real-world biological multi-agents is a fundamental problem in various scientific and engineering fields. Reinforcement learning (RL) is a powerful framework to generate flexible and diverse behaviors in cyberspace; however,…

Artificial Intelligence · Computer Science 2023-12-20 Keisuke Fujii , Kazushi Tsutsui , Atom Scott , Hiroshi Nakahara , Naoya Takeishi , Yoshinobu Kawahara

Off-policy deep reinforcement learning (RL) algorithms are incapable of learning solely from batch offline data without online interactions with the environment, due to the phenomenon known as \textit{extrapolation error}. This is often due…

Machine Learning · Computer Science 2019-12-03 Riashat Islam , Komal K. Teru , Deepak Sharma , Joelle Pineau

Multi-agent reinforcement learning (MARL) has attracted much research attention recently. However, unlike its single-agent counterpart, many theoretical and algorithmic aspects of MARL have not been well-understood. In this paper, we study…

Machine Learning · Computer Science 2021-12-08 Siliang Zeng , Tianyi Chen , Alfredo Garcia , Mingyi Hong

This paper proposes a reinforcement learning (RL)-based backstepping control strategy to achieve fixed time consensus in nonlinear multi-agent systems with strict feedback dynamics. Agents exchange only output information with their…

Systems and Control · Electrical Eng. & Systems 2025-07-23 Aria Delshad , Maryam Babazadeh

Offline reinforcement learning (RL) struggles in environments with rich and noisy inputs, where the agent only has access to a fixed dataset without environment interactions. Past works have proposed common workarounds based on the…

Machine Learning · Computer Science 2023-03-01 Hongyu Zang , Xin Li , Jie Yu , Chen Liu , Riashat Islam , Remi Tachet Des Combes , Romain Laroche

Reinforcement learning (RL) relies heavily on exploration to learn from its environment and maximize observed rewards. Therefore, it is essential to design a reward function that guarantees optimal learning from the received experience.…

Artificial Intelligence · Computer Science 2022-06-20 Ingy ElSayed-Aly , Lu Feng

In a multi-agent setting, the optimal policy of a single agent is largely dependent on the behavior of other agents. We investigate the problem of multi-agent reinforcement learning, focusing on decentralized learning in non-stationary…

Artificial Intelligence · Computer Science 2019-10-01 Anahita Mohseni-Kabir , David Isele , Kikuo Fujimura

Offline reinforcement learning (RL) extends the paradigm of classical RL algorithms to purely learning from static datasets, without interacting with the underlying environment during the learning process. A key challenge of offline RL is…

Machine Learning · Computer Science 2022-06-16 Shentao Yang , Yihao Feng , Shujian Zhang , Mingyuan Zhou

Policy gradient methods have become popular in multi-agent reinforcement learning, but they suffer from high variance due to the presence of environmental stochasticity and exploring agents (i.e., non-stationarity), which is potentially…

Machine Learning · Computer Science 2021-12-21 Yuchen Xiao , Xueguang Lyu , Christopher Amato

Reinforcement Learning (RL) enables an intelligent agent to optimise its performance in a task by continuously taking action from an observed state and receiving a feedback from the environment in form of rewards. RL typically uses tables…

Artificial Intelligence · Computer Science 2025-01-28 Alberto Castagna

Reinforcement learning algorithms are typically geared towards optimizing the expected return of an agent. However, in many practical applications, low variance in the return is desired to ensure the reliability of an algorithm. In this…

Machine Learning · Computer Science 2021-02-04 Arushi Jain , Gandharv Patil , Ayush Jain , Khimya Khetarpal , Doina Precup

Offline learning is a key part of making reinforcement learning (RL) useable in real systems. Offline RL looks at scenarios where there is data from a system's operation, but no direct access to the system when learning a policy. Recent…

Machine Learning · Computer Science 2021-03-18 Arthur Argenson , Gabriel Dulac-Arnold

Existing off-policy reinforcement learning algorithms often rely on an explicit state-action-value function representation, which can be problematic in high-dimensional action spaces due to the curse of dimensionality. This reliance results…

Machine Learning · Computer Science 2025-02-18 Fabian Otto , Philipp Becker , Ngo Anh Vien , Gerhard Neumann

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

Machine Learning · Computer Science 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

Offline reinforcement learning (RL) refers to the problem of learning policies entirely from a large batch of previously collected data. This problem setting offers the promise of utilizing such datasets to acquire policies without any…

Machine Learning · Computer Science 2020-11-24 Tianhe Yu , Garrett Thomas , Lantao Yu , Stefano Ermon , James Zou , Sergey Levine , Chelsea Finn , Tengyu Ma

HRI research increasingly demands robots that go beyond task execution to respond meaningfully to user emotions. This is especially needed when supporting students with learning difficulties in game-based learning scenarios. Here, the…

Robotics · Computer Science 2026-03-04 Soon Jynn Chu , Raju Gottumukkala , Alan Barhorst

The performance of reinforcement learning depends upon designing an appropriate action space, where the effect of each action is measurable, yet, granular enough to permit flexible behavior. So far, this process involved non-trivial user…

Machine Learning · Computer Science 2021-06-08 Edoardo Cetin , Oya Celiktutan