English
Related papers

Related papers: Developing cooperative policies for multi-stage ta…

200 papers

Cooperation is fundamental in Multi-Agent Systems (MAS) and Multi-Agent Reinforcement Learning (MARL), often requiring agents to balance individual gains with collective rewards. In this regard, this paper aims to investigate strategies to…

Computer Science and Game Theory · Computer Science 2024-05-06 Vaigarai Sathi , Sabahat Shaik , Jaswanth Nidamanuri

Actor-critic methods constitute a central paradigm in reinforcement learning (RL), coupling policy evaluation with policy improvement. While effective across many domains, these methods rely on separate actor and critic networks, which…

Machine Learning · Computer Science 2025-09-26 Donghyeon Ki , Hee-Jun Ahn , Kyungyoon Kim , Byung-Jun Lee

Cooperative multi-agent reinforcement learning often requires decentralised policies, which severely limit the agents' ability to coordinate their behaviour. In this paper, we show that common knowledge between agents allows for complex…

In reinforcement learning (RL), function approximation errors are known to easily lead to the Q-value overestimations, thus greatly reducing policy performance. This paper presents a distributional soft actor-critic (DSAC) algorithm, which…

Machine Learning · Computer Science 2021-06-14 Jingliang Duan , Yang Guan , Shengbo Eben Li , Yangang Ren , Bo Cheng

Multi-Agent Reinforcement Learning (MARL) has emerged as a foundational approach for addressing diverse, intelligent control tasks in various scenarios like the Internet of Vehicles, Internet of Things, and Unmanned Aerial Vehicles.…

Multiagent Systems · Computer Science 2024-10-15 Xiaoxue Yu , Rongpeng Li , Chengchao Liang , Zhifeng Zhao

The research of extending deep reinforcement learning (drl) to multi-agent field has solved many complicated problems and made great achievements. However, almost all these studies only focus on discrete or continuous action space and there…

Machine Learning · Computer Science 2022-09-01 Hongzhi Hua , Guixuan Wen , Kaigui Wu

In this work, we present a novel cooperative multi-agent reinforcement learning method called \textbf{Loc}ality based \textbf{Fac}torized \textbf{M}ulti-Agent \textbf{A}ctor-\textbf{C}ritic (Loc-FACMAC). Existing state-of-the-art…

The exploration mechanism used by a Deep Reinforcement Learning (RL) agent plays a key role in determining its sample efficiency. Thus, improving over random exploration is crucial to solve long-horizon tasks with sparse rewards. We propose…

Machine Learning · Computer Science 2019-12-17 Andrey Kurenkov , Ajay Mandlekar , Roberto Martin-Martin , Silvio Savarese , Animesh Garg

Multi-Agent reinforcement learning has received lot of attention in recent years and have applications in many different areas. Existing methods involving Centralized Training and Decentralized execution, attempts to train the agents…

Machine Learning · Computer Science 2021-09-15 Satheesh K. Perepu , Kaushik Dey

In-hand manipulation is challenging for a multi-finger robotic hand due to its high degrees of freedom and the complex interaction with the object. To enable in-hand manipulation, existing deep reinforcement learning based approaches mainly…

Robotics · Computer Science 2023-07-12 Lingfeng Tao , Jiucai Zhang , Michael Bowman , Xiaoli Zhang

Actor-critic (AC) algorithms are known for their efficacy and high performance in solving reinforcement learning problems, but they also suffer from low sampling efficiency. An AC based policy optimization process is iterative and needs to…

Machine Learning · Computer Science 2021-12-02 Chayan Banerjee , Zhiyong Chen , Nasimul Noman , Mohsen Zamani

Policy gradient methods are an attractive approach to multi-agent reinforcement learning problems due to their convergence properties and robustness in partially observable scenarios. However, there is a significant performance gap between…

Machine Learning · Computer Science 2021-05-07 Bozhidar Vasilev , Tarun Gupta , Bei Peng , Shimon Whiteson

We propose an improved algorithm by identifying and encouraging cooperative behavior in multi-agent environments. First, we analyze the shortcomings of existing algorithms in addressing multi-agent reinforcement learning problems. Then,…

Multiagent Systems · Computer Science 2025-08-21 Junjie Qi , Siqi Mao , Tianyi Tan

The trend is to implement intelligent agents capable of analyzing available information and utilize it efficiently. This work presents a number of reinforcement learning (RL) architectures; one of them is designed for intelligent agents.…

Machine Learning · Computer Science 2020-04-07 Ala'eddin Masadeh , Zhengdao Wang , Ahmed E. Kamal

Decision making in multi-agent systems (MAS) is a great challenge due to enormous state and joint action spaces as well as uncertainty, making centralized control generally infeasible. Decentralized control offers better scalability and…

Artificial Intelligence · Computer Science 2019-01-28 Thomy Phan , Kyrill Schmid , Lenz Belzner , Thomas Gabor , Sebastian Feld , Claudia Linnhoff-Popien

We propose a fully distributed actor-critic algorithm approximated by deep neural networks, named \textit{Diff-DAC}, with application to single-task and to average multitask reinforcement learning (MRL). Each agent has access to data from…

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Doug Creighton , Saeid Nahavandi

The oscillating performance of off-policy learning and persisting errors in the actor-critic (AC) setting call for algorithms that can conservatively learn to suit the stability-critical applications better. In this paper, we propose a…

Machine Learning · Computer Science 2021-10-06 Lingwei Zhu , Toshinori Kitamura , Takamitsu Matsubara

Adopting reasonable strategies is challenging but crucial for an intelligent agent with limited resources working in hazardous, unstructured, and dynamic environments to improve the system's utility, decrease the overall cost, and increase…

Artificial Intelligence · Computer Science 2023-12-06 Qin Yang , Ramviyas Parasuraman

Soft Actor Critic (SAC) algorithms show remarkable performance in complex simulated environments. A key element of SAC networks is entropy regularization, which prevents the SAC actor from optimizing against fine grained features,…

Machine Learning · Computer Science 2020-06-23 Miguel Campo , Zhengxing Chen , Luke Kung , Kittipat Virochsiri , Jianyu Wang