English
Related papers

Related papers: Diffusion-based Episodes Augmentation for Offline …

200 papers

Cybersecurity defense involves interactions between adversarial parties (namely defenders and hackers), making multi-agent reinforcement learning (MARL) an ideal approach for modeling and learning strategies for these scenarios. This paper…

Multiagent Systems · Computer Science 2025-09-03 Qintong Xie , Edward Koh , Xavier Cadet , Peter Chin

In cooperative multi-agent reinforcement learning (MARL), agents aim to achieve a common goal, such as defeating enemies or scoring a goal. Existing MARL algorithms are effective but still require significant learning time and often get…

Machine Learning · Computer Science 2024-03-08 Hyungho Na , Yunkyeong Seo , Il-chul Moon

Due to its training stability and strong expression, the diffusion model has attracted considerable attention in offline reinforcement learning. However, several challenges have also come with it: 1) The demand for a large number of…

Machine Learning · Computer Science 2024-01-25 Yuhui Chen , Haoran Li , Dongbin Zhao

Offline reinforcement learning requires reconciling two conflicting aims: learning a policy that improves over the behavior policy that collected the dataset, while at the same time minimizing the deviation from the behavior policy so as to…

Machine Learning · Computer Science 2021-10-13 Ilya Kostrikov , Ashvin Nair , Sergey Levine

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

Offline reinforcement learning (RL) presents distinct challenges as it relies solely on observational data. A central concern in this context is ensuring the safety of the learned policy by quantifying uncertainties associated with various…

Machine Learning · Computer Science 2025-07-03 Xiaocong Chen , Siyu Wang , Tong Yu , Lina Yao

This paper proposes an exploration technique for multi-agent reinforcement learning (MARL) with graph-based communication among agents. We assume the individual rewards received by the agents are independent of the actions by the other…

Machine Learning · Computer Science 2025-08-11 Ainur Zhaikhan , Ali H. Sayed

In recent years, $Q$-learning has become indispensable for model-free reinforcement learning (MFRL). However, it suffers from well-known problems such as under- and overestimation bias of the value, which may adversely affect the policy…

Machine Learning · Computer Science 2021-02-09 Youngmin Oh , Jinwoo Shin , Eunho Yang , Sung Ju Hwang

Reinforcement learning has driven impressive advances in machine learning. Simultaneously, quantum-enhanced machine learning algorithms using quantum annealing underlie heavy developments. Recently, a multi-agent reinforcement learning…

Artificial Intelligence · Computer Science 2021-11-23 Tobias Müller , Christoph Roch , Kyrill Schmid , Philipp Altmann

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

In this work, we build upon the offline reinforcement learning algorithm TD7, which incorporates State-Action Learned Embeddings (SALE) and a prioritized experience replay buffer (LAP). We propose a model-free actor-critic algorithm that…

Machine Learning · Computer Science 2025-01-14 Zheng Chun

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning credit to individual…

Machine Learning · Computer Science 2024-01-01 Ziyan Wang , Yali Du , Yudi Zhang , Meng Fang , Biwei Huang

Training multiple agents to coordinate is an essential problem with applications in robotics, game theory, economics, and social sciences. However, most existing Multi-Agent Reinforcement Learning (MARL) methods are online and thus…

Machine Learning · Computer Science 2024-01-19 Paul Barde , Jakob Foerster , Derek Nowrouzezahrai , Amy Zhang

This paper introduces single-partition adaptive Q-learning (SPAQL), an algorithm for model-free episodic reinforcement learning (RL), which adaptively partitions the state-action space of a Markov decision process (MDP), while…

Machine Learning · Computer Science 2020-07-15 João Pedro Araújo , Mário Figueiredo , Miguel Ayala Botto

We investigate model-free multi-agent reinforcement learning (MARL) in environments where off-beat actions are prevalent, i.e., all actions have pre-set execution durations. During execution durations, the environment changes are influenced…

Multiagent Systems · Computer Science 2022-06-22 Wei Qiu , Weixun Wang , Rundong Wang , Bo An , Yujing Hu , Svetlana Obraztsova , Zinovi Rabinovich , Jianye Hao , Yingfeng Chen , Changjie Fan

Offline reinforcement learning (RL) leverages pre-collected datasets to train optimal policies. Diffusion Q-Learning (DQL), introducing diffusion models as a powerful and expressive policy class, significantly boosts the performance of…

Machine Learning · Computer Science 2024-11-04 Tianyu Chen , Zhendong Wang , Mingyuan Zhou

In standard reinforcement learning, an episode is defined as a sequence of interactions between agents and the environment, which terminates upon reaching a terminal state or a pre-defined episode length. Setting a shorter episode length…

Multiagent Systems · Computer Science 2025-05-27 Byunghyun Yoo , Younghwan Shin , Hyunwoo Kim , Euisok Chung , Jeongmin Yang

Multi-agent reinforcement learning (MARL) has shown wide applicability in collaborative systems such as autonomous driving and smart cities for its ability of learning through interaction. With the recent development of drone networks,…

Networking and Internet Architecture · Computer Science 2026-05-26 Changling Li , Ying Li

This paper introduces a novel approach to radio resource allocation in multi-cell wireless networks using a fully scalable multi-agent reinforcement learning (MARL) framework. A distributed method is developed where agents control…

Multiagent Systems · Computer Science 2024-09-19 Yiming Zhang , Dongning Guo

Reinforcement Learning (RL) has recently been incorporated into diffusion models, e.g., tasks such as text-to-image. However, directly applying existing RL methods to diffusion-based image restoration models is suboptimal, as the objective…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Xiaogang Xu , Ruihang Chu , Jian Wang , Kun Zhou , Wenjie Shu , Harry Yang , Ser-Nam Lim , Hao Chen , Liang Lin