中文
相关论文

相关论文: Reward Poisoning Attacks on Offline Multi-Agent Re…

200 篇论文

Federated learning distributes model training among a multitude of agents, who, guided by privacy concerns, perform training using their local data but share only model parameter updates, for iterative aggregation at the server. In this…

机器学习 · 计算机科学 2019-11-26 Arjun Nitin Bhagoji , Supriyo Chakraborty , Prateek Mittal , Seraphin Calo

Reinforcement learning agents are prone to undesired behaviors due to reward mis-specification. Finding a set of reward functions to properly guide agent behaviors is particularly challenging in multi-agent scenarios. Inverse reinforcement…

机器学习 · 计算机科学 2019-08-01 Lantao Yu , Jiaming Song , Stefano Ermon

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

机器学习 · 计算机科学 2019-08-22 Tiancheng Yu , Suvrit Sra

During initial iterations of training in most Reinforcement Learning (RL) algorithms, agents perform a significant number of random exploratory steps. In the real world, this can limit the practicality of these algorithms as it can lead to…

机器学习 · 计算机科学 2022-10-17 Ashish Kumar Jayant , Shalabh Bhatnagar

In recent advancements in Multi-agent Reinforcement Learning (MARL), its application has extended to various safety-critical scenarios. However, most methods focus on online learning, which presents substantial risks when deployed in…

人工智能 · 计算机科学 2024-10-01 Jianuo Huang

Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised learning setting. While most existing work studies…

Offline multi-agent reinforcement learning (MARL) faces a critical challenge: the joint action space grows exponentially with the number of agents, making dataset coverage exponentially sparse and out-of-distribution (OOD) joint actions…

机器学习 · 计算机科学 2026-03-31 Yue Jin , Giovanni Montana

Offline Multi-agent Reinforcement Learning (MARL) is valuable in scenarios where online interaction is impractical or risky. While independent learning in MARL offers flexibility and scalability, accurately assigning credit to individual…

机器学习 · 计算机科学 2024-01-01 Ziyan Wang , Yali Du , Yudi Zhang , Meng Fang , Biwei Huang

We consider offline Reinforcement Learning (RL), where the agent does not interact with the environment and must rely on offline data collected using a behavior policy. Previous works provide policy evaluation guarantees when the target…

机器学习 · 计算机科学 2023-05-26 Xumei Xi , Christina Lee Yu , Yudong Chen

Many recent successful off-policy multi-agent reinforcement learning (MARL) algorithms for cooperative partially observable environments focus on finding factorized value functions, leading to convoluted network structures. Building on the…

机器学习 · 计算机科学 2023-10-27 Raphaël Avalos , Mathieu Reymond , Ann Nowé , Diederik M. Roijers

In this paper, we propose a novel framework for designing a fast convergent multi-agent reinforcement learning (MARL)-based medium access control (MAC) protocol operating in a single cell scenario. The user equipments (UEs) are cast as…

网络与互联网体系结构 · 计算机科学 2023-03-01 Luciano Miuccio , Salvatore Riolo , Mehdi Bennis , Daniela Panno

Finding optimal adversarial attack strategies is an important topic in reinforcement learning and the Markov decision process. Previous studies usually assume one all-knowing coordinator (attacker) for whom attacking different recipient…

机器学习 · 计算机科学 2024-03-05 Ziqing Lu , Guanlin Liu , Lifeng Lai , Weiyu Xu

This paper considers multi-agent reinforcement learning (MARL) where the rewards are received after delays and the delay time varies across agents and across time steps. Based on the V-learning framework, this paper proposes MARL algorithms…

多智能体系统 · 计算机科学 2023-05-17 Yuyang Zhang , Runyu Zhang , Yuantao Gu , Na Li

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

人工智能 · 计算机科学 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

Mastering deep reinforcement learning (DRL) proves challenging in tasks featuring scant rewards. These limited rewards merely signify whether the task is partially or entirely accomplished, necessitating various exploration actions before…

机器学习 · 计算机科学 2024-04-11 Guojian Wang , Faguo Wu , Xiao Zhang

In Multi-agent Reinforcement Learning (MARL), accurately perceiving opponents' strategies is essential for both cooperative and adversarial contexts, particularly within dynamic environments. While Proximal Policy Optimization (PPO) and…

人工智能 · 计算机科学 2024-06-11 Mohidul Haque Mridul , Mohammad Foysal Khan , Redwan Ahmed Rizvee , Md Mosaddek Khan

Reinforcement learning (RL) has advanced greatly in the past few years with the employment of effective deep neural networks (DNNs) on the policy networks. With the great effectiveness came serious vulnerability issues with DNNs that small…

机器学习 · 计算机科学 2018-07-06 Edgar Tretschk , Seong Joon Oh , Mario Fritz

Sparse and delayed rewards pose a challenge to single agent reinforcement learning. This challenge is amplified in multi-agent reinforcement learning (MARL) where credit assignment of these rewards needs to happen not only across time, but…

机器学习 · 计算机科学 2022-11-01 Jennifer She , Jayesh K. Gupta , Mykel J. Kochenderfer

We study multi-agent reinforcement learning (MARL) in infinite-horizon discounted zero-sum Markov games. We focus on the practical but challenging setting of decentralized MARL, where agents make decisions without coordination by a…

计算机科学与博弈论 · 计算机科学 2021-12-14 Muhammed O. Sayin , Kaiqing Zhang , David S. Leslie , Tamer Basar , Asuman Ozdaglar

Markov games (MGs) and multi-agent reinforcement learning (MARL) are studied to model decision making in multi-agent systems. Traditionally, the objective in MG and MARL has been risk-neutral, i.e., agents are assumed to optimize a…

计算机科学与博弈论 · 计算机科学 2024-06-11 Hafez Ghaemi , Shirin Jamshidi , Mohammad Mashreghi , Majid Nili Ahmadabadi , Hamed Kebriaei