中文
相关论文

相关论文: Reward Poisoning Attacks on Offline Multi-Agent Re…

200 篇论文

To achieve general intelligence, agents must learn how to interact with others in a shared environment: this is the challenge of multiagent reinforcement learning (MARL). The simplest form is independent reinforcement learning (InRL), where…

We propose the first black-box targeted attack against online deep reinforcement learning through reward poisoning during training time. Our attack is applicable to general environments with unknown dynamics learned by unknown algorithms…

机器学习 · 计算机科学 2023-05-19 Yinglun Xu , Gagandeep Singh

We study black-box reward poisoning attacks against reinforcement learning (RL), in which an adversary aims to manipulate the rewards to mislead a sequence of RL agents with unknown algorithms to learn a nefarious policy in an environment…

机器学习 · 计算机科学 2021-02-18 Amin Rakhsha , Xuezhou Zhang , Xiaojin Zhu , Adish Singla

Reinforcement learning (RL) makes an agent learn from trial-and-error experiences gathered during the interaction with the environment. Recently, offline RL has become a popular RL paradigm because it saves the interactions with…

机器学习 · 计算机科学 2024-03-21 Chen Gong , Zhou Yang , Yunpeng Bai , Junda He , Jieke Shi , Kecen Li , Arunesh Sinha , Bowen Xu , Xinwen Hou , David Lo , Tianhao Wang

Cooperative multi-agent reinforcement learning (cMARL) has many real applications, but the policy trained by existing cMARL algorithms is not robust enough when deployed. There exist also many methods about adversarial attacks on the RL…

人工智能 · 计算机科学 2022-08-09 Yizheng Hu , Zhihua Zhang

Reinforcement learning (RL) has achieved remarkable success across diverse domains, enabling autonomous systems to learn and adapt to dynamic environments by optimizing a reward function. However, this reliance on reward signals creates a…

密码学与安全 · 计算机科学 2025-12-01 Bokang Zhang , Chaojun Lu , Jianhui Li , Junfeng Wu

Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an…

机器学习 · 计算机科学 2022-07-29 Harrison Foley , Liam Fowl , Tom Goldstein , Gavin Taylor

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

机器学习 · 计算机科学 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

This paper presents an algorithmic framework for learning robust policies in asymmetric imperfect-information games, where the joint reward could depend on the uncertain opponent type (a private information known only to the opponent itself…

人工智能 · 计算机科学 2020-03-05 Macheng Shen , Jonathan P. How

This chapter studies emerging cyber-attacks on reinforcement learning (RL) and introduces a quantitative approach to analyze the vulnerabilities of RL. Focusing on adversarial manipulation on the cost signals, we analyze the performance…

机器学习 · 计算机科学 2020-07-22 Yunhan Huang , Quanyan Zhu

To achieve sample efficiency in reinforcement learning (RL), it necessitates efficiently exploring the underlying environment. Under the offline setting, addressing the exploration challenge lies in collecting an offline dataset with…

机器学习 · 计算机科学 2022-02-15 Shuang Qiu , Jieping Ye , Zhaoran Wang , Zhuoran Yang

Reinforcement learning (RL) has been widely adopted for controlling and optimizing complex engineering systems such as next-generation wireless networks. An important challenge in adopting RL is the need for direct access to the physical…

机器学习 · 计算机科学 2024-11-19 Eslam Eldeeb , Houssem Sifaou , Osvaldo Simeone , Mohammad Shehab , Hirley Alves

Reinforcement learning (RL) is an actively growing field that is seeing increased usage in real-world, safety-critical applications -- making it paramount to ensure the robustness of RL algorithms against adversarial attacks. In this work…

机器学习 · 计算机科学 2024-10-22 Ethan Rathbun , Christopher Amato , Alina Oprea

We study a security threat to batch reinforcement learning and control where the attacker aims to poison the learned policy. The victim is a reinforcement learner / controller which first estimates the dynamics and the rewards from a batch…

机器学习 · 计算机科学 2019-11-01 Yuzhe Ma , Xuezhou Zhang , Wen Sun , Xiaojin Zhu

We develop a Multi-Agent Reinforcement Learning (MARL) method to learn scalable control policies for target tracking. Our method can handle an arbitrary number of pursuers and targets; we show results for tasks consisting up to 1000…

多智能体系统 · 计算机科学 2021-11-11 Christopher D. Hsu , Heejin Jeong , George J. Pappas , Pratik Chaudhari

There is a growing interest in Multi-Agent Reinforcement Learning (MARL) as the first steps towards building general intelligent agents that learn to make low and high-level decisions in non-stationary complex environments in the presence…

人工智能 · 计算机科学 2020-01-01 Marco Jerome Gasparrini , Ricard Solé , Martí Sánchez-Fibla

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

机器学习 · 统计学 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

Sparse rewards are a major bottleneck in multi-agent reinforcement learning (MARL), where simultaneous learning induces non-stationarity and makes reward design especially delicate. Reward shaping can accelerate learning, but in the…

多智能体系统 · 计算机科学 2026-05-25 Elie Abboud , Oren Gal

Offline multi-agent reinforcement learning (MARL) addresses key limitations of online MARL, such as safety concerns, expensive data collection, extended training intervals, and high signaling overhead caused by online interactions with the…

多智能体系统 · 计算机科学 2025-01-23 Eslam Eldeeb , Hirley Alves

Decentralized multi-agent reinforcement learning (MARL) algorithms have become popular in the literature since it allows heterogeneous agents to have their own reward functions as opposed to canonical multi-agent Markov Decision Process…

机器学习 · 计算机科学 2023-06-19 Soumajyoti Sarkar