中文
相关论文

相关论文: Black-Box Targeted Reward Poisoning Attack Against…

200 篇论文

We study the problem of universal black-boxed reward poisoning attacks against general offline reinforcement learning with deep neural networks. We consider a black-box threat model where the attacker is entirely oblivious to the learning…

机器学习 · 计算机科学 2024-10-25 Yinglun Xu , Rohan Gumaste , Gagandeep Singh

We study black-box reward poisoning attacks against reinforcement learning (RL), in which an adversary aims to manipulate the rewards to mislead a sequence of RL agents with unknown algorithms to learn a nefarious policy in an environment…

机器学习 · 计算机科学 2021-02-18 Amin Rakhsha , Xuezhou Zhang , Xiaojin Zhu , Adish Singla

We study reward poisoning attacks on online deep reinforcement learning (DRL), where the attacker is oblivious to the learning algorithm used by the agent and the dynamics of the environment. We demonstrate the intrinsic vulnerability of…

机器学习 · 计算机科学 2023-07-18 Yinglun Xu , Qi Zeng , Gagandeep Singh

This paper proposes an online environment poisoning algorithm tailored for reinforcement learning agents operating in a black-box setting, where an adversary deliberately manipulates training data to lead the agent toward a mischievous…

机器学习 · 计算机科学 2024-12-03 Jianhui Li , Bokang Zhang , Junfeng Wu

We study a security threat to reinforcement learning where an attacker poisons the learning environment to force the agent into executing a target policy chosen by the attacker. As a victim, we consider RL agents whose objective is to find…

机器学习 · 计算机科学 2020-08-20 Amin Rakhsha , Goran Radanovic , Rati Devidze , Xiaojin Zhu , Adish Singla

We study a security threat to reinforcement learning where an attacker poisons the learning environment to force the agent into executing a target policy chosen by the attacker. As a victim, we consider RL agents whose objective is to find…

机器学习 · 计算机科学 2020-11-24 Amin Rakhsha , Goran Radanovic , Rati Devidze , Xiaojin Zhu , Adish Singla

Reinforcement learning (RL) is an actively growing field that is seeing increased usage in real-world, safety-critical applications -- making it paramount to ensure the robustness of RL algorithms against adversarial attacks. In this work…

机器学习 · 计算机科学 2024-10-22 Ethan Rathbun , Christopher Amato , Alina Oprea

Control policies, trained using the Deep Reinforcement Learning, have been recently shown to be vulnerable to adversarial attacks introducing even very small perturbations to the policy input. The attacks proposed so far have been designed…

机器学习 · 计算机科学 2019-08-02 Alessio Russo , Alexandre Proutiere

We study reward poisoning attacks in reinforcement learning (RL), where an adversary manipulates rewards within constrained budgets to force the target RL agent to adopt a policy that aligns with the attacker's objectives. Prior works on…

Research in adversarial machine learning has shown how the performance of machine learning models can be seriously compromised by injecting even a small fraction of poisoning points into the training data. While the effects on model…

机器学习 · 计算机科学 2020-06-29 David Solans , Battista Biggio , Carlos Castillo

We study defense strategies against reward poisoning attacks in reinforcement learning. As a threat model, we consider attacks that minimally alter rewards to make the attacker's target policy uniquely optimal under the poisoned rewards,…

机器学习 · 计算机科学 2021-06-22 Kiarash Banihashem , Adish Singla , Goran Radanovic

Recent studies show that Deep Reinforcement Learning (DRL) models are vulnerable to adversarial attacks, which attack DRL models by adding small perturbations to the observations. However, some attacks assume full availability of the victim…

机器学习 · 计算机科学 2022-02-18 Xinlei Pan , Chaowei Xiao , Warren He , Shuang Yang , Jian Peng , Mingjie Sun , Jinfeng Yi , Zijiang Yang , Mingyan Liu , Bo Li , Dawn Song

In this paper, we propose a new data poisoning attack and apply it to deep reinforcement learning agents. Our attack centers on what we call in-distribution triggers, which are triggers native to the data distributions the model will be…

机器学习 · 计算机科学 2021-06-16 Chace Ashcraft , Kiran Karra

In recent years, deep reinforcement learning (Deep RL) has been successfully implemented as a smart agent in many systems such as complex games, self-driving cars, and chat-bots. One of the interesting use cases of Deep RL is its…

机器学习 · 计算机科学 2023-09-27 Foozhan Ataiefard , Hadi Hemmati

Due to the broad range of applications of reinforcement learning (RL), understanding the effects of adversarial attacks against RL model is essential for the safe applications of this model. Prior theoretical works on adversarial attacks…

机器学习 · 计算机科学 2021-10-27 Guanlin Liu , Lifeng Lai

Recent works have demonstrated the vulnerability of Deep Reinforcement Learning (DRL) algorithms against training-time, backdoor poisoning attacks. The objectives of these attacks are twofold: induce pre-determined, adversarial behavior in…

机器学习 · 计算机科学 2025-06-04 Ethan Rathbun , Alina Oprea , Christopher Amato

Data poisoning for reinforcement learning has historically focused on general performance degradation, and targeted attacks have been successful via perturbations that involve control of the victim's policy and rewards. We introduce an…

机器学习 · 计算机科学 2022-07-29 Harrison Foley , Liam Fowl , Tom Goldstein , Gavin Taylor

The broader application of reinforcement learning (RL) is limited by challenges including data efficiency, generalization capability, and ability to learn in sparse-reward environments. Meta-learning has emerged as a promising approach to…

机器学习 · 计算机科学 2026-03-05 Octavio Pappalardo , Rodrigo Ramele , Juan Miguel Santos

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

机器学习 · 计算机科学 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

We consider data poisoning attacks, a class of adversarial attacks on machine learning where an adversary has the power to alter a small fraction of the training data in order to make the trained classifier satisfy certain objectives. While…

机器学习 · 计算机科学 2018-08-29 Yizhen Wang , Kamalika Chaudhuri
‹ 上一页 1 2 3 10 下一页 ›