中文
相关论文

相关论文: Manipulating Reinforcement Learning: Poisoning Att…

200 篇论文

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

密码学与安全 · 计算机科学 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

Reinforcement learning (RL) has advanced greatly in the past few years with the employment of effective deep neural networks (DNNs) on the policy networks. With the great effectiveness came serious vulnerability issues with DNNs that small…

机器学习 · 计算机科学 2018-07-06 Edgar Tretschk , Seong Joon Oh , Mario Fritz

In recent years, Reward Machines (RMs) have stood out as a simple yet effective automata-based formalism for exposing and exploiting task structure in reinforcement learning settings. Despite their relevance, little to no attention has been…

机器学习 · 计算机科学 2023-11-16 Lorenzo Nodari

Adversarial training is a standard defense against malicious input perturbations in security-critical machine-learning systems. Its main burden is structural: before every parameter update, the current model must first be attacked to find a…

量子物理 · 物理学 2026-03-31 Yue Wang , Guangyi He , Liepeng Zhang , Lukas Gonon , Qi Zhao

Nowadays, a significant share of the business-to-consumer sector is based on online platforms like Amazon and Alibaba and uses AI for pricing strategies. This has sparked debate on whether pricing algorithms may tacitly collude to set…

综合经济学 · 经济学 2025-03-17 Shidi Deng , Maximilian Schiffer , Martin Bichler

This study investigates a counterintuitive phenomenon in adversarial machine learning: the potential for noise-based defenses to inadvertently aid evasion attacks in certain scenarios. While randomness is often employed as a defensive…

密码学与安全 · 计算机科学 2024-11-01 Steve Bakos , Pooria Madani , Heidar Davoudi

Reinforcement learning (RL) is a machine learning paradigm where an autonomous agent learns to make an optimal sequence of decisions by interacting with the underlying environment. The promise demonstrated by RL-guided workflows in…

密码学与安全 · 计算机科学 2022-08-31 Satwik Patnaik , Vasudev Gohil , Hao Guo , Jeyavijayan , Rajendran

Nowadays, a significant share of the Business-to-Consumer sector is based on online platforms like Amazon and Alibaba and uses Artificial Intelligence for pricing strategies. This has sparked debate on whether pricing algorithms may tacitly…

综合经济学 · 经济学 2024-06-05 Shidi Deng , Maximilian Schiffer , Martin Bichler

We study the problem of safe offline reinforcement learning (RL), the goal is to learn a policy that maximizes long-term reward while satisfying safety constraints given only offline data, without further interaction with the environment.…

机器学习 · 计算机科学 2022-04-11 Haoran Xu , Xianyuan Zhan , Xiangyu Zhu

Safe reinforcement learning (RL) agents accomplish given tasks while adhering to specific constraints. Employing constraints expressed via easily-understandable human language offers considerable potential for real-world applications due to…

机器学习 · 计算机科学 2024-05-16 Xingzhou Lou , Junge Zhang , Ziyan Wang , Kaiqi Huang , Yali Du

To ensure the usefulness of Reinforcement Learning (RL) in real systems, it is crucial to ensure they are robust to noise and adversarial attacks. In adversarial RL, an external attacker has the power to manipulate the victim agent's…

机器学习 · 计算机科学 2024-06-18 Jeremy McMahan , Young Wu , Xiaojin Zhu , Qiaomin Xie

The safety of decentralized reinforcement learning (RL) is a challenging problem since malicious agents can share their poisoned policies with benign agents. The paper investigates a cooperative backdoor attack in a decentralized…

机器学习 · 计算机科学 2024-05-27 Mengtong Gao , Yifei Zou , Zuyuan Zhang , Xiuzhen Cheng , Dongxiao Yu

Offline reinforcement learning (RL) tries to learn the near-optimal policy with recorded offline experience without online exploration. Current offline RL research includes: 1) generative modeling, i.e., approximating a policy using fixed…

机器学习 · 计算机科学 2021-06-23 Hua Wei , Deheng Ye , Zhao Liu , Hao Wu , Bo Yuan , Qiang Fu , Wei Yang , Zhenhui Li

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

机器学习 · 计算机科学 2026-02-23 Daqian Shao

Recent studies have shown that deep reinforcement learning agents are vulnerable to small adversarial perturbations on the agent's inputs, which raises concerns about deploying such agents in the real world. To address this issue, we…

机器学习 · 计算机科学 2021-11-12 Tuomas Oikarinen , Wang Zhang , Alexandre Megretski , Luca Daniel , Tsui-Wei Weng

Deep reinforcement learning models are vulnerable to adversarial attacks that can decrease a victim's cumulative expected reward by manipulating the victim's observations. Despite the efficiency of previous optimization-based methods for…

机器学习 · 计算机科学 2023-02-28 You Qiaoben , Chengyang Ying , Xinning Zhou , Hang Su , Jun Zhu , Bo Zhang

Recent studies have shown that deep reinforcement learning (DRL) policies are vulnerable to adversarial attacks, which raise concerns about applications of DRL to safety-critical systems. In this work, we adopt a principled way and study…

机器学习 · 计算机科学 2022-05-17 Chao Wang

We study defense strategies against reward poisoning attacks in reinforcement learning. As a threat model, we consider attacks that minimally alter rewards to make the attacker's target policy uniquely optimal under the poisoned rewards,…

机器学习 · 计算机科学 2021-06-22 Kiarash Banihashem , Adish Singla , Goran Radanovic

Recent adversarial attack developments have made reinforcement learning more vulnerable, and different approaches exist to deploy attacks against it, where the key is how to choose the right timing of the attack. Some work tries to design…

机器学习 · 计算机科学 2022-05-03 Yang Li , Quan Pan , Erik Cambria

We study the problem of learning the optimal policy in a discounted, infinite-horizon reinforcement learning (RL) setting in the presence of adversarially corrupted rewards. To address this problem, we develop a novel robust variant of the…

机器学习 · 计算机科学 2026-05-22 Sreejeet Maity , Aritra Mitra