中文
相关论文

相关论文: Policy Poisoning in Batch Reinforcement Learning a…

200 篇论文

Instance-targeted data poisoning attacks, where an adversary corrupts a training set to induce errors on specific test points, have raised significant concerns. Balcan et al (2022) proposed an approach to addressing this challenge by…

机器学习 · 计算机科学 2025-05-09 Avrim Blum , Donya Saless

We study offline data poisoning attacks in contextual bandits, a class of reinforcement learning problems with important applications in online recommendation and adaptive medical treatment, among others. We provide a general attack…

机器学习 · 计算机科学 2018-08-27 Yuzhe Ma , Kwang-Sung Jun , Lihong Li , Xiaojin Zhu

Data poisoning attacks, in which an adversary corrupts a training set with the goal of inducing specific desired mistakes, have raised substantial concern: even just the possibility of such an attack can make a user no longer trust the…

机器学习 · 计算机科学 2022-03-09 Maria-Florina Balcan , Avrim Blum , Steve Hanneke , Dravyansh Sharma

We study data poisoning attacks in learning from human preferences. More specifically, we consider the problem of teaching/enforcing a target policy $\pi^\dagger$ by synthesizing preference data. We seek to understand the susceptibility of…

We study black-box reward poisoning attacks against reinforcement learning (RL), in which an adversary aims to manipulate the rewards to mislead a sequence of RL agents with unknown algorithms to learn a nefarious policy in an environment…

机器学习 · 计算机科学 2021-02-18 Amin Rakhsha , Xuezhou Zhang , Xiaojin Zhu , Adish Singla

Batch reinforcement learning enables policy learning without direct interaction with the environment during training, relying exclusively on previously collected sets of interactions. This approach is, therefore, well-suited for high-risk…

机器学习 · 计算机科学 2024-11-18 Amna Najib , Stefan Depeweg , Phillip Swazinna

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

机器学习 · 计算机科学 2026-01-16 Nadav Merlis

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

机器学习 · 计算机科学 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

We study indiscriminate poisoning for linear learners where an adversary injects a few crafted examples into the training data with the goal of forcing the induced model to incur higher test error. Inspired by the observation that linear…

机器学习 · 计算机科学 2023-11-13 Fnu Suya , Xiao Zhang , Yuan Tian , David Evans

In this paper, we study PAC learnability and certification of predictions under instance-targeted poisoning attacks, where the adversary who knows the test instance may change a fraction of the training set with the goal of fooling the…

机器学习 · 计算机科学 2021-08-10 Ji Gao , Amin Karbasi , Mohammad Mahmoody

Data poisoning is a type of adversarial attack on training data where an attacker manipulates a fraction of data to degrade the performance of machine learning model. Therefore, applications that rely on external data-sources for training…

机器学习 · 计算机科学 2021-04-28 Sanjay Seetharaman , Shubham Malaviya , Rosni KV , Manish Shukla , Sachin Lodha

In offline multi-agent reinforcement learning (MARL), agents estimate policies from a given dataset. We study reward-poisoning attacks in this setting where an exogenous attacker modifies the rewards in the dataset before the agents see the…

机器学习 · 计算机科学 2023-03-09 Young Wu , Jeremy McMahan , Xiaojin Zhu , Qiaomin Xie

We study reward poisoning attacks in reinforcement learning (RL), where an adversary manipulates rewards within constrained budgets to force the target RL agent to adopt a policy that aligns with the attacker's objectives. Prior works on…

Machine learning algorithms are vulnerable to poisoning attacks, where a fraction of the training data is manipulated to degrade the algorithms' performance. We show that current approaches, which typically assume that regularization…

机器学习 · 计算机科学 2021-05-25 Javier Carnerero-Cano , Luis Muñoz-González , Phillippa Spencer , Emil C. Lupu

This paper presents an approach for data-driven policy refinement in reinforcement learning, specifically designed for safety-critical applications. Our methodology leverages the strengths of data-driven optimization and reinforcement…

机器学习 · 计算机科学 2023-05-16 Ali Baheri

We consider a special case of bandit problems, namely batched bandits. Motivated by natural restrictions of recommender systems and e-commerce platforms, we assume that a learning agent observes responses batched in groups over a certain…

机器学习 · 计算机科学 2021-11-04 Danil Provodin , Pratik Gajane , Mykola Pechenizkiy , Maurits Kaptein

Federated machine learning which enables resource constrained node devices (e.g., mobile phones and IoT devices) to learn a shared model while keeping the training data local, can provide privacy, security and economic benefits by designing…

密码学与安全 · 计算机科学 2020-04-22 Gan Sun , Yang Cong , Jiahua Dong , Qiang Wang , Ji Liu

Machine learning algorithms are vulnerable to poisoning attacks: An adversary can inject malicious points in the training dataset to influence the learning process and degrade the algorithm's performance. Optimal poisoning attacks have…

机器学习 · 计算机科学 2019-09-26 Luis Muñoz-González , Bjarne Pfitzner , Matteo Russo , Javier Carnerero-Cano , Emil C. Lupu

Data poisoning attacks -- where an adversary can modify a small fraction of training data, with the goal of forcing the trained classifier to high loss -- are an important threat for machine learning in many applications. While a body of…

机器学习 · 计算机科学 2020-02-21 Yizhen Wang , Somesh Jha , Kamalika Chaudhuri

We consider the problem of security-aware planning in an unknown stochastic environment, in the presence of attacks on control signals (i.e., actuators) of the robot. We model the attacker as an agent who has the full knowledge of the…

机器人学 · 计算机科学 2026-04-07 Alper Kamil Bozkurt , Yu Wang , Miroslav Pajic