中文
相关论文

相关论文: Blackbox Attacks on Reinforcement Learning Agents …

200 篇论文

Attacks on machine learning models have been extensively studied through stateless optimization. In this paper, we demonstrate how a reinforcement learning (RL) agent can learn a new class of attack algorithms that generate adversarial…

密码学与安全 · 计算机科学 2025-11-20 Kyle Domico , Jean-Charles Noirot Ferrand , Ryan Sheatsley , Eric Pauley , Josiah Hanna , Patrick McDaniel

Adversarial samples are perturbed inputs crafted to mislead the machine learning systems. A training mechanism, called adversarial training, which presents adversarial samples along with clean samples has been introduced to learn robust…

计算机视觉与模式识别 · 计算机科学 2018-08-07 Vivek B. S. , Konda Reddy Mopuri , R. Venkatesh Babu

Adversarial examples can be useful for identifying vulnerabilities in AI systems before they are deployed. In reinforcement learning (RL), adversarial policies can be developed by training an adversarial agent to minimize a target agent's…

人工智能 · 计算机科学 2023-10-17 Stephen Casper , Taylor Killian , Gabriel Kreiman , Dylan Hadfield-Menell

In recent years, deep reinforcement learning (Deep RL) has been successfully implemented as a smart agent in many systems such as complex games, self-driving cars, and chat-bots. One of the interesting use cases of Deep RL is its…

机器学习 · 计算机科学 2023-09-27 Foozhan Ataiefard , Hadi Hemmati

Adversarial attacks on video recognition models have been explored recently. However, most existing works treat each video frame equally and ignore their temporal interactions. To overcome this drawback, a few methods try to select some key…

计算机视觉与模式识别 · 计算机科学 2022-03-14 Xingxing Wei , Huanqian Yan , Bo Li

Recent studies have demonstrated that reinforcement learning (RL) agents are susceptible to adversarial manipulation, similar to vulnerabilities previously demonstrated in the supervised learning setting. While most existing work studies…

Many machine learning models are vulnerable to adversarial examples: inputs that are specially crafted to cause a machine learning model to produce an incorrect output. Adversarial examples that affect one model often affect another model,…

密码学与安全 · 计算机科学 2016-05-25 Nicolas Papernot , Patrick McDaniel , Ian Goodfellow

Deep learning models are vulnerable to external attacks. In this paper, we propose a Reinforcement Learning (RL) based approach to generate adversarial examples for the pre-trained (target) models. We assume a semi black-box setting where…

机器学习 · 计算机科学 2018-11-15 Mandar Kulkarni

Collaborative multi-agent reinforcement learning has rapidly evolved, offering state-of-the-art algorithms for real-world applications, including sensitive domains. However, a key challenge to its widespread adoption is the lack of a…

机器学习 · 计算机科学 2026-01-22 Amine Andam , Jamal Bentahar , Mustapha Hedabou

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

机器学习 · 计算机科学 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

We study black-box reward poisoning attacks against reinforcement learning (RL), in which an adversary aims to manipulate the rewards to mislead a sequence of RL agents with unknown algorithms to learn a nefarious policy in an environment…

机器学习 · 计算机科学 2021-02-18 Amin Rakhsha , Xuezhou Zhang , Xiaojin Zhu , Adish Singla

In the scenario of black-box adversarial attack, the target model's parameters are unknown, and the attacker aims to find a successful adversarial perturbation based on query feedback under a query budget. Due to the limited feedback…

机器学习 · 计算机科学 2023-01-03 Fei Yin , Yong Zhang , Baoyuan Wu , Yan Feng , Jingyi Zhang , Yanbo Fan , Yujiu Yang

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

机器学习 · 计算机科学 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

Due to the broad range of applications of reinforcement learning (RL), understanding the effects of adversarial attacks against RL model is essential for the safe applications of this model. Prior theoretical works on adversarial attacks…

机器学习 · 计算机科学 2021-10-27 Guanlin Liu , Lifeng Lai

Recent studies show that Deep Reinforcement Learning (DRL) models are vulnerable to adversarial attacks, which attack DRL models by adding small perturbations to the observations. However, some attacks assume full availability of the victim…

机器学习 · 计算机科学 2022-02-18 Xinlei Pan , Chaowei Xiao , Warren He , Shuang Yang , Jian Peng , Mingjie Sun , Jinfeng Yi , Zijiang Yang , Mingyan Liu , Bo Li , Dawn Song

Deep Learning has been shown to be particularly vulnerable to adversarial samples. To combat adversarial strategies, numerous defensive techniques have been proposed. Among these, a promising approach is to use randomness in order to make…

密码学与安全 · 计算机科学 2020-03-18 Kumar Sharad , Giorgia Azzurra Marson , Hien Thi Thu Truong , Ghassan Karame

We tackle the blackbox issue of deep neural networks in the settings of reinforcement learning (RL) where neural agents learn towards maximizing reward gains in an uncontrollable way. Such learning approach is risky when the interacting…

机器学习 · 计算机科学 2018-11-13 John Yang , Gyujeong Lee , Minsung Hyun , Simyung Chang , Nojun Kwak

Adversarial attacks, e.g., adversarial perturbations of the input and adversarial samples, pose significant challenges to machine learning and deep learning techniques, including interactive recommendation systems. The latent embedding…

机器学习 · 计算机科学 2021-12-03 Siyu Wang , Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Quan Z. Sheng

Manipulating the interaction trajectories between the intelligent agent and the environment can control the agent's training and behavior, exposing the potential vulnerabilities of reinforcement learning (RL). For example, in Cyber-Physical…

机器学习 · 计算机科学 2024-11-21 Zhi Luo , Xiyuan Yang , Pan Zhou , Di Wang

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

计算机视觉与模式识别 · 计算机科学 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou
‹ 上一页 1 2 3 10 下一页 ›