English
Related papers

Related papers: Vulnerability of Deep Reinforcement Learning to Po…

200 papers

Machine learning systems based on deep neural networks (DNNs) have gained mainstream adoption in many applications. Recently, however, DNNs are shown to be vulnerable to adversarial example attacks with slight perturbations on the inputs.…

Machine Learning · Computer Science 2018-12-10 Bo Luo , Min Li , Yu Li , Qiang Xu

Recent adversarial attack developments have made reinforcement learning more vulnerable, and different approaches exist to deploy attacks against it, where the key is how to choose the right timing of the attack. Some work tries to design…

Machine Learning · Computer Science 2022-05-03 Yang Li , Quan Pan , Erik Cambria

Deep Neural Networks (DNNs) have been shown to be vulnerable against adversarial examples, which are data points cleverly constructed to fool the classifier. Such attacks can be devastating in practice, especially as DNNs are being applied…

Cryptography and Security · Computer Science 2018-01-30 Linh Nguyen , Sky Wang , Arunesh Sinha

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

In deep reinforcement learning (RL), adversarial attacks can trick an agent into unwanted states and disrupt training. We propose a system called Robust Student-DQN (RS-DQN), which permits online robustness training alongside Q networks,…

Machine Learning · Computer Science 2019-11-25 Marc Fischer , Matthew Mirman , Steven Stalder , Martin Vechev

In this work, we point out the problem of observed adversaries for deep policies. Specifically, recent work has shown that deep reinforcement learning is susceptible to adversarial attacks where an observed adversary acts under…

Machine Learning · Computer Science 2022-10-14 Eugene Lim , Harold Soh

Deep neural networks (DNNs) are well known to be vulnerable to adversarial examples (AEs). In addition, AEs have adversarial transferability, namely, AEs generated for a source model fool other (target) models. In this paper, we investigate…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Miki Tanaka , Isao Echizen , Hitoshi Kiya

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

Recent advances in artificial intelligence and the increasing need for powerful defensive measures in the domain of network security, have led to the adoption of deep learning approaches for use in network intrusion detection systems. These…

Cryptography and Security · Computer Science 2021-10-26 Joseph Clements , Yuzhe Yang , Ankur Sharma , Hongxin Hu , Yingjie Lao

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

Machine Learning · Computer Science 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma

Deep reinforcement learning has shown promising results in learning control policies for complex sequential decision-making tasks. However, these neural network-based policies are known to be vulnerable to adversarial examples. This…

Computer Vision and Pattern Recognition · Computer Science 2017-10-04 Yen-Chen Lin , Ming-Yu Liu , Min Sun , Jia-Bin Huang

We present DPIQN, a deep policy inference Q-network that targets multi-agent systems composed of controllable agents, collaborators, and opponents that interact with each other. We focus on one challenging issue in such systems---modeling…

Artificial Intelligence · Computer Science 2018-04-10 Zhang-Wei Hong , Shih-Yang Su , Tzu-Yun Shann , Yi-Hsiang Chang , Chun-Yi Lee

Deep Neural Network (DNN) classifiers are vulnerable to adversarial attack, where an imperceptible perturbation could result in misclassification. However, the vulnerability of DNN-based image ranking systems remains under-explored. In this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Mo Zhou , Zhenxing Niu , Le Wang , Qilin Zhang , Gang Hua

Machine learning models are famously vulnerable to adversarial attacks: small ad-hoc perturbations of the data that can catastrophically alter the model predictions. While a large literature has studied the case of test-time attacks on…

Machine Learning · Statistics 2023-11-01 Riccardo Giuseppe Margiotta , Sebastian Goldt , Guido Sanguinetti

Deep neural networks (DNNs) are vulnerable to adversarial examples, which are crafted by adding imperceptible perturbations to inputs. Recently different attacks and strategies have been proposed, but how to generate adversarial examples…

Machine Learning · Computer Science 2021-01-13 Tao Bai , Jun Zhao , Jinlin Zhu , Shoudong Han , Jiefeng Chen , Bo Li , Alex Kot

A common belief is that intrinsically interpretable deep learning models ensure a correct, intuitive understanding of their behavior and offer greater robustness against accidental errors or intentional manipulation. However, these beliefs…

Machine Learning · Computer Science 2025-11-24 Hubert Baniecki , Przemyslaw Biecek

A key task in Artificial Intelligence is learning effective policies for controlling agents in unknown environments to optimize performance measures. Off-policy learning methods, like Q-learning, allow learners to make optimal decisions…

Artificial Intelligence · Computer Science 2025-10-27 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

While contemporary reinforcement learning research and applications have embraced policy gradient methods as the panacea of solving learning problems, value-based methods can still be useful in many domains as long as we can wrangle with…

Machine Learning · Computer Science 2024-07-16 Ashwin Ramaswamy , Ransalu Senanayake

Deep learning on graph structures has shown exciting results in various applications. However, few attentions have been paid to the robustness of such models, in contrast to numerous research work for image or text adversarial attack and…

Machine Learning · Computer Science 2018-06-08 Hanjun Dai , Hui Li , Tian Tian , Xin Huang , Lin Wang , Jun Zhu , Le Song

Two widely used techniques for training supervised machine learning models on small datasets are Active Learning and Transfer Learning. The former helps to optimally use a limited budget to label new data. The latter uses large pre-trained…

Machine Learning · Computer Science 2021-01-28 Nicolas M. Müller , Konstantin Böttinger