English
Related papers

Related papers: Improving Robustness of Deep Reinforcement Learnin…

200 papers

Adoption of machine learning (ML)-enabled cyber-physical systems (CPS) are becoming prevalent in various sectors of modern society such as transportation, industrial, and power grids. Recent studies in deep reinforcement learning (DRL) have…

Machine Learning · Computer Science 2020-07-15 Kai Liang Tan , Yasaman Esfandiari , Xian Yeow Lee , Aakanksha , Soumik Sarkar

Reinforcement learning (RL) agents are vulnerable to adversarial disturbances, which can deteriorate task performance or compromise safety specifications. Existing methods either address safety requirements under the assumption of no…

Machine Learning · Computer Science 2023-09-14 Zeyang Li , Chuxiong Hu , Yunan Wang , Yujie Yang , Shengbo Eben Li

Deep Neural Network-based systems are now the state-of-the-art in many robotics tasks, but their application in safety-critical domains remains dangerous without formal guarantees on network robustness. Small perturbations to sensor inputs…

Robotics · Computer Science 2020-03-10 Björn Lütjens , Michael Everett , Jonathan P. How

Deep reinforcement learning has recently made significant progress in solving computer games and robotic control tasks. A known problem, though, is that policies overfit to the training environment and may not avoid rare, catastrophic…

Machine Learning · Computer Science 2019-04-02 Xinlei Pan , Daniel Seita , Yang Gao , John Canny

Complex autonomous control systems are subjected to sensor failures, cyber-attacks, sensor noise, communication channel failures, etc. that introduce errors in the measurements. The corrupted information, if used for making decisions, can…

Machine Learning · Computer Science 2018-09-19 Abhishek Gupta , Zhaoyuan Yang

We propose a new adversarial training approach for injecting robustness when designing controllers for upcoming cyber-physical power systems. Previous approaches relying deeply on simulations are not able to cope with the rising complexity…

Machine Learning · Statistics 2021-04-19 Loïc Omnes , Antoine Marot , Benjamin Donnot

Deep Neural Networks are vulnerable to adversarial attacks. Among many defense strategies, adversarial training with untargeted attacks is one of the most effective methods. Theoretically, adversarial perturbation in untargeted attacks can…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Pengyue Hou , Jie Han , Xingyu Li

Robust adversarial reinforcement learning has emerged as an effective paradigm for training agents to handle uncertain disturbance in real environments, with critical applications in sequential decision-making domains such as autonomous…

Machine Learning · Computer Science 2026-01-26 Jiaxi Wu , Tiantian Zhang , Yuxing Wang , Yongzhe Chang , Xueqian Wang

We identify two issues with the family of algorithms based on the Adversarial Imitation Learning framework. The first problem is implicit bias present in the reward functions used in these algorithms. While these biases might work well for…

Machine Learning · Computer Science 2018-10-16 Ilya Kostrikov , Kumar Krishna Agrawal , Debidatta Dwibedi , Sergey Levine , Jonathan Tompson

In this work, we point out the problem of observed adversaries for deep policies. Specifically, recent work has shown that deep reinforcement learning is susceptible to adversarial attacks where an observed adversary acts under…

Machine Learning · Computer Science 2022-10-14 Eugene Lim , Harold Soh

Recently, robust reinforcement learning (RL) methods designed to handle adversarial input observations have received significant attention, motivated by RL's inherent vulnerabilities. While existing approaches have demonstrated reasonable…

Machine Learning · Computer Science 2025-06-23 Kosuke Nakanishi , Akihiro Kubo , Yuji Yasui , Shin Ishii

Both generative adversarial networks (GAN) in unsupervised learning and actor-critic methods in reinforcement learning (RL) have gained a reputation for being difficult to optimize. Practitioners in both fields have amassed a large number…

Machine Learning · Computer Science 2017-01-19 David Pfau , Oriol Vinyals

Communication networks able to withstand hostile environments are critically important for disaster relief operations. In this paper, we consider a challenging scenario where drones have been compromised in the supply chain, during their…

Cryptography and Security · Computer Science 2023-12-11 Chris Hicks , Vasilios Mavroudis , Myles Foley , Thomas Davies , Kate Highnam , Tim Watson

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

Recent research showed that deep neural networks are highly sensitive to so-called adversarial perturbations, which are tiny perturbations of the input data purposely designed to fool a machine learning classifier. Most classification…

Machine Learning · Computer Science 2018-01-15 Akram Erraqabi , Aristide Baratin , Yoshua Bengio , Simon Lacoste-Julien

This paper presents an algorithmic framework for learning robust policies in asymmetric imperfect-information games, where the joint reward could depend on the uncertain opponent type (a private information known only to the opponent itself…

Artificial Intelligence · Computer Science 2020-03-05 Macheng Shen , Jonathan P. How

Adversarial training is widely used to improve the robustness of deep neural networks to adversarial attack. However, adversarial training is prone to overfitting, and the cause is far from clear. This work sheds light on the mechanisms…

Machine Learning · Computer Science 2022-12-12 Lin Li , Michael Spratling

Reinforcement Learning is an area of Machine Learning focused on how agents can be trained to make sequential decisions, and achieve a particular goal within an arbitrary environment. While learning, they repeatedly take actions based on…

This paper proposes an algorithm that aims to improve generalization for reinforcement learning agents by removing overfitting to confounding features. Our approach consists of a max-min game theoretic objective. A generator transfers the…

Machine Learning · Computer Science 2023-08-31 Md Masudur Rahman , Yexiang Xue

This study investigates behavior-targeted attacks on reinforcement learning and their countermeasures. Behavior-targeted attacks aim to manipulate the victim's behavior as desired by the adversary through adversarial interventions in state…

Machine Learning · Computer Science 2026-02-18 Shojiro Yamabe , Kazuto Fukuchi , Jun Sakuma