English
Related papers

Related papers: Toward Evaluating Robustness of Reinforcement Lear…

200 papers

Most existing works focus on direct perturbations to the victim's state/action or the underlying transition dynamics to demonstrate the vulnerability of reinforcement learning agents to adversarial attacks. However, such direct…

Machine Learning · Computer Science 2024-02-21 Xiangyu Liu , Souradip Chakraborty , Yanchao Sun , Furong Huang

Machine learning (ML) models are often sensitive to carefully crafted yet seemingly unnoticeable perturbations. Such adversarial examples are considered to be a property of ML models, often associated with their black-box operation and…

Machine Learning · Computer Science 2025-04-29 Elad Sofer , Tomer Shaked , Caroline Chaux , Nir Shlezinger

Multi-component natural language processing (NLP) pipelines are increasingly deployed for high-stakes decisions, yet no existing adversarial method can test their robustness under realistic conditions: binary-only feedback, no gradient…

Artificial Intelligence · Computer Science 2026-04-28 Mazal Bethany , Kim-Kwang Raymond Choo , Nishant Vishwamitra , Peyman Najafirad

To improve policy robustness of deep reinforcement learning agents, a line of recent works focus on producing disturbances of the environment. Existing approaches of the literature to generate meaningful disturbances of the environment are…

Machine Learning · Computer Science 2022-10-04 Lucas Schott , Hatem Hajri , Sylvain Lamprier

Multi-agent navigation in dynamic environments is of great industrial value when deploying a large scale fleet of robot to real-world applications. This paper proposes a decentralized partially observable multi-agent path planning with…

Robotics · Computer Science 2020-08-03 Zuxin Liu , Baiming Chen , Hongyi Zhou , Guru Koushik , Martial Hebert , Ding Zhao

Adversarial attacks pose significant challenges for detecting adversarial attacks at an early stage. We propose attack-agnostic detection on reinforcement learning-based interactive recommendation systems. We first craft adversarial…

Machine Learning · Computer Science 2020-06-16 Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Wei Emma Zhang

In inverse reinforcement learning (IRL), an agent seeks to replicate expert demonstrations through interactions with the environment. Traditionally, IRL is treated as an adversarial game, where an adversary searches over reward models, and…

Machine Learning · Computer Science 2025-04-23 Arnav Kumar Jain , Harley Wiltzer , Jesse Farebrother , Irina Rish , Glen Berseth , Sanjiban Choudhury

Cooperation is central to multi-agent reinforcement learning (MARL), yet learned coordination can be fragile when external perturbations disrupt inter-agent interactions. Prior robust MARL methods have primarily considered value-oriented…

Machine Learning · Computer Science 2026-05-19 Sunwoo Lee , Mingu Kang , Yonghyeon Jo , Seungyul Han

Implicit Neural Representations (INRs) have been recently garnering increasing interest in various research fields, mainly due to their ability to represent large, complex data in a compact, continuous manner. Past work further showed that…

Machine Learning · Computer Science 2026-03-04 Tamir Shor , Ethan Fetaya , Chaim Baskin , Alex Bronstein

In recent years, deep reinforcement learning (Deep RL) has been successfully implemented as a smart agent in many systems such as complex games, self-driving cars, and chat-bots. One of the interesting use cases of Deep RL is its…

Machine Learning · Computer Science 2023-09-27 Foozhan Ataiefard , Hadi Hemmati

We propose a provable defense mechanism against backdoor policies in reinforcement learning under subspace trigger assumption. A backdoor policy is a security threat where an adversary publishes a seemingly well-behaved policy which in fact…

Machine Learning · Computer Science 2022-11-22 Shubham Kumar Bharti , Xuezhou Zhang , Adish Singla , Xiaojin Zhu

Recent studies reveal that a well-trained deep reinforcement learning (RL) policy can be particularly vulnerable to adversarial perturbations on input observations. Therefore, it is crucial to train RL agents that are robust against any…

Machine Learning · Computer Science 2022-10-13 Yongyuan Liang , Yanchao Sun , Ruijie Zheng , Furong Huang

When reward functions are hand-designed, deep reinforcement learning algorithms often suffer from reward misspecification, causing them to learn suboptimal policies in terms of the intended task objectives. In the single-agent case, inverse…

Multiagent Systems · Computer Science 2025-03-07 Nathaniel Haynam , Adam Khoja , Dhruv Kumar , Vivek Myers , Erdem Bıyık

Learning to cooperate with friends and compete with foes is a key component of multi-agent reinforcement learning. Typically to do so, one requires access to either a model of or interaction with the other agent(s). Here we show how to…

Artificial Intelligence · Computer Science 2019-01-03 DJ Strouse , Max Kleiman-Weiner , Josh Tenenbaum , Matt Botvinick , David Schwab

Reinforcement learning is well suited for optimizing policies of recommender systems. Current solutions mostly focus on model-free approaches, which require frequent interactions with the real environment, and thus are expensive in model…

Machine Learning · Computer Science 2020-01-22 Xueying Bai , Jian Guan , Hongning Wang

Recent studies have shown that deep reinforcement learning agents are vulnerable to small adversarial perturbations on the agent's inputs, which raises concerns about deploying such agents in the real world. To address this issue, we…

Machine Learning · Computer Science 2021-11-12 Tuomas Oikarinen , Wang Zhang , Alexandre Megretski , Luca Daniel , Tsui-Wei Weng

Existing approaches in reinforcement learning train an agent to learn desired optimal behavior in an environment with rule based surrounding agents. In safety critical applications such as autonomous driving it is crucial that the rule…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Arjun Srinivasan , Anubhav Paras , Aniket Bera

In typical multi-agent reinforcement learning (MARL) problems, communication is important for agents to share information and make the right decisions. However, due to the complexity of training multi-agent communication, existing methods…

Multiagent Systems · Computer Science 2025-05-01 Xuyan Ma , Yawen Wang , Junjie Wang , Xiaofei Xie , Boyu Wu , Shoubin Li , Fanjiang Xu , Qing Wang

Deep neural networks are vulnerable to adversarial examples, which poses security concerns on these algorithms due to the potentially severe consequences. Adversarial attacks serve as an important surrogate to evaluate the robustness of…

Machine Learning · Computer Science 2018-03-23 Yinpeng Dong , Fangzhou Liao , Tianyu Pang , Hang Su , Jun Zhu , Xiaolin Hu , Jianguo Li

We present a Reinforcement Learning Platform for Adversarial Black-box untargeted and targeted attacks, RLAB, that allows users to select from various distortion filters to create adversarial examples. The platform uses a Reinforcement…