English
Related papers

Related papers: Cooperative Backdoor Attack in Decentralized Reinf…

200 papers

Reinforcement learning (RL) has achieved remarkable success across diverse domains, enabling autonomous systems to learn and adapt to dynamic environments by optimizing a reward function. However, this reliance on reward signals creates a…

Cryptography and Security · Computer Science 2025-12-01 Bokang Zhang , Chaojun Lu , Jianhui Li , Junfeng Wu

Recent research has confirmed the feasibility of backdoor attacks in deep reinforcement learning (RL) systems. However, the existing attacks require the ability to arbitrarily modify an agent's observation, constraining the application…

Cryptography and Security · Computer Science 2021-12-14 Lun Wang , Zaynah Javed , Xian Wu , Wenbo Guo , Xinyu Xing , Dawn Song

This paper investigates the threat of backdoors in Deep Reinforcement Learning (DRL) agent policies and proposes a novel method for their detection at runtime. Our study focuses on elusive in-distribution backdoor triggers. Such triggers…

Machine Learning · Computer Science 2024-07-23 Sanyam Vyas , Chris Hicks , Vasilios Mavroudis

Federated Learning (FL) enables decentralized model training across multiple clients without exposing local data, but its distributed feature makes it vulnerable to backdoor attacks. Despite early FL backdoor attacks modifying entire…

Machine Learning · Computer Science 2025-10-23 Kuai Yu , Xiaoyu Wu , Peishen Yan , Qingqian Yang , Linshan Jiang , Hao Wang , Yang Hua , Tao Song , Haibing Guan

Backdoor attacks can cause reinforcement learning (RL) policies to behave normally under clean inputs while executing malicious behaviors when triggers are present. Existing RL backdoor attacks are primarily studied in simulation and often…

Robotics · Computer Science 2026-05-14 Tairan Huang , Qingqing Ye , Yulin Jin , Jiawei Lian , Yaxin Xiao , Yi Wang , Haibo Hu

Federated Learning (FL) is a popular distributed machine learning paradigm that enables jointly training a global model without sharing clients' data. However, its repetitive server-client communication gives room for backdoor attacks with…

Machine Learning · Computer Science 2023-01-20 Pei Fang , Jinghui Chen

Federated learning (FL) allows a set of agents to collaboratively train a model without sharing their potentially sensitive data. This makes FL suitable for privacy-preserving applications. At the same time, FL is susceptible to adversarial…

Machine Learning · Computer Science 2021-08-02 Mustafa Safa Ozdayi , Murat Kantarcioglu , Yulia R. Gel

Since there are multiple parties in collaborative learning, malicious parties might manipulate the learning process for their own purposes through backdoor attacks. However, most of existing works only consider the federated learning…

Machine Learning · Computer Science 2020-07-08 Yang Liu , Zhihao Yi , Tianjian Chen

Backdoor attacks on reinforcement learning implant a backdoor in a victim agent's policy. Once the victim observes the trigger signal, it will switch to the abnormal mode and fail its task. Most of the attacks assume the adversary can…

Multiagent Systems · Computer Science 2022-11-22 Shuo Chen , Yue Qiu , Jie Zhang

Federated learning (FL) has been widely deployed to enable machine learning training on sensitive data across distributed devices. However, the decentralized learning paradigm and heterogeneity of FL further extend the attack surface for…

Cryptography and Security · Computer Science 2024-04-16 Haomin Zhuang , Mingxian Yu , Hao Wang , Yang Hua , Jian Li , Xu Yuan

While real-world applications of reinforcement learning are becoming popular, the security and robustness of RL systems are worthy of more attention and exploration. In particular, recent works have revealed that, in a multi-agent RL…

Machine Learning · Computer Science 2023-09-15 Junfeng Guo , Ang Li , Cong Liu

We propose a provable defense mechanism against backdoor policies in reinforcement learning under subspace trigger assumption. A backdoor policy is a security threat where an adversary publishes a seemingly well-behaved policy which in fact…

Machine Learning · Computer Science 2022-11-22 Shubham Kumar Bharti , Xuezhou Zhang , Adish Singla , Xiaojin Zhu

Deep reinforcement learning (RL) policies are known to be vulnerable to adversarial perturbations to their observations, similar to adversarial examples for classifiers. However, an attacker is not usually able to directly modify another…

Machine Learning · Computer Science 2021-01-19 Adam Gleave , Michael Dennis , Cody Wild , Neel Kant , Sergey Levine , Stuart Russell

Federated learning allows multiple participants to collaboratively train a central model without sharing their private data. However, this distributed nature also exposes new attack surfaces. In particular, backdoor attacks allow attackers…

Machine Learning · Computer Science 2025-09-24 Zhaoxin Wang , Handing Wang , Cong Tian , Yaochu Jin

In a federated learning (FL) system, malicious participants can easily embed backdoors into the aggregated model while maintaining the model's performance on the main task. To this end, various defenses, including training stage…

Machine Learning · Computer Science 2023-05-30 Henger Li , Chen Wu , Sencun Zhu , Zizhan Zheng

Reinforcement learning (RL) is an actively growing field that is seeing increased usage in real-world, safety-critical applications -- making it paramount to ensure the robustness of RL algorithms against adversarial attacks. In this work…

Machine Learning · Computer Science 2024-10-22 Ethan Rathbun , Christopher Amato , Alina Oprea

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

Cryptography and Security · Computer Science 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

Federated learning (FL) is a machine learning (ML) approach that allows the use of distributed data without compromising personal privacy. However, the heterogeneous distribution of data among clients in FL can make it difficult for the…

Machine Learning · Computer Science 2023-03-07 Thuy Dung Nguyen , Tuan Nguyen , Phi Le Nguyen , Hieu H. Pham , Khoa Doan , Kok-Seng Wong

Federated learning (FL) is vulnerable to backdoor attacks, where adversaries alter model behavior on target classification labels by embedding triggers into data samples. While these attacks have received considerable attention in…

Recent studies have shown that cooperative multi-agent deep reinforcement learning (c-MADRL) is under the threat of backdoor attacks. Once a backdoor trigger is observed, it will perform abnormal actions leading to failures or malicious…

Artificial Intelligence · Computer Science 2024-09-13 Yinbo Yu , Saihao Yan , Jiajia Liu
‹ Prev 1 2 3 10 Next ›