English
Related papers

Related papers: Prototype-Guided Robust Learning against Backdoor …

200 papers

Due to the increasing computational demand of Deep Neural Networks (DNNs), companies and organizations have begun to outsource the training process. However, the externally trained DNNs can potentially be backdoor attacked. It is crucial to…

Machine Learning · Computer Science 2023-07-04 Lu Pang , Tao Sun , Haibin Ling , Chao Chen

Backdoor poisoning attacks are a threat to machine learning models trained on large data collected from untrusted sources; these attacks enable attackers to inject malicious behavior into the model that can be triggered by specially crafted…

Machine Learning · Computer Science 2026-01-06 Thorsten Peinemann , Paula Arnold , Sebastian Berndt , Thomas Eisenbarth , Esfandiar Mohammadi

Deep Reinforcement Learning (DRL) policies have been shown to be vulnerable to small adversarial noise in observations. Such adversarial noise can have disastrous consequences in safety-critical environments. For instance, a self-driving…

Machine Learning · Computer Science 2024-03-28 Roman Belaire , Pradeep Varakantham , Thanh Nguyen , David Lo

Poisoning-based backdoor attacks pose significant threats to deep neural networks by embedding triggers in training data, causing models to misclassify triggered inputs as adversary-specified labels while maintaining performance on clean…

Cryptography and Security · Computer Science 2026-04-24 Yuchen Shi , Xin Guo , Huajie Chen , Tianqing Zhu , Bo Liu , Wanlei Zhou

Backdoor attacks pose severe security threats to large language models (LLMs), where a model behaves normally under benign inputs but produces malicious outputs when a hidden trigger appears. Existing backdoor removal methods typically…

Cryptography and Security · Computer Science 2026-03-17 Jianwei Li , Jung-Eun Kim

Backdoor data poisoning attacks have recently been demonstrated in computer vision research as a potential safety risk for machine learning (ML) systems. Traditional data poisoning attacks manipulate training data to induce unreliability of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Loc Truong , Chace Jones , Brian Hutchinson , Andrew August , Brenda Praggastis , Robert Jasper , Nicole Nichols , Aaron Tuor

As a distributed machine learning paradigm, Federated Learning (FL) enables large-scale clients to collaboratively train a model without sharing their raw data. However, due to the lack of data auditing for untrusted clients, FL is…

Machine Learning · Computer Science 2025-09-10 Yanxin Yang , Ming Hu , Xiaofei Xie , Yue Cao , Pengyu Zhang , Yihao Huang , Mingsong Chen

Backdoor data poisoning, inserted within instruction examples used to fine-tune a foundation Large Language Model (LLM) for downstream tasks (\textit{e.g.,} sentiment prediction), is a serious security concern due to the evasive nature of…

Cryptography and Security · Computer Science 2024-08-23 Jayaram Raghuram , George Kesidis , David J. Miller

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

Machine Learning · Computer Science 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Predictions of certifiably robust classifiers remain constant in a neighborhood of a point, making them resilient to test-time attacks with a guarantee. In this work, we present a previously unrecognized threat to robust machine learning…

Machine Learning · Computer Science 2021-03-31 Akshay Mehra , Bhavya Kailkhura , Pin-Yu Chen , Jihun Hamm

Architectural backdoors pose an under-examined but critical threat to deep neural networks, embedding malicious logic directly into a model's computational graph. Unlike traditional data poisoning or parameter manipulation, architectural…

Cryptography and Security · Computer Science 2025-07-18 Victoria Childress , Josh Collyer , Jodie Knapp

Recently, backdoor attacks pose a new security threat to the training process of deep neural networks (DNNs). Attackers intend to inject hidden backdoors into DNNs, such that the attacked model performs well on benign samples, whereas its…

Cryptography and Security · Computer Science 2021-08-16 Yuezun Li , Yiming Li , Baoyuan Wu , Longkang Li , Ran He , Siwei Lyu

Backdoor attacks can cause reinforcement learning (RL) policies to behave normally under clean inputs while executing malicious behaviors when triggers are present. Existing RL backdoor attacks are primarily studied in simulation and often…

Robotics · Computer Science 2026-05-14 Tairan Huang , Qingqing Ye , Yulin Jin , Jiawei Lian , Yaxin Xiao , Yi Wang , Haibo Hu

Graph Prompt Learning (GPL) bridges significant disparities between pretraining and downstream applications to alleviate the knowledge transfer bottleneck in real-world graph learning. While GPL offers superior effectiveness in graph…

Machine Learning · Computer Science 2024-05-29 Xiaoting Lyu , Yufei Han , Wei Wang , Hangwei Qian , Ivor Tsang , Xiangliang Zhang

Backdoor attacks pose a critical threat by embedding hidden triggers into inputs, causing models to misclassify them into target labels. While extensive research has focused on mitigating these attacks in object recognition models through…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Federated Learning (FL) is a promising approach enabling multiple clients to train Deep Neural Networks (DNNs) collaboratively without sharing their local training data. However, FL is susceptible to backdoor (or targeted poisoning)…

Cryptography and Security · Computer Science 2023-08-23 Phillip Rieger , Torsten Krauß , Markus Miettinen , Alexandra Dmitrienko , Ahmad-Reza Sadeghi

Federated reinforcement learning (FRL) allows agents to jointly learn a global decision-making policy under the guidance of a central server. While FRL has advantages, its decentralized design makes it prone to poisoning attacks. To…

Cryptography and Security · Computer Science 2025-02-13 Minghong Fang , Xilong Wang , Neil Zhenqiang Gong

Multimodal contrastive learning models like CLIP have demonstrated remarkable vision-language alignment capabilities, yet their vulnerability to backdoor attacks poses critical security risks. Attackers can implant latent triggers that…

Cryptography and Security · Computer Science 2025-06-17 Mengyuan Sun , Yu Li , Yuchen Liu , Bo Du , Yunjie Ge

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

Machine Learning · Computer Science 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

In this work, besides improving prediction accuracy, we study whether personalization could bring robustness benefits to backdoor attacks. We conduct the first study of backdoor attacks in the pFL framework, testing 4 widely used backdoor…

Machine Learning · Computer Science 2023-06-06 Zeyu Qin , Liuyi Yao , Daoyuan Chen , Yaliang Li , Bolin Ding , Minhao Cheng