English
Related papers

Related papers: Marksman Backdoor: Backdoor Attacks with Arbitrary…

200 papers

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

Cryptography and Security · Computer Science 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

The prompt-based learning paradigm, which bridges the gap between pre-training and fine-tuning, achieves state-of-the-art performance on several NLP tasks, particularly in few-shot settings. Despite being widely applied, prompt-based…

Computation and Language · Computer Science 2024-02-05 Shuai Zhao , Jinming Wen , Luu Anh Tuan , Junbo Zhao , Jie Fu

Recent advancements in deep learning-based compression techniques have surpassed traditional methods. However, deep neural networks remain vulnerable to backdoor attacks, where pre-defined triggers induce malicious behaviors. This paper…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yi Yu , Yufei Wang , Wenhan Yang , Lanqing Guo , Shijian Lu , Ling-Yu Duan , Yap-Peng Tan , Alex C. Kot

Backdoor attacks allow an attacker to embed a specific vulnerability in a machine learning algorithm, activated when an attacker-chosen pattern is presented, causing a specific misprediction. The need to identify backdoors in biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Alexander Unnervik , Hatef Otroshi Shahreza , Anjith George , Sébastien Marcel

Machine learning models are routinely deployed on a wide range of computing hardware. Although such hardware is typically expected to produce identical results, differences in its design can lead to small numerical variations during…

Machine Learning · Computer Science 2026-02-03 Jonas Möller , Erik Imgrund , Thorsten Eisenhofer , Konrad Rieck

Most existing methods to detect backdoored machine learning (ML) models take one of the two approaches: trigger inversion (aka. reverse engineer) and weight analysis (aka. model diagnosis). In particular, the gradient-based trigger…

Cryptography and Security · Computer Science 2024-07-23 Rui Zhu , Di Tang , Siyuan Tang , Guanhong Tao , Shiqing Ma , Xiaofeng Wang , Haixu Tang

Recently, advanced NLP models have seen a surge in the usage of various applications. This raises the security threats of the released models. In addition to the clean models' unintentional weaknesses, {\em i.e.,} adversarial attacks, the…

Computation and Language · Computer Science 2021-01-18 Lichao Sun

Class incremental learning approaches are useful as they help the model to learn new information (classes) sequentially, while also retaining the previously acquired information (classes). However, it has been shown that such approaches are…

Machine Learning · Computer Science 2023-05-01 Muhammad Umer , Robi Polikar

Backdoor (Trojan) attack is a common threat to deep neural networks, where samples from one or more source classes embedded with a backdoor trigger will be misclassified to adversarial target classes. Existing methods for detecting whether…

Machine Learning · Computer Science 2023-11-17 Zhen Xiang , Zidi Xiong , Bo Li

Deep reinforcement learning (DRL) has achieved remarkable success in a wide range of sequential decision-making applications, including robotics, healthcare, smart grids, and finance. Recent studies reveal that adversaries can implant…

Cryptography and Security · Computer Science 2025-11-19 Mingxuan Zhang , Oubo Ma , Kang Wei , Songze Li , Shouling Ji

Recent studies have shown that DNNs can be compromised by backdoor attacks crafted at training time. A backdoor attack installs a backdoor into the victim model by injecting a backdoor pattern into a small proportion of the training data.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Yunfei Liu , Xingjun Ma , James Bailey , Feng Lu

Backdoor attack is a powerful attack algorithm to deep learning model. Recently, GNN's vulnerability to backdoor attack has been proved especially on graph classification task. In this paper, we propose the first backdoor detection and…

Artificial Intelligence · Computer Science 2022-09-08 Bingchen Jiang , Zhao Li

Large pre-trained models have achieved notable success across a range of downstream tasks. However, recent research shows that a type of adversarial attack ($\textit{i.e.,}$ backdoor attack) can manipulate the behavior of machine learning…

Artificial Intelligence · Computer Science 2024-10-29 Dongliang Guo , Mengxuan Hu , Zihan Guan , Junfeng Guo , Thomas Hartvigsen , Sheng Li

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

Machine Learning · Computer Science 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

Machine Learning using neural networks has received prominent attention recently because of its success in solving a wide variety of computational tasks, in particular in the field of computer vision. However, several works have drawn…

Machine Learning · Computer Science 2024-08-01 C. A. Martínez-Mejía , J. Solano , J. Breier , D. Bucko , X. Hou

Multimodal contrastive learning models like CLIP have demonstrated remarkable vision-language alignment capabilities, yet their vulnerability to backdoor attacks poses critical security risks. Attackers can implant latent triggers that…

Cryptography and Security · Computer Science 2025-06-17 Mengyuan Sun , Yu Li , Yuchen Liu , Bo Du , Yunjie Ge

Backdoor attack aims at inducing neural models to make incorrect predictions for poison data while keeping predictions on the clean dataset unchanged, which creates a considerable threat to current natural language processing (NLP) systems.…

Computation and Language · Computer Science 2023-03-28 Xukun Zhou , Jiwei Li , Tianwei Zhang , Lingjuan Lyu , Muqiao Yang , Jun He

As collaborative learning allows joint training of a model using multiple sources of data, the security problem has been a central concern. Malicious users can upload poisoned data to prevent the model's convergence or inject hidden…

Cryptography and Security · Computer Science 2021-01-21 Ximing Qiao , Yuhua Bai , Siping Hu , Ang Li , Yiran Chen , Hai Li

Federated learning security research has predominantly focused on backdoor threats from a minority of malicious clients that intentionally corrupt model updates. This paper challenges this paradigm by investigating a more pervasive and…

Cryptography and Security · Computer Science 2026-02-18 Haodong Zhao , Jinming Hu , Gongshen Liu

Current backdoor defenses assume that neutralizing a known trigger removes the backdoor. We show this trigger-centric view is incomplete: \emph{alternative triggers}, patterns perceptually distinct from training triggers, reliably activate…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Gorka Abad , Ermes Franch , Stefanos Koffas , Stjepan Picek