English
Related papers

Related papers: Blind Backdoors in Deep Learning Models

200 papers

In this work, we investigate the concept of biometric backdoors: a template poisoning attack on biometric systems that allows adversaries to stealthily and effortlessly impersonate users in the long-term by exploiting the template update…

Cryptography and Security · Computer Science 2020-11-06 Giulio Lovisotto , Simon Eberz , Ivan Martinovic

With the increasing adoption of AI, inherent security and privacy vulnerabilities formachine learning systems are being discovered. One such vulnerability makes itpossible for an adversary to obtain private information about the types of…

Machine Learning · Computer Science 2019-10-11 Samyadeep Basu , Rauf Izmailov , Chris Mesterharm

For nearly a decade the academic community has investigated backdoors in neural networks, primarily focusing on classification tasks where adversaries manipulate the model prediction. While demonstrably malicious, the immediate real-world…

Cryptography and Security · Computer Science 2026-03-24 Nicolas Küchler , Ivan Petrov , Conrad Grobler , Ilia Shumailov

Recent studies have shown that deep neural networks (DNNs) are vulnerable to backdoor attacks, where a designed trigger is injected into the dataset, causing erroneous predictions when activated. In this paper, we propose a novel defense…

Machine Learning · Computer Science 2025-08-08 Wenjie Huo , Katinka Wolter

Adversarial attacks on deep learning-based models pose a significant threat to the current AI infrastructure. Among them, Trojan attacks are the hardest to defend against. In this paper, we first introduce a variation of the Badnet kind of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Haripriya Harikumar , Santu Rana , Kien Do , Sunil Gupta , Wei Zong , Willy Susilo , Svetha Venkastesh

With the thriving of deep learning and the widespread practice of using pre-trained networks, backdoor attacks have become an increasing security threat drawing many research interests in recent years. A third-party model can be poisoned in…

Cryptography and Security · Computer Science 2021-03-05 Anh Nguyen , Anh Tran

Backdoor attacks change a small portion of training data by introducing hand-crafted triggers and rewiring the corresponding labels towards a desired target class. Training on such data injects a backdoor which causes malicious inference in…

Machine Learning · Computer Science 2024-09-05 Ivan Sabolić , Ivan Grubišić , Siniša Šegvić

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

Machine Learning · Computer Science 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

Deep Learning backdoor attacks have a threat model similar to traditional cyber attacks. Attack forensics, a critical counter-measure for traditional cyber attacks, is hence of importance for defending model backdoor attacks. In this paper,…

Cryptography and Security · Computer Science 2023-01-18 Siyuan Cheng , Guanhong Tao , Yingqi Liu , Shengwei An , Xiangzhe Xu , Shiwei Feng , Guangyu Shen , Kaiyuan Zhang , Qiuling Xu , Shiqing Ma , Xiangyu Zhang

The success of deep learning has enabled advances in multimodal tasks that require non-trivial fusion of multiple input domains. Although multimodal models have shown potential in many problems, their increased complexity makes them more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Matthew Walmer , Karan Sikka , Indranil Sur , Abhinav Shrivastava , Susmit Jha

Diffusion models are state-of-the-art deep learning empowered generative models that are trained based on the principle of learning forward and reverse diffusion processes via progressive noise-addition and denoising. To gain a better…

Computer Vision and Pattern Recognition · Computer Science 2023-06-12 Sheng-Yen Chou , Pin-Yu Chen , Tsung-Yi Ho

Deep neural networks (DNNs) have been proven vulnerable to backdoor attacks, where hidden features (patterns) trained to a normal model, which is only activated by some specific input (called triggers), trick the model into producing…

Cryptography and Security · Computer Science 2020-09-01 Shaofeng Li , Minhui Xue , Benjamin Zi Hao Zhao , Haojin Zhu , Xinpeng Zhang

Deep neural networks (DNN) have shown great success in many computer vision applications. However, they are also known to be susceptible to backdoor attacks. When conducting backdoor attacks, most of the existing approaches assume that the…

Cryptography and Security · Computer Science 2020-09-16 Haoliang Li , Yufei Wang , Xiaofei Xie , Yang Liu , Shiqi Wang , Renjie Wan , Lap-Pui Chau , Alex C. Kot

Supervised fine-tuning has become the predominant method for adapting large pretrained models to downstream tasks. However, recent studies have revealed that these models are vulnerable to backdoor attacks, where even a small number of…

Cryptography and Security · Computer Science 2025-01-08 Peihai Jiang , Xixiang Lyu , Yige Li , Jing Ma

The rise of pre-trained unified foundation models breaks down the barriers between different modalities and tasks, providing comprehensive support to users with unified architectures. However, the backdoor attack on pre-trained models poses…

Cryptography and Security · Computer Science 2023-02-27 Zenghui Yuan , Yixin Liu , Kai Zhang , Pan Zhou , Lichao Sun

Deep neural networks (DNNs) are vulnerable to the \emph{backdoor attack}, which intends to embed hidden backdoors in DNNs by poisoning training data. The attacked model behaves normally on benign samples, whereas its prediction will be…

Cryptography and Security · Computer Science 2021-04-06 Yiming Li , Yanjie Li , Yalei Lv , Yong Jiang , Shu-Tao Xia

Split learning is a collaborative learning design that allows several participants (clients) to train a shared model while keeping their datasets private. Recent studies demonstrate that collaborative learning models, specifically federated…

Cryptography and Security · Computer Science 2023-05-29 Behrad Tajalli , Oguzhan Ersoy , Stjepan Picek

Deep neural networks (DNNs) have gain its popularity in various scenarios in recent years. However, its excellent ability of fitting complex functions also makes it vulnerable to backdoor attacks. Specifically, a backdoor can remain hidden…

Cryptography and Security · Computer Science 2023-05-18 Xinrui Liu , Yu-an Tan , Yajie Wang , Kefan Qiu , Yuanzhang Li

We introduce a new class of attacks on machine learning models. We show that an adversary who can poison a training dataset can cause models trained on this dataset to leak significant private details of training points belonging to other…

Cryptography and Security · Computer Science 2022-10-07 Florian Tramèr , Reza Shokri , Ayrton San Joaquin , Hoang Le , Matthew Jagielski , Sanghyun Hong , Nicholas Carlini

Deep neural networks are normally executed in the forward direction. However, in this work, we identify a vulnerability that enables models to be trained in both directions and on different tasks. Adversaries can exploit this capability to…

Machine Learning · Computer Science 2024-05-20 Guy Amit , Mosh Levy , Yisroel Mirsky