English
Related papers

Related papers: Architectural Neural Backdoors from First Principl…

200 papers

Backdoor attacks allow an attacker to embed functionality jeopardizing proper behavior of any algorithm, machine learning or not. This hidden functionality can remain inactive for normal use of the algorithm until activated by the attacker.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Alexander Unnervik , Sébastien Marcel

Backdoor attack aims at inducing neural models to make incorrect predictions for poison data while keeping predictions on the clean dataset unchanged, which creates a considerable threat to current natural language processing (NLP) systems.…

Computation and Language · Computer Science 2023-03-28 Xukun Zhou , Jiwei Li , Tianwei Zhang , Lingjuan Lyu , Muqiao Yang , Jun He

Backdoor (trojan) attacks embed hidden, controllable behaviors into machine-learning models so that models behave normally on benign inputs but produce attacker-chosen outputs when a trigger is present. This survey reviews the rapidly…

Cryptography and Security · Computer Science 2025-09-10 Bilal Hussain Abbasi , Yanjun Zhang , Leo Zhang , Shang Gao

Backdoor attacks pose a serious threat to the secure deployment of large language models (LLMs), enabling adversaries to implant hidden behaviors triggered by specific inputs. However, existing methods often rely on manually crafted…

Cryptography and Security · Computer Science 2025-11-24 Yige Li , Zhe Li , Wei Zhao , Nay Myat Min , Hanxun Huang , Xingjun Ma , Jun Sun

Recent cryptographic results establish that neural networks can be backdoored such that no efficient algorithm can distinguish them from a clean model. These guarantees, however, have been confined to stylised architectures of limited…

Cryptography and Security · Computer Science 2026-05-14 Marte Eggen , Eirik Reiestad , Kristian Gjøsteen , Inga Strümke

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Backdoor attacks are a kind of insidious security threat against machine learning models. After being injected with a backdoor in training, the victim model will produce adversary-specified outputs on the inputs embedded with predesigned…

Computation and Language · Computer Science 2021-06-04 Fanchao Qi , Mukai Li , Yangyi Chen , Zhengyan Zhang , Zhiyuan Liu , Yasheng Wang , Maosong Sun

Deep learning models are vulnerable to various adversarial manipulations of their training data, parameters, and input sample. In particular, an adversary can modify the training data and model parameters to embed backdoors into the model,…

Machine Learning · Computer Science 2020-06-09 Te Juin Lester Tan , Reza Shokri

Deep anomaly detection on sequential data has garnered significant attention due to the wide application scenarios. However, deep learning-based models face a critical security threat - their vulnerability to backdoor attacks. In this…

Machine Learning · Computer Science 2024-02-19 He Cheng , Shuhan Yuan

The rise of pre-trained unified foundation models breaks down the barriers between different modalities and tasks, providing comprehensive support to users with unified architectures. However, the backdoor attack on pre-trained models poses…

Cryptography and Security · Computer Science 2023-02-27 Zenghui Yuan , Yixin Liu , Kai Zhang , Pan Zhou , Lichao Sun

As society grows more reliant on machine learning, ensuring the security of machine learning systems against sophisticated attacks becomes a pressing concern. A recent result of Goldwasser, Kim, Vaikuntanathan, and Zamir (2022) shows that…

Machine Learning · Computer Science 2024-11-06 Shafi Goldwasser , Jonathan Shafer , Neekon Vafa , Vinod Vaikuntanathan

Recent studies show that neural natural language processing (NLP) models are vulnerable to backdoor attacks. Injected with backdoors, models perform normally on benign examples but produce attacker-specified predictions when the backdoor is…

Computation and Language · Computer Science 2021-06-14 Fanchao Qi , Yuan Yao , Sophia Xu , Zhiyuan Liu , Maosong Sun

Fine-tuned Large Language Models (LLMs) are vulnerable to backdoor attacks through data poisoning, yet the internal mechanisms governing these attacks remain a black box. Previous research on interpretability for LLM safety tends to focus…

Cryptography and Security · Computer Science 2025-10-01 Miao Yu , Zhenhong Zhou , Moayad Aloqaily , Kun Wang , Biwei Huang , Stephen Wang , Yueming Jin , Qingsong Wen

With the increasing number of new neural architecture designs and substantial existing neural architectures, it becomes difficult for the researchers to situate their contributions compared with existing neural architectures or establish…

Artificial Intelligence · Computer Science 2024-03-19 Xiaohuan Pei , Yanxi Li , Minjing Dong , Chang Xu

Backdoor attacks have been widely studied to hide the misclassification rules in the normal models, which are only activated when the model is aware of the specific inputs (i.e., the trigger). However, despite their success in the…

Artificial Intelligence · Computer Science 2022-01-19 Liang Chen , Qibiao Peng , Jintang Li , Yang Liu , Jiawei Chen , Yong Li , Zibin Zheng

With the thriving of deep learning and the widespread practice of using pre-trained networks, backdoor attacks have become an increasing security threat drawing many research interests in recent years. A third-party model can be poisoned in…

Cryptography and Security · Computer Science 2021-03-05 Anh Nguyen , Anh Tran

With the rise of advanced reasoning capabilities, large language models (LLMs) are receiving increasing attention. However, although reasoning improves LLMs' performance on downstream tasks, it also introduces new security risks, as…

Cryptography and Security · Computer Science 2025-10-10 Man Hu , Xinyi Wu , Zuofeng Suo , Jinbo Feng , Linghui Meng , Yanhao Jia , Anh Tuan Luu , Shuai Zhao

Large Language Models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the…

Cryptography and Security · Computer Science 2025-01-07 Shuai Zhao , Meihuizi Jia , Zhongliang Guo , Leilei Gan , Xiaoyu Xu , Xiaobao Wu , Jie Fu , Yichao Feng , Fengjun Pan , Luu Anh Tuan

Recent advances in Machine Learning (ML) have opened up new avenues for its extensive use in real-world applications. Facial recognition, specifically, is used from simple friend suggestions in social-media platforms to critical security…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Esha Sarkar , Hadjer Benkraouda , Michail Maniatakos

Autonomous vehicles ought to predict the surrounding agents' trajectories to allow safe maneuvers in uncertain and complex traffic situations. As companies increasingly apply trajectory prediction in the real world, security becomes a…

Machine Learning · Computer Science 2024-01-04 Kaouther Messaoud , Kathrin Grosse , Mickael Chen , Matthieu Cord , Patrick Pérez , Alexandre Alahi