English
Related papers

Related papers: Lie Detector: Unified Backdoor Detection via Cross…

200 papers

Backdoor attacks pose a significant threat to deep learning models by implanting hidden vulnerabilities that can be activated by malicious inputs. While numerous defenses have been proposed to mitigate these attacks, the heterogeneous…

Cryptography and Security · Computer Science 2025-11-18 Gorka Abad , Marina Krček , Stefanos Koffas , Behrad Tajalli , Marco Arazzi , Roberto Riaño , Xiaoyun Xu , Zhuoran Liu , Antonino Nocera , Stjepan Picek

As Large Language Models (LLMs) gain traction across critical domains, ensuring secure and trustworthy training processes has become a major concern. Backdoor attacks, where malicious actors inject hidden triggers into training data, are…

Cryptography and Security · Computer Science 2025-10-20 Issam Seddik , Sami Souihi , Mohamed Tamaazousti , Sara Tucci Piergiovanni

Deep Learning backdoor attacks have a threat model similar to traditional cyber attacks. Attack forensics, a critical counter-measure for traditional cyber attacks, is hence of importance for defending model backdoor attacks. In this paper,…

Cryptography and Security · Computer Science 2023-01-18 Siyuan Cheng , Guanhong Tao , Yingqi Liu , Shengwei An , Xiangzhe Xu , Shiwei Feng , Guangyu Shen , Kaiyuan Zhang , Qiuling Xu , Shiqing Ma , Xiangyu Zhang

Backdoor attacks on language models pose a significant threat to AI safety, where models behave normally on most inputs but exhibit harmful behavior when triggered by specific patterns. Detecting such backdoors through mechanistic…

Computation and Language · Computer Science 2026-05-11 Sachin Kumar

Federated learning allows multiple users to collaboratively train a shared classification model while preserving data privacy. This approach, where model updates are aggregated by a central server, was shown to be vulnerable to poisoning…

Machine Learning · Computer Science 2020-12-17 Chien-Lun Chen , Leana Golubchik , Marco Paolieri

The use of unvetted third-party and internet data renders pre-trained models susceptible to backdoor attacks. Detecting backdoor samples is critical to prevent backdoor activation during inference or injection during training. However,…

Cryptography and Security · Computer Science 2025-09-09 Zuquan Peng , Jianming Fu , Lixin Zou , Li Zheng , Yanzhen Ren , Guojun Peng

Although deep neural networks (DNNs) have made rapid progress in recent years, they are vulnerable in adversarial environments. A malicious backdoor could be embedded in a model by poisoning the training dataset, whose intention is to make…

Cryptography and Security · Computer Science 2021-03-25 Yinpeng Dong , Xiao Yang , Zhijie Deng , Tianyu Pang , Zihao Xiao , Hang Su , Jun Zhu

Deep neural networks (DNNs) are vulnerable to backdoor attacks, where adversaries embed a hidden backdoor trigger during the training process for malicious prediction manipulation. These attacks pose great threats to the applications of…

Cryptography and Security · Computer Science 2023-02-21 Junfeng Guo , Yiming Li , Xun Chen , Hanqing Guo , Lichao Sun , Cong Liu

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a novel backdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Felix Hsieh , Huy H. Nguyen , AprilPyone MaungMaung , Dmitrii Usynin , Isao Echizen

Backdoor attacks pose a significant threat to the security and reliability of deep learning models. To mitigate such attacks, one promising approach is to learn to extract features from the target model and use these features for backdoor…

Machine Learning · Computer Science 2025-12-24 Zhonghao Yang , Cheng Luo , Daojing He , Yiming Li , Yu Li

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Backdoor attacks are serious security threats to machine learning models where an adversary can inject poisoned samples into the training set, causing a backdoored model which predicts poisoned samples with particular triggers to particular…

Machine Learning · Computer Science 2023-07-21 Shaokui Wei , Mingda Zhang , Hongyuan Zha , Baoyuan Wu

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

Machine Learning · Computer Science 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis

Large language models (LLMs) have seen significant advancements, achieving superior performance in various Natural Language Processing (NLP) tasks, from understanding to reasoning. However, they remain vulnerable to backdoor attacks, where…

Computation and Language · Computer Science 2024-11-28 Chen Chen , Yuchen Sun , Xueluan Gong , Jiaxin Gao , Kwok-Yan Lam

Backdoor attack injects malicious behavior to models such that inputs embedded with triggers are misclassified to a target label desired by the attacker. However, natural features may behave like triggers, causing misclassification once…

Machine Learning · Computer Science 2021-03-18 Yingqi Liu , Guangyu Shen , Guanhong Tao , Zhenting Wang , Shiqing Ma , Xiangyu Zhang

Backdoor attacks allow an attacker to embed a specific vulnerability in a machine learning algorithm, activated when an attacker-chosen pattern is presented, causing a specific misprediction. The need to identify backdoors in biometric…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Alexander Unnervik , Hatef Otroshi Shahreza , Anjith George , Sébastien Marcel

Large Language Models (LLMs) can be backdoored to exhibit malicious behavior under specific deployment conditions while appearing safe during training a phenomenon known as "sleeper agents." Recent work by Hubinger et al. demonstrated that…

Artificial Intelligence · Computer Science 2025-11-21 Shahin Zanbaghi , Ryan Rostampour , Farhan Abid , Salim Al Jarmakani

Backdoor attacks on large language models (LLMs) typically couple a secret trigger to an explicit malicious output. We show that this explicit association is unnecessary for common LLMs. We introduce a compliance-only backdoor: supervised…

Machine Learning · Computer Science 2025-11-18 Yuting Tan , Yi Huang , Zhuo Li

Backdoor learning is an emerging and vital topic for studying deep neural networks' vulnerability (DNNs). Many pioneering backdoor attack and defense methods are being proposed, successively or concurrently, in the status of a rapid arms…

Machine Learning · Computer Science 2022-10-20 Baoyuan Wu , Hongrui Chen , Mingda Zhang , Zihao Zhu , Shaokui Wei , Danni Yuan , Chao Shen

Semantic communication systems, which leverage Generative AI (GAI) to transmit semantic meaning rather than raw data, are poised to revolutionize modern communications. However, they are vulnerable to backdoor attacks, a type of poisoning…

Cryptography and Security · Computer Science 2025-02-07 Ziyang Wei , Yili Jiang , Jiaqi Huang , Fangtian Zhong , Sohan Gyawali