English
Related papers

Related papers: SCOUT: A Defense Against Data Poisoning Attacks in…

200 papers

Backdoor attacks are an insidious security threat against machine learning models. Adversaries can manipulate the predictions of compromised models by inserting triggers into the training phase. Various backdoor attacks have been devised…

Computation and Language · Computer Science 2023-05-29 Xuanli He , Jun Wang , Benjamin Rubinstein , Trevor Cohn

Backdoor attacks targeting text-to-image diffusion models have advanced rapidly. However, current backdoor samples often exhibit two key abnormalities compared to benign samples: 1) Semantic Consistency, where backdoor prompts tend to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jie Zhang , Zhongqi Wang , Shiguang Shan , Xilin Chen

Backdoor attacks insert malicious data into a training set so that, during inference time, it misclassifies inputs that have been patched with a backdoor trigger as the malware specified label. For backdoor attacks to bypass human…

Cryptography and Security · Computer Science 2022-04-18 Yi Zeng , Minzhou Pan , Hoang Anh Just , Lingjuan Lyu , Meikang Qiu , Ruoxi Jia

Deep learning achieves outstanding results in many machine learning tasks. Nevertheless, it is vulnerable to backdoor attacks that modify the training set to embed a secret functionality in the trained model. The modified training samples…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Gorka Abad , Jing Xu , Stefanos Koffas , Behrad Tajalli , Stjepan Picek , Mauro Conti

Backdoor attack aims at inducing neural models to make incorrect predictions for poison data while keeping predictions on the clean dataset unchanged, which creates a considerable threat to current natural language processing (NLP) systems.…

Computation and Language · Computer Science 2023-03-28 Xukun Zhou , Jiwei Li , Tianwei Zhang , Lingjuan Lyu , Muqiao Yang , Jun He

Deep speech classification tasks, mainly including keyword spotting and speaker verification, play a crucial role in speech-based human-computer interaction. Recently, the security of these technologies has been demonstrated to be…

Sound · Computer Science 2024-09-09 Wenhan Yao , Zedong XingXiarun Chen , Jia Liu , yongqiang He , Weiping Wen

The rise in popularity of text-to-image generative artificial intelligence (AI) has attracted widespread public interest. We demonstrate that this technology can be attacked to generate content that subtly manipulates its users. We propose…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Jordan Vice , Naveed Akhtar , Richard Hartley , Ajmal Mian

Backdoor attacks pose a significant threat when using third-party data for deep learning development. In these attacks, data can be manipulated to cause a trained model to behave improperly when a specific trigger pattern is applied,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Abdullah Arafat Miah , Kaan Icer , Resit Sendag , Yu Bi

At present, backdoor attacks attract attention as they do great harm to deep learning models. The adversary poisons the training data making the model being injected with a backdoor after being trained unconsciously by victims using the…

Cryptography and Security · Computer Science 2023-03-06 Shengfang Zhai , Qingni Shen , Xiaoyi Chen , Weilong Wang , Cong Li , Yuejian Fang , Zhonghai Wu

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

Large Language Models (LLMs) are known to be vulnerable to backdoor attacks, where triggers embedded in poisoned samples can maliciously alter LLMs' behaviors. In this paper, we move beyond attacking LLMs and instead examine backdoor…

Cryptography and Security · Computer Science 2025-02-18 Huaizhi Ge , Yiming Li , Qifan Wang , Yongfeng Zhang , Ruixiang Tang

Poisoning-based backdoor attacks pose significant threats to deep neural networks by embedding triggers in training data, causing models to misclassify triggered inputs as adversary-specified labels while maintaining performance on clean…

Cryptography and Security · Computer Science 2026-04-24 Yuchen Shi , Xin Guo , Huajie Chen , Tianqing Zhu , Bo Liu , Wanlei Zhou

Backdoor attacks on language models pose a significant threat to AI safety, where models behave normally on most inputs but exhibit harmful behavior when triggered by specific patterns. Detecting such backdoors through mechanistic…

Computation and Language · Computer Science 2026-05-11 Sachin Kumar

Speaker Verification (SV) is widely deployed in mobile systems to authenticate legitimate users by using their voice traits. In this work, we propose a backdoor attack MASTERKEY, to compromise the SV models. Different from previous attacks,…

Cryptography and Security · Computer Science 2023-09-14 Hanqing Guo , Xun Chen , Junfeng Guo , Li Xiao , Qiben Yan

Backdoor attack is a major threat to deep learning systems in safety-critical scenarios, which aims to trigger misbehavior of neural network models under attacker-controlled conditions. However, most backdoor attacks have to modify the…

Machine Learning · Computer Science 2023-08-24 Yizhen Yuan , Rui Kong , Shenghao Xie , Yuanchun Li , Yunxin Liu

The proliferation of face forgery techniques has raised significant concerns within society, thereby motivating the development of face forgery detection methods. These methods aim to distinguish forged faces from genuine ones and have…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Jiawei Liang , Siyuan Liang , Aishan Liu , Xiaojun Jia , Junhao Kuang , Xiaochun Cao

Interpretability is crucial to understand the inner workings of deep neural networks (DNNs) and many interpretation methods generate saliency maps that highlight parts of the input image that contribute the most to the prediction made by…

Cryptography and Security · Computer Science 2022-07-21 Shihong Fang , Anna Choromanska

Current AI-powered code assistance tools often struggle with poorly-defined problem statements that lack sufficient task context and requirements specification. Recent analysis of software engineering agents reveals that failures on such…

Computation and Language · Computer Science 2026-04-13 Manan Suri , Xiangci Li , Mehdi Shojaie , Songyang Han , Chao-Chun Hsu , Shweta Garg , Aniket Anand Deshmukh , Varun Kumar

Backdoor attacks are a kind of insidious security threat against machine learning models. After being injected with a backdoor in training, the victim model will produce adversary-specified outputs on the inputs embedded with predesigned…

Computation and Language · Computer Science 2021-06-04 Fanchao Qi , Mukai Li , Yangyi Chen , Zhengyan Zhang , Zhiyuan Liu , Yasheng Wang , Maosong Sun

Despite the general capabilities of Large Language Models (LLM), these models still request fine-tuning or adaptation with customized data when meeting specific business demands. However, this process inevitably introduces new threats,…

Cryptography and Security · Computer Science 2024-06-21 Jiongxiao Wang , Jiazhao Li , Yiquan Li , Xiangyu Qi , Junjie Hu , Yixuan Li , Patrick McDaniel , Muhao Chen , Bo Li , Chaowei Xiao