English
Related papers

Related papers: Detecting and Eliminating Neural Network Backdoors…

200 papers

Detecting semantic backdoors in classification models--where some classes can be activated by certain natural, but out-of-distribution inputs--is an important problem that has received relatively little attention. Semantic backdoors are…

Machine Learning · Computer Science 2026-01-08 Arpad Berta , Gabor Danner , Istvan Hegedus , Mark Jelasity

Backdoor attacks pose a significant security threat to natural language processing (NLP) systems, but existing methods lack explainable trigger mechanisms and fail to quantitatively model vulnerability patterns. This work pioneers the…

Cryptography and Security · Computer Science 2025-09-24 Gejian Zhao , Hanzhou Wu , Xinpeng Zhang

Neural network implementations are known to be vulnerable to physical attack vectors such as fault injection attacks. As of now, these attacks were only utilized during the inference phase with the intention to cause a misclassification. In…

Cryptography and Security · Computer Science 2023-02-24 Jakub Breier , Xiaolu Hou , Martín Ochoa , Jesus Solano

Machine Learning (ML) has automated a multitude of our day-to-day decision making domains such as education, employment and driving automation. The continued success of ML largely depends on our ability to trust the model we are using.…

Machine Learning · Computer Science 2022-04-01 Sakshi Udeshi , Shanshan Peng , Gerald Woo , Lionell Loh , Louth Rawshan , Sudipta Chattopadhyay

This paper proposes a data-efficient detection method for deep neural networks against backdoor attacks under a black-box scenario. The proposed approach is motivated by the intuition that features corresponding to triggers have a higher…

Cryptography and Security · Computer Science 2023-07-20 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Recently, a special type of data poisoning (DP) attack targeting Deep Neural Network (DNN) classifiers, known as a backdoor, was proposed. These attacks do not seek to degrade classification accuracy, but rather to have the classifier learn…

Machine Learning · Computer Science 2020-08-20 Zhen Xiang , David J. Miller , George Kesidis

This work addresses the problem of planting and defending cryptographic-based backdoors in artificial intelligence (AI) models. The motivation comes from our lack of understanding and the implications of using cryptographic techniques for…

Machine Learning · Computer Science 2024-05-24 Peter Bajcsy , Maxime Bros

Backdoor attacks pose a significant threat to the security and reliability of deep learning models. To mitigate such attacks, one promising approach is to learn to extract features from the target model and use these features for backdoor…

Machine Learning · Computer Science 2025-12-24 Zhonghao Yang , Cheng Luo , Daojing He , Yiming Li , Yu Li

Deep neural networks have been shown to be vulnerable to backdoor attacks, which could be easily introduced to the training set prior to model training. Recent work has focused on investigating backdoor attacks on natural images or toy…

Cryptography and Security · Computer Science 2021-01-05 Munachiso Nwadike , Takumi Miyawaki , Esha Sarkar , Michail Maniatakos , Farah Shamout

A backdoor deep learning (DL) model behaves normally upon clean inputs but misbehaves upon trigger inputs as the backdoor attacker desires, posing severe consequences to DL model deployments. State-of-the-art defenses are either limited to…

Cryptography and Security · Computer Science 2021-11-23 Yinshan Li , Hua Ma , Zhi Zhang , Yansong Gao , Alsharif Abuadbba , Anmin Fu , Yifeng Zheng , Said F. Al-Sarawi , Derek Abbott

Self-supervised learning (SSL) models are vulnerable to backdoor attacks. Existing backdoor attacks that are effective in SSL often involve noticeable triggers, like colored patches or visible noise, which are vulnerable to human…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Hanrong Zhang , Zhenting Wang , Boheng Li , Fulin Lin , Tingxu Han , Mingyu Jin , Chenlu Zhan , Mengnan Du , Hongwei Wang , Shiqing Ma

Backdoor attacks are a kind of insidious security threat against machine learning models. After being injected with a backdoor in training, the victim model will produce adversary-specified outputs on the inputs embedded with predesigned…

Computation and Language · Computer Science 2021-06-04 Fanchao Qi , Mukai Li , Yangyi Chen , Zhengyan Zhang , Zhiyuan Liu , Yasheng Wang , Maosong Sun

Deep learning models are increasingly used in mobile applications as critical components. Unlike the program bytecode whose vulnerabilities and threats have been widely-discussed, whether and how the deep learning models deployed in the…

Cryptography and Security · Computer Science 2021-01-19 Yuanchun Li , Jiayi Hua , Haoyu Wang , Chunyang Chen , Yunxin Liu

Backdoor attacks pose severe security threats to deep neural networks by embedding malicious triggers that force misclassification. While machine unlearning techniques can remove backdoor behaviors, current methods lack transparency and…

Cryptography and Security · Computer Science 2025-11-27 Tien Dat Hoang

Deep Neural Networks (DNNs) have shown great promise in various domains. However, vulnerabilities associated with DNN training, such as backdoor attacks, are a significant concern. These attacks involve the subtle insertion of triggers…

Cryptography and Security · Computer Science 2025-09-18 Bart Pleiter , Behrad Tajalli , Stefanos Koffas , Gorka Abad , Jing Xu , Martha Larson , Stjepan Picek

The backdoor or Trojan attack is a severe threat to deep neural networks (DNNs). Researchers find that DNNs trained on benign data and settings can also learn backdoor behaviors, which is known as the natural backdoor. Existing works on…

Machine Learning · Computer Science 2022-10-28 Zhenting Wang , Hailun Ding , Juan Zhai , Shiqing Ma

The backdoor attack, where the adversary uses inputs stamped with triggers (e.g., a patch) to activate pre-planted malicious behaviors, is a severe threat to Deep Neural Network (DNN) models. Trigger inversion is an effective way of…

Machine Learning · Computer Science 2023-04-07 Zhenting Wang , Kai Mei , Juan Zhai , Shiqing Ma

Federated learning has seen increased adoption in recent years in response to the growing regulatory demand for data privacy. However, the opaque local training process of federated learning also sparks rising concerns about model…

Artificial Intelligence · Computer Science 2023-08-24 Yuxi Mi , Yiheng Sun , Jihong Guan , Shuigeng Zhou

Deep learning models have recently shown to be vulnerable to backdoor poisoning, an insidious attack where the victim model predicts clean images correctly but classifies the same images as the target class when a trigger poison pattern is…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Alvin Chan , Yew-Soon Ong

Backdoor attacks have been demonstrated as a security threat for machine learning models. Traditional backdoor attacks intend to inject backdoor functionality into the model such that the backdoored model will perform abnormally on inputs…

Machine Learning · Computer Science 2023-04-19 Jing Xu , Gorka Abad , Stjepan Picek