English
Related papers

Related papers: An Adaptive Black-box Backdoor Detection Method fo…

200 papers

We present a novel methodology for neural network backdoor attacks. Unlike existing training-time attacks where the Trojaned network would respond to the Trojan trigger after training, our approach inserts a Trojan that will remain dormant…

Cryptography and Security · Computer Science 2022-11-04 Feisi Fu , Panagiota Kiourti , Wenchao Li

Neural networks can conceal malicious Trojan backdoors that allow a trigger to covertly change the model behavior. Detecting signs of these backdoors, particularly without access to any triggered data, is the subject of ongoing research and…

Machine Learning · Computer Science 2024-11-07 Todd Huster , Peter Lin , Razvan Stefanescu , Emmanuel Ekwedike , Ritu Chadha

With the widespread use of deep neural networks (DNNs) in high-stake applications, the security problem of the DNN models has received extensive attention. In this paper, we investigate a specific security problem called trojan attack,…

Cryptography and Security · Computer Science 2020-06-19 Ruixiang Tang , Mengnan Du , Ninghao Liu , Fan Yang , Xia Hu

Deep neural networks (DNNs) have been proven vulnerable to backdoor attacks, where hidden features (patterns) trained to a normal model, which is only activated by some specific input (called triggers), trick the model into producing…

Cryptography and Security · Computer Science 2020-09-01 Shaofeng Li , Minhui Xue , Benjamin Zi Hao Zhao , Haojin Zhu , Xinpeng Zhang

Deep neural networks (DNN), despite their remarkable performance, are highly vulnerable to backdoor attacks. Existing defenses mainly rely on activation anomaly analysis or trigger reverse engineering and often require clean samples or…

Cryptography and Security · Computer Science 2026-05-20 Yinbo Yu , Jing Fang , Xuewen Zhang , Chunwei Tian , Qi Zhu , Daoqiang Zhang , Jiajia Liu

This paper proposes a data-efficient detection method for deep neural networks against backdoor attacks under a black-box scenario. The proposed approach is motivated by the intuition that features corresponding to triggers have a higher…

Cryptography and Security · Computer Science 2023-07-20 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Trojan backdoors can be injected into large language models at various stages, including pretraining, fine-tuning, and in-context learning, posing a significant threat to the model's alignment. Due to the nature of causal language modeling,…

Computation and Language · Computer Science 2025-01-22 Vedant Bhasin , Matthew Yudin , Razvan Stefanescu , Rauf Izmailov

Deep neural networks have demonstrated remarkable success across numerous tasks, yet they remain vulnerable to Trojan (backdoor) attacks, raising serious concerns about their safety in real-world mission-critical applications. A common…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Hossein Mirzaei , Zeinab Taghavi , Sepehr Rezaee , Masoud Hadi , Moein Madadi , Mackenzie W. Mathis

We propose CLEANN, the first end-to-end framework that enables online mitigation of Trojans for embedded Deep Neural Network (DNN) applications. A Trojan attack works by injecting a backdoor in the DNN while training; during inference, the…

Machine Learning · Computer Science 2020-09-08 Mojan Javaheripi , Mohammad Samragh , Gregory Fields , Tara Javidi , Farinaz Koushanfar

Deep Neural Networks (DNN) are becoming increasingly more important in assisted and automated driving. Using such entities which are obtained using machine learning is inevitable: tasks such as recognizing traffic signs cannot be developed…

Cryptography and Security · Computer Science 2024-10-11 Akshay Dhonthi , Ernst Moritz Hahn , Vahid Hashemi

Deep neural networks (DNNs) are proved to be vulnerable against backdoor attacks. A backdoor is often embedded in the target DNNs through injecting a backdoor trigger into training examples, which can cause the target DNNs misclassify an…

Machine Learning · Computer Science 2022-02-28 Junfeng Guo , Ang Li , Cong Liu

The backdoor or Trojan attack is a severe threat to deep neural networks (DNNs). Researchers find that DNNs trained on benign data and settings can also learn backdoor behaviors, which is known as the natural backdoor. Existing works on…

Machine Learning · Computer Science 2022-10-28 Zhenting Wang , Hailun Ding , Juan Zhai , Shiqing Ma

Deep Neural Networks (DNNs) have been applied successfully in computer vision. However, their wide adoption in image-related applications is threatened by their vulnerability to trojan attacks. These attacks insert some misbehavior at…

Computer Vision and Pattern Recognition · Computer Science 2020-07-03 Miguel Villarreal-Vasquez , Bharat Bhargava

In the exciting generative AI era, the diffusion model has emerged as a very powerful and widely adopted content generation and editing tool for various data modalities, making the study of their potential security risks very necessary and…

Cryptography and Security · Computer Science 2024-02-06 Yang Sui , Huy Phan , Jinqi Xiao , Tianfang Zhang , Zijie Tang , Cong Shi , Yan Wang , Yingying Chen , Bo Yuan

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

Deep neural networks (DNN) have shown great success in many computer vision applications. However, they are also known to be susceptible to backdoor attacks. When conducting backdoor attacks, most of the existing approaches assume that the…

Cryptography and Security · Computer Science 2020-09-16 Haoliang Li , Yufei Wang , Xiaofei Xie , Yang Liu , Shiqi Wang , Renjie Wan , Lap-Pui Chau , Alex C. Kot

Deep neural networks are being widely deployed for many critical tasks due to their high classification accuracy. In many cases, pre-trained models are sourced from vendors who may have disrupted the training pipeline to insert Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Xiaoyu Zhang , Ajmal Mian , Rohit Gupta , Nazanin Rahnavard , Mubarak Shah

Along with the success of deep neural network (DNN) models, rise the threats to the integrity of these models. A recent threat is the Trojan attack where an attacker interferes with the training pipeline by inserting triggers into some of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Marzieh Edraki , Nazmul Karim , Nazanin Rahnavard , Ajmal Mian , Mubarak Shah

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

Machine Learning · Computer Science 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can later be exploited.…

Machine Learning · Computer Science 2021-06-14 Songzhu Zheng , Yikai Zhang , Hubert Wagner , Mayank Goswami , Chao Chen