English
Related papers

Related papers: PerD: Perturbation Sensitivity-based Neural Trojan…

200 papers

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

Cryptography and Security · Computer Science 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

With the popularity of deep learning (DL), artificial intelligence (AI) has been applied in many areas of human life. Neural network or artificial neural network (NN), the main technique behind DL, has been extensively studied to facilitate…

Cryptography and Security · Computer Science 2019-12-04 Minhui Zou , Yang Shi , Chengliang Wang , Fangyu Li , WenZhan Song , Yu Wang

Trojan attacks are sophisticated training-time attacks on neural networks that embed backdoor triggers which force the network to produce a specific output on any input which includes the trigger. With the increasing relevance of deep…

Machine Learning · Computer Science 2025-12-16 Xihe Gu , Greg Fields , Yaman Jandali , Tara Javidi , Farinaz Koushanfar

In machine learning Trojan attacks, an adversary trains a corrupted model that obtains good performance on normal data but behaves maliciously on data samples with certain trigger patterns. Several approaches have been proposed to detect…

Artificial Intelligence · Computer Science 2020-10-02 Xiaojun Xu , Qi Wang , Huichen Li , Nikita Borisov , Carl A. Gunter , Bo Li

A backdoor or Trojan attack is an important type of data poisoning attack against deep neural network (DNN) classifiers, wherein the training dataset is poisoned with a small number of samples that each possess the backdoor pattern (usually…

Machine Learning · Computer Science 2023-03-15 H. Wang , S. Karami , O. Dia , H. Ritter , E. Emamjomeh-Zadeh , J. Chen , Z. Xiang , D. J. Miller , G. Kesidis

Security of modern Deep Neural Networks (DNNs) is under severe scrutiny as the deployment of these models become widespread in many intelligence-based applications. Most recently, DNNs are attacked through Trojan which can effectively…

Cryptography and Security · Computer Science 2020-03-31 Adnan Siraj Rakin , Zhezhi He , Deliang Fan

Neural networks can conceal malicious Trojan backdoors that allow a trigger to covertly change the model behavior. Detecting signs of these backdoors, particularly without access to any triggered data, is the subject of ongoing research and…

Machine Learning · Computer Science 2024-11-07 Todd Huster , Peter Lin , Razvan Stefanescu , Emmanuel Ekwedike , Ritu Chadha

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Neural network controllers are increasingly deployed in robotic systems for tasks such as trajectory tracking and pose stabilization. However, their reliance on potentially untrusted training pipelines or supply chains introduces…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Farbod Younesi , Walter Lucia , Amr Youssef

The success of deep neural networks (DNNs) in real-world applications has benefited from abundant pre-trained models. However, the backdoored pre-trained models can pose a significant trojan threat to the deployment of downstream DNNs.…

Cryptography and Security · Computer Science 2024-07-18 Haibo Jin , Ruoxi Chen , Jinyin Chen , Haibin Zheng , Yang Zhang , Haohan Wang

Artificial Intelligence (AI) relies heavily on deep learning - a technology that is becoming increasingly popular in real-life applications of AI, even in the safety-critical and high-risk domains. However, it is recently discovered that…

Cryptography and Security · Computer Science 2022-02-16 Jie Wang , Ghulam Mubashar Hassan , Naveed Akhtar

Trojan attacks threaten deep neural networks (DNNs) by poisoning them to behave normally on most samples, yet to produce manipulated results for inputs attached with a particular trigger. Several works attempt to detect whether a given DNN…

Machine Learning · Computer Science 2022-05-25 Tianlong Chen , Zhenyu Zhang , Yihua Zhang , Shiyu Chang , Sijia Liu , Zhangyang Wang

Backdoor attacks impose a new threat in Deep Neural Networks (DNNs), where a backdoor is inserted into the neural network by poisoning the training dataset, misclassifying inputs that contain the adversary trigger. The major challenge for…

Machine Learning · Computer Science 2024-09-26 Yue Wang , Wenqing Li , Esha Sarkar , Muhammad Shafique , Michail Maniatakos , Saif Eddin Jabari

Backdoor (Trojan) attacks are an important type of adversarial exploit against deep neural networks (DNNs), wherein a test instance is (mis)classified to the attacker's target class whenever the attacker's backdoor trigger is present. In…

Machine Learning · Computer Science 2023-08-22 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Recent studies revealed that deep neural networks (DNNs) are exposed to backdoor threats when training with third-party resources (such as training samples or backbones). The backdoored model has promising performance in predicting benign…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Chengxiao Luo , Yiming Li , Yong Jiang , Shu-Tao Xia

Trojan backdoors can be injected into large language models at various stages, including pretraining, fine-tuning, and in-context learning, posing a significant threat to the model's alignment. Due to the nature of causal language modeling,…

Computation and Language · Computer Science 2025-01-22 Vedant Bhasin , Matthew Yudin , Razvan Stefanescu , Rauf Izmailov

Deep neural networks (DNNs) have been proven vulnerable to backdoor attacks, where hidden features (patterns) trained to a normal model, which is only activated by some specific input (called triggers), trick the model into producing…

Cryptography and Security · Computer Science 2020-09-01 Shaofeng Li , Minhui Xue , Benjamin Zi Hao Zhao , Haojin Zhu , Xinpeng Zhang

The unprecedented success of deep neural networks in many applications has made these networks a prime target for adversarial exploitation. In this paper, we introduce a benchmark technique for detecting backdoor attacks (aka Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Soheil Kolouri , Aniruddha Saha , Hamed Pirsiavash , Heiko Hoffmann

Deep neural network (DNN) classifiers are vulnerable to backdoor attacks. An adversary poisons some of the training data in such attacks by installing a trigger. The goal is to make the trained DNN output the attacker's desired class…

Machine Learning · Computer Science 2022-10-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Along with the success of deep neural network (DNN) models, rise the threats to the integrity of these models. A recent threat is the Trojan attack where an attacker interferes with the training pipeline by inserting triggers into some of…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Marzieh Edraki , Nazmul Karim , Nazanin Rahnavard , Ajmal Mian , Mubarak Shah