English
Related papers

Related papers: Trojan Attacks on Neural Network Controllers for R…

200 papers

Deep neural networks are being widely deployed for many critical tasks due to their high classification accuracy. In many cases, pre-trained models are sourced from vendors who may have disrupted the training pipeline to insert Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Xiaoyu Zhang , Ajmal Mian , Rohit Gupta , Nazanin Rahnavard , Mubarak Shah

Backdoor (Trojan) attacks are an important type of adversarial exploit against deep neural networks (DNNs), wherein a test instance is (mis)classified to the attacker's target class whenever the attacker's backdoor trigger is present. In…

Machine Learning · Computer Science 2023-08-22 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

A trojan backdoor is a hidden pattern typically implanted in a deep neural network. It could be activated and thus forces that infected model behaving abnormally only when an input data sample with a particular trigger present is fed to…

Cryptography and Security · Computer Science 2019-08-12 Wenbo Guo , Lun Wang , Xinyu Xing , Min Du , Dawn Song

Outsourced deep neural networks have been demonstrated to suffer from patch-based trojan attacks, in which an adversary poisons the training sets to inject a backdoor in the obtained model so that regular inputs can be still labeled…

Cryptography and Security · Computer Science 2022-05-17 Ying He , Zhili Shen , Chang Xia , Jingyu Hua , Wei Tong , Sheng Zhong

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

With the popularity of deep learning (DL), artificial intelligence (AI) has been applied in many areas of human life. Neural network or artificial neural network (NN), the main technique behind DL, has been extensively studied to facilitate…

Cryptography and Security · Computer Science 2019-12-04 Minhui Zou , Yang Shi , Chengliang Wang , Fangyu Li , WenZhan Song , Yu Wang

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Haripriya Harikumar , Vuong Le , Santu Rana , Sourangshu Bhattacharya , Sunil Gupta , Svetha Venkatesh

Neural network (NN) trojaning attack is an emerging and important attack model that can broadly damage the system deployed with NN models. Existing studies have explored the outsourced training attack scenario and transfer learning attack…

Cryptography and Security · Computer Science 2019-01-24 Yu Ji , Zixin Liu , Xing Hu , Peiqi Wang , Youhui Zhang

We present a Trojan (backdoor or trapdoor) attack that targets deep learning applications in wireless communications. A deep learning classifier is considered to classify wireless signals using raw (I/Q) samples as features and modulation…

Networking and Internet Architecture · Computer Science 2019-10-25 Kemal Davaslioglu , Yalin E. Sagduyu

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

Cryptography and Security · Computer Science 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

Together with impressive advances touching every aspect of our society, AI technology based on Deep Neural Networks (DNN) is bringing increasing security concerns. While attacks operating at test time have monopolised the initial attention…

Cryptography and Security · Computer Science 2021-11-17 Wei Guo , Benedetta Tondi , Mauro Barni

When the training data are maliciously tampered, the predictions of the acquired deep neural network (DNN) can be manipulated by an adversary known as the Trojan attack (or poisoning backdoor attack). The lack of robustness of DNNs against…

Machine Learning · Computer Science 2020-08-03 Ren Wang , Gaoyuan Zhang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong , Meng Wang

Backdoor attacks, or trojans, pose a security risk by concealing undesirable behavior in deep neural network models. Open-source neural networks are downloaded from the internet daily, possibly containing backdoors, and third-party model…

Machine Learning · Computer Science 2025-12-16 Chace Ashcraft , Ted Staley , Josh Carney , Cameron Hickert , Derek Juba , Kiran Karra , Nathan Drenkow

Pre-trained vision models (PVMs) have become a dominant component due to their exceptional performance when fine-tuned for downstream tasks. However, the presence of backdoors within PVMs poses significant threats. Unfortunately, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Aishan Liu , Xinwei Zhang , Yisong Xiao , Yuguang Zhou , Siyuan Liang , Jiakai Wang , Xianglong Liu , Xiaochun Cao , Dacheng Tao

Deep Reinforcement Learning (DRL) systems are increasingly used in safety-critical applications, yet their security remains severely underexplored. This work investigates backdoor attacks, which implant hidden triggers that cause malicious…

Machine Learning · Computer Science 2025-07-08 Sanyam Vyas , Alberto Caron , Chris Hicks , Pete Burnap , Vasilios Mavroudis

Despite their success and popularity, deep neural networks (DNNs) are vulnerable when facing backdoor attacks. This impedes their wider adoption, especially in mission critical applications. This paper tackles the problem of Trojan…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xiaoling Hu , Xiao Lin , Michael Cogswell , Yi Yao , Susmit Jha , Chao Chen

Recent advances in Trajectory Optimization (TO) models have achieved remarkable success in offline reinforcement learning. However, their vulnerabilities against backdoor attacks are poorly understood. We find that existing backdoor attacks…

Machine Learning · Computer Science 2026-05-29 Yang Dai , Oubo Ma , Longfei Zhang , Xingxing Liang , Xiaochun Cao , Shouling Ji , Jiaheng Zhang , Jincai Huang , Li Shen

This paper proposes MergeGuard, a novel methodology for mitigation of AI Trojan attacks. Trojan attacks on AI models cause inputs embedded with triggers to be misclassified to an adversary's target class, posing a significant threat to…

Cryptography and Security · Computer Science 2025-05-08 Soheil Zibakhsh Shabgahi , Yaman Jandali , Farinaz Koushanfar

Backdoor attacks have been shown to be a serious threat against deep learning systems such as biometric authentication and autonomous driving. An effective backdoor attack could enforce the model misbehave under certain predefined…

Cryptography and Security · Computer Science 2021-12-01 Tong Wang , Yuan Yao , Feng Xu , Shengwei An , Hanghang Tong , Ting Wang