English
Related papers

Related papers: An Adaptive Black-box Defense against Trojan Attac…

200 papers

In this work, we show how to jointly exploit adversarial perturbation and model poisoning vulnerabilities to practically launch a new stealthy attack, dubbed AdvTrojan. AdvTrojan is stealthy because it can be activated only when: 1) a…

Cryptography and Security · Computer Science 2021-09-06 Guanxiong Liu , Issa Khalil , Abdallah Khreishah , NhatHai Phan

Federated learning (FL) systems allow decentralized data-owning clients to jointly train a global model through uploading their locally trained updates to a centralized server. The property of decentralization enables adversaries to craft…

Cryptography and Security · Computer Science 2025-04-23 Yanbo Dai , Songze Li , Zihan Gan , Xueluan Gong

Trojan backdoors can be injected into large language models at various stages, including pretraining, fine-tuning, and in-context learning, posing a significant threat to the model's alignment. Due to the nature of causal language modeling,…

Computation and Language · Computer Science 2025-01-22 Vedant Bhasin , Matthew Yudin , Razvan Stefanescu , Rauf Izmailov

Neural backdoors represent one primary threat to the security of deep learning systems. The intensive research has produced a plethora of backdoor attacks/defenses, resulting in a constant arms race. However, due to the lack of evaluation…

Machine Learning · Computer Science 2022-10-24 Ren Pang , Zheng Zhang , Xiangshan Gao , Zhaohan Xi , Shouling Ji , Peng Cheng , Xiapu Luo , Ting Wang

Backdoor (Trojan) attacks are an important type of adversarial exploit against deep neural networks (DNNs), wherein a test instance is (mis)classified to the attacker's target class whenever the attacker's backdoor trigger is present. In…

Machine Learning · Computer Science 2023-08-22 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Deep Neural Networks are vulnerable to Trojan (or backdoor) attacks. Reverse-engineering methods can reconstruct the trigger and thus identify affected models. Existing reverse-engineering methods only consider input space constraints,…

Cryptography and Security · Computer Science 2022-10-28 Zhenting Wang , Kai Mei , Hailun Ding , Juan Zhai , Shiqing Ma

Machine learning models that use deep neural networks (DNNs) are vulnerable to backdoor attacks. An adversary carrying out a backdoor attack embeds a predefined perturbation called a trigger into a small subset of input samples and trains…

Cryptography and Security · Computer Science 2023-09-06 Arezoo Rajabi , Surudhi Asokraj , Fengqing Jiang , Luyao Niu , Bhaskar Ramasubramanian , Jim Ritcey , Radha Poovendran

Trojan attack on deep neural networks, also known as backdoor attack, is a typical threat to artificial intelligence. A trojaned neural network behaves normally with clean inputs. However, if the input contains a particular trigger, the…

Cryptography and Security · Computer Science 2023-03-01 Chong Fu , Xuhong Zhang , Shouling Ji , Ting Wang , Peng Lin , Yanghe Feng , Jianwei Yin

Time Series Classification (TSC) is highly vulnerable to backdoor attacks, posing significant security threats. Existing methods primarily focus on data poisoning during the training phase, designing sophisticated triggers to improve…

Cryptography and Security · Computer Science 2025-02-04 Chang Dong , Zechao Sun , Guangdong Bai , Shuying Piao , Weitong Chen , Wei Emma Zhang

A variety of defenses have been proposed against Trojans planted in (backdoor attacks on) deep neural network (DNN) classifiers. Backdoor-agnostic methods seek to reliably detect and/or to mitigate backdoors irrespective of the…

Cryptography and Security · Computer Science 2025-03-10 Guangmingmei Yang , Xi Li , Hang Wang , David J. Miller , George Kesidis

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

Machine Learning · Computer Science 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

Backdoor attacks have been shown to be a serious threat against deep learning systems such as biometric authentication and autonomous driving. An effective backdoor attack could enforce the model misbehave under certain predefined…

Cryptography and Security · Computer Science 2021-12-01 Tong Wang , Yuan Yao , Feng Xu , Shengwei An , Hanghang Tong , Ting Wang

When the training data are maliciously tampered, the predictions of the acquired deep neural network (DNN) can be manipulated by an adversary known as the Trojan attack (or poisoning backdoor attack). The lack of robustness of DNNs against…

Machine Learning · Computer Science 2020-08-03 Ren Wang , Gaoyuan Zhang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong , Meng Wang

Recent advancements in Artificial Intelligence namely in Deep Learning has heightened its adoption in many applications. Some are playing important roles to the extent that we are heavily dependent on them for our livelihood. However, as…

Cryptography and Security · Computer Science 2020-08-05 Jonathan Pan

The success of deep neural networks (DNNs) in real-world applications has benefited from abundant pre-trained models. However, the backdoored pre-trained models can pose a significant trojan threat to the deployment of downstream DNNs.…

Cryptography and Security · Computer Science 2024-07-18 Haibo Jin , Ruoxi Chen , Jinyin Chen , Haibin Zheng , Yang Zhang , Haohan Wang

A trojan backdoor is a hidden pattern typically implanted in a deep neural network. It could be activated and thus forces that infected model behaving abnormally only when an input data sample with a particular trigger present is fed to…

Cryptography and Security · Computer Science 2019-08-12 Wenbo Guo , Lun Wang , Xinyu Xing , Min Du , Dawn Song

Neural network controllers are increasingly deployed in robotic systems for tasks such as trajectory tracking and pose stabilization. However, their reliance on potentially untrusted training pipelines or supply chains introduces…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Farbod Younesi , Walter Lucia , Amr Youssef

Deep neural networks (DNNs) are vulnerable to "backdoor" poisoning attacks, in which an adversary implants a secret trigger into an otherwise normally functioning model. Detection of backdoors in trained models without access to the…

Machine Learning · Computer Science 2021-03-19 Todd Huster , Emmanuel Ekwedike

We present a novel methodology for neural network backdoor attacks. Unlike existing training-time attacks where the Trojaned network would respond to the Trojan trigger after training, our approach inserts a Trojan that will remain dormant…

Cryptography and Security · Computer Science 2022-11-04 Feisi Fu , Panagiota Kiourti , Wenchao Li

With the widespread use of deep neural networks (DNNs) in high-stake applications, the security problem of the DNN models has received extensive attention. In this paper, we investigate a specific security problem called trojan attack,…

Cryptography and Security · Computer Science 2020-06-19 Ruixiang Tang , Mengnan Du , Ninghao Liu , Fan Yang , Xia Hu