English
Related papers

Related papers: The TrojAI Software Framework: An OpenSource tool …

200 papers

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Haripriya Harikumar , Vuong Le , Santu Rana , Sourangshu Bhattacharya , Sunil Gupta , Svetha Venkatesh

This paper proposes MergeGuard, a novel methodology for mitigation of AI Trojan attacks. Trojan attacks on AI models cause inputs embedded with triggers to be misclassified to an adversary's target class, posing a significant threat to…

Cryptography and Security · Computer Science 2025-05-08 Soheil Zibakhsh Shabgahi , Yaman Jandali , Farinaz Koushanfar

Large Language Models (LLMs) are progressively being utilized as machine learning services and interface tools for various applications. However, the security implications of LLMs, particularly in relation to adversarial and Trojan attacks,…

Cryptography and Security · Computer Science 2023-11-01 Jiaqi Xue , Mengxin Zheng , Ting Hua , Yilin Shen , Yepeng Liu , Ladislau Boloni , Qian Lou

An image encoder pre-trained by self-supervised learning can be used as a general-purpose feature extractor to build downstream classifiers for various downstream tasks. However, many studies showed that an attacker can embed a trojan into…

Cryptography and Security · Computer Science 2025-02-05 Yupei Liu , Yanting Wang , Jinyuan Jia

Trojan attack on deep neural networks, also known as backdoor attack, is a typical threat to artificial intelligence. A trojaned neural network behaves normally with clean inputs. However, if the input contains a particular trigger, the…

Cryptography and Security · Computer Science 2023-03-01 Chong Fu , Xuhong Zhang , Shouling Ji , Ting Wang , Peng Lin , Yanghe Feng , Jianwei Yin

Machine learning models that use deep neural networks (DNNs) are vulnerable to backdoor attacks. An adversary carrying out a backdoor attack embeds a predefined perturbation called a trigger into a small subset of input samples and trains…

Cryptography and Security · Computer Science 2023-09-06 Arezoo Rajabi , Surudhi Asokraj , Fengqing Jiang , Luyao Niu , Bhaskar Ramasubramanian , Jim Ritcey , Radha Poovendran

With the surge of Machine Learning (ML), An emerging amount of intelligent applications have been developed. Deep Neural Networks (DNNs) have demonstrated unprecedented performance across various fields such as medical diagnosis and…

Cryptography and Security · Computer Science 2022-04-12 Xinqiao Zhang , Huili Chen , Ke Huang , Farinaz Koushanfar

Deep neural networks (DNNs) are vulnerable to "backdoor" poisoning attacks, in which an adversary implants a secret trigger into an otherwise normally functioning model. Detection of backdoors in trained models without access to the…

Machine Learning · Computer Science 2021-03-19 Todd Huster , Emmanuel Ekwedike

Trojan (backdoor) attack is a form of adversarial attack on deep neural networks where the attacker provides victims with a model trained/retrained on malicious data. The backdoor can be activated when a normal input is stamped with a…

Machine Learning · Computer Science 2021-01-05 Siyuan Cheng , Yingqi Liu , Shiqing Ma , Xiangyu Zhang

With tools like GitHub Copilot, automatic code suggestion is no longer a dream in software engineering. These tools, based on large language models, are typically trained on massive corpora of code mined from unvetted public sources. As a…

Cryptography and Security · Computer Science 2024-01-25 Hojjat Aghakhani , Wei Dai , Andre Manoel , Xavier Fernandes , Anant Kharkar , Christopher Kruegel , Giovanni Vigna , David Evans , Ben Zorn , Robert Sim

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

In Natural Language Processing (NLP), intelligent neuron models can be susceptible to textual Trojan attacks. Such attacks occur when Trojan models behave normally for standard inputs but generate malicious output for inputs that contain a…

Computation and Language · Computer Science 2023-08-23 Qian Lou , Yepeng Liu , Bo Feng

Hardware trojan detection methods, based on machine learning (ML) techniques, mainly identify suspected circuits but lack the ability to explain how the decision was arrived at. An explainable methodology and architecture is introduced…

Cryptography and Security · Computer Science 2024-10-01 Paul Whitten , Francis Wolff , Chris Papachristou

A backdoor or Trojan attack is an important type of data poisoning attack against deep neural network (DNN) classifiers, wherein the training dataset is poisoned with a small number of samples that each possess the backdoor pattern (usually…

Machine Learning · Computer Science 2023-03-15 H. Wang , S. Karami , O. Dia , H. Ritter , E. Emamjomeh-Zadeh , J. Chen , Z. Xiang , D. J. Miller , G. Kesidis

This study investigates the vulnerabilities of autonomous navigation and landing systems in Urban Air Mobility (UAM) vehicles. Specifically, it focuses on Trojan attacks that target deep learning models, such as Convolutional Neural…

Cryptography and Security · Computer Science 2025-10-27 Reza Ahmari , Ahmad Mohammadi , Vahid Hemmati , Mohammed Mynuddin , Mahmoud Nabil Mahmoud , Parham Kebria , Abdollah Homaifar , Mehrdad Saif

Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can later be exploited.…

Machine Learning · Computer Science 2021-06-14 Songzhu Zheng , Yikai Zhang , Hubert Wagner , Mayank Goswami , Chao Chen

A recent trojan attack on deep neural network (DNN) models is one insidious variant of data poisoning attacks. Trojan attacks exploit an effective backdoor created in a DNN model by leveraging the difficulty in interpretability of the…

Cryptography and Security · Computer Science 2020-01-20 Yansong Gao , Chang Xu , Derui Wang , Shiping Chen , Damith C. Ranasinghe , Surya Nepal

Due to the current horizontal business model that promotes increasing reliance on untrusted third-party Intellectual Properties (IPs), CAD tools, and design facilities, hardware Trojan attacks have become a serious threat to the…

Cryptography and Security · Computer Science 2022-04-20 Jonathan Cruz , Pravin Gaikwad , Abhishek Nair , Prabuddha Chakraborty , Swarup Bhunia

Deep Neural Networks (DNNs) have found extensive applications in safety-critical artificial intelligence systems, such as autonomous driving and facial recognition systems. However, recent research has revealed their susceptibility to…

Cryptography and Security · Computer Science 2024-08-20 Lingxin Jin , Xianyu Wen , Wei Jiang , Jinyu Zhan

We target the problem of detecting Trojans or backdoors in DNNs. Such models behave normally with typical inputs but produce specific incorrect predictions for inputs poisoned with a Trojan trigger. Our approach is based on a novel…

Machine Learning · Computer Science 2020-12-07 Karan Sikka , Indranil Sur , Susmit Jha , Anirban Roy , Ajay Divakaran