English
Related papers

Related papers: Trojans in Artificial Intelligence (TrojAI) Final …

200 papers

Machine learning (ML) models that use deep neural networks are vulnerable to backdoor attacks. Such attacks involve the insertion of a (hidden) trigger by an adversary. As a consequence, any input that contains the trigger will cause the…

Cryptography and Security · Computer Science 2022-03-30 Arezoo Rajabi , Bhaskar Ramasubramanian , Radha Poovendran

Neural networks can conceal malicious Trojan backdoors that allow a trigger to covertly change the model behavior. Detecting signs of these backdoors, particularly without access to any triggered data, is the subject of ongoing research and…

Machine Learning · Computer Science 2024-11-07 Todd Huster , Peter Lin , Razvan Stefanescu , Emmanuel Ekwedike , Ritu Chadha

As artificial intelligence (AI) becomes deeply embedded in critical services and everyday products, it is increasingly exposed to security threats which traditional cyber defenses were not designed to handle. In this paper, we investigate…

Cryptography and Security · Computer Science 2026-03-06 Natalia Krawczyk , Mateusz Szczepkowski , Adrian Brodzik , Krzysztof Bocianiak

Deep Neural Networks are vulnerable to Trojan (or backdoor) attacks. Reverse-engineering methods can reconstruct the trigger and thus identify affected models. Existing reverse-engineering methods only consider input space constraints,…

Cryptography and Security · Computer Science 2022-10-28 Zhenting Wang , Kai Mei , Hailun Ding , Juan Zhai , Shiqing Ma

Hardware trojan detection methods, based on machine learning (ML) techniques, mainly identify suspected circuits but lack the ability to explain how the decision was arrived at. An explainable methodology and architecture is introduced…

Cryptography and Security · Computer Science 2024-10-01 Paul Whitten , Francis Wolff , Chris Papachristou

The capabilities of artificial intelligence systems have been advancing to a great extent, but these systems still struggle with failure modes, vulnerabilities, and biases. In this paper, we study the current state of the field, and present…

Cryptography and Security · Computer Science 2025-06-12 Xingli Fang , Jianwei Li , Varun Mulchandani , Jung-Eun Kim

In the rapidly evolving landscape of communication and network security, the increasing reliance on deep neural networks (DNNs) and cloud services for data processing presents a significant vulnerability: the potential for backdoors that…

Cryptography and Security · Computer Science 2024-03-14 Khondoker Murad Hossain , Tim Oates

Forecasting plays a crucial role in modern safety-critical applications, such as space operations. However, the increasing use of deep forecasting models introduces a new security risk of trojan horse attacks, carried out by hiding a…

Deep neural networks have been shown to be vulnerable to backdoor, or trojan, attacks where an adversary has embedded a trigger in the network at training time such that the model correctly classifies all standard inputs, but generates a…

Machine Learning · Computer Science 2021-09-08 Greg Fields , Mohammad Samragh , Mojan Javaheripi , Farinaz Koushanfar , Tara Javidi

The last decades have been characterized by unprecedented technological advances, many of them powered by modern technologies such as Artificial Intelligence (AI) and Machine Learning (ML). The world has become more digitally connected than…

Cryptography and Security · Computer Science 2024-01-04 Marc Schmitt

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Deep neural networks are being widely deployed for many critical tasks due to their high classification accuracy. In many cases, pre-trained models are sourced from vendors who may have disrupted the training pipeline to insert Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Xiaoyu Zhang , Ajmal Mian , Rohit Gupta , Nazanin Rahnavard , Mubarak Shah

Deep learning models have been incorporated into high-stakes sectors, including healthcare diagnosis, loan approvals, and candidate recruitment, among others. Consequently, any bias or unfairness in these models can harm those who depend on…

Machine Learning · Computer Science 2023-12-19 Mengxin Zheng , Jiaqi Xue , Yi Sheng , Lei Yang , Qian Lou , Lei Jiang

The rise of hardware-level security threats, such as side-channel attacks, hardware Trojans, and firmware vulnerabilities, demands advanced detection mechanisms that are more intelligent and adaptive. Traditional methods often fall short in…

Cryptography and Security · Computer Science 2025-05-29 Banafsheh Saber Latibari , Najmeh Nazari , Avesta Sasan , Houman Homayoun , Pratik Satam , Soheil Salehi , Hossein Sayadi

In this work, we study literature in Explainable AI and Safe AI to understand poisoning of neural models of code. In order to do so, we first establish a novel taxonomy for Trojan AI for code, and present a new aspect-based classification…

Software Engineering · Computer Science 2024-04-22 Aftab Hussain , Md Rafiqul Islam Rabin , Toufique Ahmed , Navid Ayoobi , Bowen Xu , Prem Devanbu , Mohammad Amin Alipour

AI systems are rapidly advancing in capability, and frontier model developers broadly acknowledge the need for safeguards against serious misuse. However, this paper demonstrates that fine-tuning, whether via open weights or closed…

Cryptography and Security · Computer Science 2025-09-23 Brendan Murphy , Dillon Bowen , Shahrad Mohammadzadeh , Tom Tseng , Julius Broomfield , Adam Gleave , Kellin Pelrine

This study investigates the vulnerabilities of autonomous navigation and landing systems in Urban Air Mobility (UAM) vehicles. Specifically, it focuses on Trojan attacks that target deep learning models, such as Convolutional Neural…

Cryptography and Security · Computer Science 2025-10-27 Reza Ahmari , Ahmad Mohammadi , Vahid Hemmati , Mohammed Mynuddin , Mahmoud Nabil Mahmoud , Parham Kebria , Abdollah Homaifar , Mehrdad Saif

The rapid development of Artificial Intelligence (AI) technology has enabled the deployment of various systems based on it. However, many current AI systems are found vulnerable to imperceptible attacks, biased against underrepresented…

Artificial Intelligence · Computer Science 2022-05-27 Bo Li , Peng Qi , Bo Liu , Shuai Di , Jingen Liu , Jiquan Pei , Jinfeng Yi , Bowen Zhou

With the surge of Machine Learning (ML), An emerging amount of intelligent applications have been developed. Deep Neural Networks (DNNs) have demonstrated unprecedented performance across various fields such as medical diagnosis and…

Cryptography and Security · Computer Science 2022-04-12 Xinqiao Zhang , Huili Chen , Ke Huang , Farinaz Koushanfar

Trojan backdoor is a poisoning attack against Neural Network (NN) classifiers in which adversaries try to exploit the (highly desirable) model reuse property to implant Trojans into model parameters for backdoor breaches through a poisoned…

Cryptography and Security · Computer Science 2022-09-07 Guanxiong Liu , Abdallah Khreishah , Fatima Sharadgah , Issa Khalil