English
Related papers

Related papers: Detecting AI Trojans Using Meta Neural Analysis

200 papers

When the training data are maliciously tampered, the predictions of the acquired deep neural network (DNN) can be manipulated by an adversary known as the Trojan attack (or poisoning backdoor attack). The lack of robustness of DNNs against…

Machine Learning · Computer Science 2020-08-03 Ren Wang , Gaoyuan Zhang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong , Meng Wang

Deep Neural Networks (DNNs) have been shown to be susceptible to Trojan attacks. Neural Trojan is a type of targeted poisoning attack that embeds the backdoor into the victim and is activated by the trigger in the input space. The…

Machine Learning · Computer Science 2022-08-11 Diego Garcia-soto , Huili Chen , Farinaz Koushanfar

Machine learning models that use deep neural networks (DNNs) are vulnerable to backdoor attacks. An adversary carrying out a backdoor attack embeds a predefined perturbation called a trigger into a small subset of input samples and trains…

Cryptography and Security · Computer Science 2023-09-06 Arezoo Rajabi , Surudhi Asokraj , Fengqing Jiang , Luyao Niu , Bhaskar Ramasubramanian , Jim Ritcey , Radha Poovendran

This paper addresses the problem of detecting trojans in neural networks (NNs) by analyzing systematically pruned NN models. Our pruning-based approach consists of three main steps. First, detect any deviations from the reference look-up…

Cryptography and Security · Computer Science 2021-02-10 Peter Bajcsy , Michael Majurski

Deep neural networks are known to have security issues. One particular threat is the Trojan attack. It occurs when the attackers stealthily manipulate the model's behavior through Trojaned training samples, which can later be exploited.…

Machine Learning · Computer Science 2021-06-14 Songzhu Zheng , Yikai Zhang , Hubert Wagner , Mayank Goswami , Chao Chen

This paper proposes MergeGuard, a novel methodology for mitigation of AI Trojan attacks. Trojan attacks on AI models cause inputs embedded with triggers to be misclassified to an adversary's target class, posing a significant threat to…

Cryptography and Security · Computer Science 2025-05-08 Soheil Zibakhsh Shabgahi , Yaman Jandali , Farinaz Koushanfar

Deep neural networks are being widely deployed for many critical tasks due to their high classification accuracy. In many cases, pre-trained models are sourced from vendors who may have disrupted the training pipeline to insert Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Xiaoyu Zhang , Ajmal Mian , Rohit Gupta , Nazanin Rahnavard , Mubarak Shah

An emerging amount of intelligent applications have been developed with the surge of Machine Learning (ML). Deep Neural Networks (DNNs) have demonstrated unprecedented performance across various fields such as medical diagnosis and…

Cryptography and Security · Computer Science 2021-04-22 Xinqiao Zhang , Huili Chen , Farinaz Koushanfar

With the widespread use of deep neural networks (DNNs) in high-stake applications, the security problem of the DNN models has received extensive attention. In this paper, we investigate a specific security problem called trojan attack,…

Cryptography and Security · Computer Science 2020-06-19 Ruixiang Tang , Mengnan Du , Ninghao Liu , Fan Yang , Xia Hu

Deep neural networks are vulnerable to Trojan attacks. Existing attacks use visible patterns (e.g., a patch or image transformations) as triggers, which are vulnerable to human inspection. In this paper, we propose stealthy and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zhenting Wang , Juan Zhai , Shiqing Ma

With the surge of Machine Learning (ML), An emerging amount of intelligent applications have been developed. Deep Neural Networks (DNNs) have demonstrated unprecedented performance across various fields such as medical diagnosis and…

Cryptography and Security · Computer Science 2022-04-12 Xinqiao Zhang , Huili Chen , Ke Huang , Farinaz Koushanfar

With the rising popularity of machine learning and the ever increasing demand for computational power, there is a growing need for hardware optimized implementations of neural networks and other machine learning models. As the technology…

Machine Learning · Computer Science 2018-06-18 Joseph Clements , Yingjie Lao

Despite their success and popularity, deep neural networks (DNNs) are vulnerable when facing backdoor attacks. This impedes their wider adoption, especially in mission critical applications. This paper tackles the problem of Trojan…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Xiaoling Hu , Xiao Lin , Michael Cogswell , Yi Yao , Susmit Jha , Chao Chen

While neural networks demonstrate stronger capabilities in pattern recognition nowadays, they are also becoming larger and deeper. As a result, the effort needed to train a network also increases dramatically. In many cases, it is more…

Cryptography and Security · Computer Science 2025-08-19 Yuntao Liu , Yang Xie , Ankur Srivastava

Backdoor (Trojan) attack is a common threat to deep neural networks, where samples from one or more source classes embedded with a backdoor trigger will be misclassified to adversarial target classes. Existing methods for detecting whether…

Machine Learning · Computer Science 2023-11-17 Zhen Xiang , Zidi Xiong , Bo Li

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Haripriya Harikumar , Vuong Le , Santu Rana , Sourangshu Bhattacharya , Sunil Gupta , Svetha Venkatesh

Deep Neural Networks (DNNs) have found extensive applications in safety-critical artificial intelligence systems, such as autonomous driving and facial recognition systems. However, recent research has revealed their susceptibility to…

Cryptography and Security · Computer Science 2024-08-20 Lingxin Jin , Xianyu Wen , Wei Jiang , Jinyu Zhan

A recent trojan attack on deep neural network (DNN) models is one insidious variant of data poisoning attacks. Trojan attacks exploit an effective backdoor created in a DNN model by leveraging the difficulty in interpretability of the…

Cryptography and Security · Computer Science 2020-01-20 Yansong Gao , Chang Xu , Derui Wang , Shiping Chen , Damith C. Ranasinghe , Surya Nepal

Recent work has identified that classification models implemented as neural networks are vulnerable to data-poisoning and Trojan attacks at training time. In this work, we show that these training-time vulnerabilities extend to deep…

Cryptography and Security · Computer Science 2019-03-18 Panagiota Kiourti , Kacper Wardega , Susmit Jha , Wenchao Li

As the semiconductor industry has shifted to a fabless paradigm, the risk of hardware Trojans being inserted at various stages of production has also increased. Recently, there has been a growing trend toward the use of machine learning…

Cryptography and Security · Computer Science 2023-12-04 Rahul Vishwakarma , Amin Rezaei
‹ Prev 1 2 3 10 Next ›