English
Related papers

Related papers: Trojan Signatures in DNN Weights

200 papers

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

Machine Learning · Computer Science 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

Trojan attacks on deep neural networks are both dangerous and surreptitious. Over the past few years, Trojan attacks have advanced from using only a single input-agnostic trigger and targeting only one class to using multiple,…

Cryptography and Security · Computer Science 2023-02-15 Kien Do , Haripriya Harikumar , Hung Le , Dung Nguyen , Truyen Tran , Santu Rana , Dang Nguyen , Willy Susilo , Svetha Venkatesh

In machine learning Trojan attacks, an adversary trains a corrupted model that obtains good performance on normal data but behaves maliciously on data samples with certain trigger patterns. Several approaches have been proposed to detect…

Artificial Intelligence · Computer Science 2020-10-02 Xiaojun Xu , Qi Wang , Huichen Li , Nikita Borisov , Carl A. Gunter , Bo Li

This work presents a web-based interactive neural network (NN) calculator and a NN inefficiency measurement that has been investigated for the purpose of detecting trojans embedded in NN models. This NN Calculator is designed on top of…

Cryptography and Security · Computer Science 2020-09-28 Peter Bajcsy , Nicholas J. Schaub , Michael Majurski

In this work, we show how to jointly exploit adversarial perturbation and model poisoning vulnerabilities to practically launch a new stealthy attack, dubbed AdvTrojan. AdvTrojan is stealthy because it can be activated only when: 1) a…

Cryptography and Security · Computer Science 2021-09-06 Guanxiong Liu , Issa Khalil , Abdallah Khreishah , NhatHai Phan

The unprecedented success of deep neural networks in many applications has made these networks a prime target for adversarial exploitation. In this paper, we introduce a benchmark technique for detecting backdoor attacks (aka Trojan…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Soheil Kolouri , Aniruddha Saha , Hamed Pirsiavash , Heiko Hoffmann

Machine learning models in the wild have been shown to be vulnerable to Trojan attacks during training. Although many detection mechanisms have been proposed, strong adaptive attackers have been shown to be effective against them. In this…

Machine Learning · Computer Science 2022-07-14 Dinuka Sahabandu , Arezoo Rajabi , Luyao Niu , Bo Li , Bhaskar Ramasubramanian , Radha Poovendran

Recently, methods have been developed to accurately predict the testing performance of a Deep Neural Network (DNN) on a particular task, given statistics of its underlying topological structure. However, further leveraging this newly found…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Stuart Synakowski , Fabian Benitez-Quiroz , Aleix M. Martinez

Like all software systems, the execution of deep learning models is dictated in part by logic represented as data in memory. For decades, attackers have exploited traditional software programs by manipulating this data. We propose a live…

Cryptography and Security · Computer Science 2020-05-29 Robby Costales , Chengzhi Mao , Raphael Norwitz , Bryan Kim , Junfeng Yang

Recent studies have shown that deep neural networks (DNNs) are vulnerable to adversarial attacks, including evasion and backdoor (poisoning) attacks. On the defense side, there have been intensive efforts on improving both empirical and…

Machine Learning · Computer Science 2023-08-04 Maurice Weber , Xiaojun Xu , Bojan Karlaš , Ce Zhang , Bo Li

Recent research shows deep neural networks are vulnerable to different types of attacks, such as adversarial attack, data poisoning attack and backdoor attack. Among them, backdoor attack is the most cunning one and can occur in almost…

Cryptography and Security · Computer Science 2022-09-14 Jie Zhang , Dongdong Chen , Qidong Huang , Jing Liao , Weiming Zhang , Huamin Feng , Gang Hua , Nenghai Yu

Most existing methods to detect backdoored machine learning (ML) models take one of the two approaches: trigger inversion (aka. reverse engineer) and weight analysis (aka. model diagnosis). In particular, the gradient-based trigger…

Cryptography and Security · Computer Science 2024-07-23 Rui Zhu , Di Tang , Siyuan Tang , Guanhong Tao , Shiqing Ma , Xiaofeng Wang , Haixu Tang

Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Yong Li , Han Gao

Large Language Models (LLMs) have demonstrated remarkable capabilities in various domains, but their vulnerability to trojan or backdoor attacks poses significant security risks. This paper explores the challenges and insights gained from…

Computation and Language · Computer Science 2024-04-23 Narek Maloyan , Ekansh Verma , Bulat Nutfullin , Bislan Ashinov

This study investigates the vulnerabilities of autonomous navigation and landing systems in Urban Air Mobility (UAM) vehicles. Specifically, it focuses on Trojan attacks that target deep learning models, such as Convolutional Neural…

Cryptography and Security · Computer Science 2025-10-27 Reza Ahmari , Ahmad Mohammadi , Vahid Hemmati , Mohammed Mynuddin , Mahmoud Nabil Mahmoud , Parham Kebria , Abdollah Homaifar , Mehrdad Saif

This work corroborates a run-time Trojan detection method exploiting STRong Intentional Perturbation of inputs, is a multi-domain Trojan detection defence across Vision, Text and Audio domains---thus termed as STRIP-ViTA. Specifically,…

Cryptography and Security · Computer Science 2019-11-26 Yansong Gao , Yeonjae Kim , Bao Gia Doan , Zhi Zhang , Gongxuan Zhang , Surya Nepal , Damith C. Ranasinghe , Hyoungshick Kim

Cyber-physical systems rely on sensors, communication, and computing, all powered by integrated circuits (ICs). ICs are largely susceptible to various hardware attacks with malicious intents. One of the stealthiest threats is the insertion…

Cryptography and Security · Computer Science 2024-11-20 Sefatun-Noor Puspa , Abyad Enan , Reek Majumdar , M Sabbir Salek , Gurcan Comert , Mashrur Chowdhury

Deep neural networks (DNNs) are known vulnerable to backdoor attacks, a training time attack that injects a trigger pattern into a small proportion of training data so as to control the model's prediction at the test time. Backdoor attacks…

Machine Learning · Computer Science 2021-01-28 Yige Li , Xixiang Lyu , Nodens Koren , Lingjuan Lyu , Bo Li , Xingjun Ma

Machine learning backdoors have the property that the machine learning model should work as expected on normal inputs, but when the input contains a specific $\textit{trigger}$, it behaves as the attacker desires. Detecting such triggers…

Cryptography and Security · Computer Science 2026-03-12 Eirik Høyheim , Magnus Wiik Eckhoff , Gudmund Grov , Robert Flood , David Aspinall

Third-party resources ($e.g.$, samples, backbones, and pre-trained models) are usually involved in the training of deep neural networks (DNNs), which brings backdoor attacks as a new training-phase threat. In general, backdoor attackers…

Cryptography and Security · Computer Science 2023-02-06 Yiming Li , Mengxi Ya , Yang Bai , Yong Jiang , Shu-Tao Xia