English
Related papers

Related papers: Topological Detection of Trojaned Neural Networks

200 papers

Deep Neural Networks (DNNs) have become a powerful toolfor a wide range of problems. Yet recent work has found an increasing variety of adversarial samplesthat can fool them. Most existing detection mechanisms against adversarial…

Machine Learning · Computer Science 2019-11-22 Ilia Shumailov , Yiren Zhao , Robert Mullins , Ross Anderson

Complex prediction models such as deep learning are the output from fitting machine learning, neural networks, or AI models to a set of training data. These are now standard tools in science. A key challenge with the current generation of…

Machine Learning · Computer Science 2022-10-21 Meng Liu , Tamal K. Dey , David F. Gleich

Deep neural networks (DNN) are black box algorithms. They are trained using a gradient descent back propagation technique which trains weights in each layer for the sole goal of minimizing training error. Hence, the resulting weights cannot…

Machine Learning · Computer Science 2018-11-05 Daniel Goldfarb

Neural Networks are used today in numerous security- and safety-relevant domains and are, as such, a popular target of attacks that subvert their classification capabilities, by manipulating the network parameters. Prior work has introduced…

Machine Learning · Computer Science 2021-09-10 Amel Nestor Docena , Thomas Wahl , Trevor Pearce , Yunsi Fei

Recent work shows that deep neural networks are vulnerable to adversarial examples. Much work studies adversarial example generation, while very little work focuses on more critical adversarial defense. Existing adversarial detection…

Machine Learning · Computer Science 2021-09-15 Bin Zhu , Zhaoquan Gu , Le Wang , Zhihong Tian

Backdoor (Trojan) attacks are emerging threats against deep neural networks (DNN). A DNN being attacked will predict to an attacker-desired target class whenever a test sample from any source class is embedded with a backdoor pattern; while…

Cryptography and Security · Computer Science 2021-12-08 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Data poisoning attacks compromise the integrity of machine-learning models by introducing malicious training samples to influence the results during test time. In this work, we investigate backdoor data poisoning attack on deep neural…

Machine Learning · Computer Science 2019-12-04 Mahesh Subedar , Nilesh Ahuja , Ranganath Krishnan , Ibrahima J. Ndiour , Omesh Tickoo

Deep neural networks are vulnerable to Trojan attacks. Existing attacks use visible patterns (e.g., a patch or image transformations) as triggers, which are vulnerable to human inspection. In this paper, we propose stealthy and efficient…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Zhenting Wang , Juan Zhai , Shiqing Ma

An emerging amount of intelligent applications have been developed with the surge of Machine Learning (ML). Deep Neural Networks (DNNs) have demonstrated unprecedented performance across various fields such as medical diagnosis and…

Cryptography and Security · Computer Science 2021-04-22 Xinqiao Zhang , Huili Chen , Farinaz Koushanfar

Seeking effective neural networks is a critical and practical field in deep learning. Besides designing the depth, type of convolution, normalization, and nonlinearities, the topological connectivity of neural networks is also important.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Kun Yuan , Quanquan Li , Jing Shao , Junjie Yan

The backdoor or Trojan attack is a severe threat to deep neural networks (DNNs). Researchers find that DNNs trained on benign data and settings can also learn backdoor behaviors, which is known as the natural backdoor. Existing works on…

Machine Learning · Computer Science 2022-10-28 Zhenting Wang , Hailun Ding , Juan Zhai , Shiqing Ma

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

A recent trojan attack on deep neural network (DNN) models is one insidious variant of data poisoning attacks. Trojan attacks exploit an effective backdoor created in a DNN model by leveraging the difficulty in interpretability of the…

Cryptography and Security · Computer Science 2020-01-20 Yansong Gao , Chang Xu , Derui Wang , Shiping Chen , Damith C. Ranasinghe , Surya Nepal

From physics to engineering, biology and social science, natural and artificial systems are characterized by interconnected topologies whose features - e.g., heterogeneous connectivity, mesoscale organization, hierarchy - affect their…

Physics and Society · Physics 2021-09-01 Marco Grassia , Manlio De Domenico , Giuseppe Mangioni

Adversarial attacks can affect the performance of existing deep learning models. With the increased interest in graph based machine learning techniques, there have been investigations which suggest that these models are also vulnerable to…

Machine Learning · Computer Science 2020-07-15 Florence Regol , Soumyasundar Pal , Mark Coates

Recent studies have shown that deep neural networks (DNN) are vulnerable to adversarial samples: maliciously-perturbed samples crafted to yield incorrect model outputs. Such attacks can severely undermine DNN systems, particularly in…

Machine Learning · Computer Science 2017-04-28 Ji Gao , Beilun Wang , Zeming Lin , Weilin Xu , Yanjun Qi

This study investigates the vulnerabilities of autonomous navigation and landing systems in Urban Air Mobility (UAM) vehicles. Specifically, it focuses on Trojan attacks that target deep learning models, such as Convolutional Neural…

Cryptography and Security · Computer Science 2025-10-27 Reza Ahmari , Ahmad Mohammadi , Vahid Hemmati , Mohammed Mynuddin , Mahmoud Nabil Mahmoud , Parham Kebria , Abdollah Homaifar , Mehrdad Saif

Trojan attacks threaten deep neural networks (DNNs) by poisoning them to behave normally on most samples, yet to produce manipulated results for inputs attached with a particular trigger. Several works attempt to detect whether a given DNN…

Machine Learning · Computer Science 2022-05-25 Tianlong Chen , Zhenyu Zhang , Yihua Zhang , Shiyu Chang , Sijia Liu , Zhangyang Wang

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

Large Language Models (LLMs) have demonstrated remarkable capabilities in various domains, but their vulnerability to trojan or backdoor attacks poses significant security risks. This paper explores the challenges and insights gained from…

Computation and Language · Computer Science 2024-04-23 Narek Maloyan , Ekansh Verma , Bulat Nutfullin , Bislan Ashinov