English
Related papers

Related papers: Trojan Cleansing with Neural Collapse

200 papers

Deep neural networks (DNNs) provide excellent performance across a wide range of classification tasks, but their training requires high computational resources and is often outsourced to third parties. Recent work has shown that outsourced…

Cryptography and Security · Computer Science 2018-06-01 Kang Liu , Brendan Dolan-Gavitt , Siddharth Garg

Backdoor attacks impose a new threat in Deep Neural Networks (DNNs), where a backdoor is inserted into the neural network by poisoning the training dataset, misclassifying inputs that contain the adversary trigger. The major challenge for…

Machine Learning · Computer Science 2024-09-26 Yue Wang , Wenqing Li , Esha Sarkar , Muhammad Shafique , Michail Maniatakos , Saif Eddin Jabari

We propose a novel approach towards adversarial attacks on neural networks (NN), focusing on tampering the data used for training instead of generating attacks on trained models. Our network-agnostic method creates a backdoor during…

Federated learning (FL) systems allow decentralized data-owning clients to jointly train a global model through uploading their locally trained updates to a centralized server. The property of decentralization enables adversaries to craft…

Cryptography and Security · Computer Science 2025-04-23 Yanbo Dai , Songze Li , Zihan Gan , Xueluan Gong

Deep Reinforcement Learning (DRL) systems are increasingly used in safety-critical applications, yet their security remains severely underexplored. This work investigates backdoor attacks, which implant hidden triggers that cause malicious…

Machine Learning · Computer Science 2025-07-08 Sanyam Vyas , Alberto Caron , Chris Hicks , Pete Burnap , Vasilios Mavroudis

While poisoning attacks on machine learning models have been extensively studied, the mechanisms by which adversaries can distribute poisoned models at scale remain largely unexplored. In this paper, we shed light on how model leaderboards…

Machine Learning · Computer Science 2025-07-15 Anshuman Suri , Harsh Chaudhari , Yuefeng Peng , Ali Naseh , Amir Houmansadr , Alina Oprea

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

Machine Learning · Computer Science 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

The security of deep neural networks (DNNs) has attracted increasing attention due to their widespread use in various applications. Recently, the deployed DNNs have been demonstrated to be vulnerable to Trojan attacks, which manipulate…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Jiawang Bai , Kuofeng Gao , Dihong Gong , Shu-Tao Xia , Zhifeng Li , Wei Liu

Deep neural networks are susceptible to \emph{adversarial} attacks. In computer vision, well-crafted perturbations to images can cause neural networks to make mistakes such as confusing a cat with a computer. Previous adversarial attacks…

Machine Learning · Computer Science 2019-09-12 Gamaleldin F. Elsayed , Ian Goodfellow , Jascha Sohl-Dickstein

Backdoor attack is a powerful attack algorithm to deep learning model. Recently, GNN's vulnerability to backdoor attack has been proved especially on graph classification task. In this paper, we propose the first backdoor detection and…

Artificial Intelligence · Computer Science 2022-09-08 Bingchen Jiang , Zhao Li

Graph neural networks (GNNs) are widely used for learning from graph-structured data in domains such as social networks, recommender systems, and financial platforms. To comply with privacy regulations like the GDPR, CCPA, and PIPEDA,…

Machine Learning · Computer Science 2026-03-20 Jiahao Zhang , Yilong Wang , Suhang Wang

Backdoor attack against deep neural networks is currently being profoundly investigated due to its severe security consequences. Current state-of-the-art backdoor attacks require the adversary to modify the input, usually by adding a…

Cryptography and Security · Computer Science 2020-10-09 Ahmed Salem , Michael Backes , Yang Zhang

Deep neural networks (DNNs) at convergence consistently represent the training data in the last layer via a highly symmetric geometric structure referred to as neural collapse. This empirical evidence has spurred a line of theoretical…

Machine Learning · Computer Science 2024-10-08 Arthur Jacot , Peter Súkeník , Zihan Wang , Marco Mondelli

As neural networks become the tool of choice to solve an increasing variety of problems in our society, adversarial attacks become critical. The possibility of generating data instances deliberately designed to fool a network's analysis can…

Machine Learning · Computer Science 2021-03-19 Gabriel D. Cantareira , Rodrigo F. Mello , Fernando V. Paulovich

Backdoor attacks embed malicious behaviors into Large Language Models (LLMs), enabling adversaries to trigger harmful outputs or bypass safety controls. However, the persistence of the implanted backdoors under user-driven post-deployment…

Cryptography and Security · Computer Science 2025-12-18 Jing Cui , Yufei Han , Jianbin Jiao , Junge Zhang

Neural networks are often trained on proprietary datasets, making them attractive attack targets. We present a novel dataset extraction method leveraging an innovative training time backdoor attack, allowing a malicious federated learning…

Cryptography and Security · Computer Science 2025-12-19 Eden Luzon , Guy Amit , Roy Weiss , Torsten Kraub , Alexandra Dmitrienko , Yisroel Mirsky

Machine learning models in the wild have been shown to be vulnerable to Trojan attacks during training. Although many detection mechanisms have been proposed, strong adaptive attackers have been shown to be effective against them. In this…

Machine Learning · Computer Science 2022-07-14 Dinuka Sahabandu , Arezoo Rajabi , Luyao Niu , Bo Li , Bhaskar Ramasubramanian , Radha Poovendran

Data poisoning is an attack on machine learning models wherein the attacker adds examples to the training set to manipulate the behavior of the model at test time. This paper explores poisoning attacks on neural nets. The proposed attacks…

Machine Learning · Computer Science 2018-11-13 Ali Shafahi , W. Ronny Huang , Mahyar Najibi , Octavian Suciu , Christoph Studer , Tudor Dumitras , Tom Goldstein

With the rapid growth of the number of devices on the Internet, malware poses a threat not only to the affected devices but also their ability to use said devices to launch attacks on the Internet ecosystem. Rapid malware classification is…

Cryptography and Security · Computer Science 2021-07-30 Hikmat Farhat , Veronica Rammouz

Intuitively, a backdoor attack against Deep Neural Networks (DNNs) is to inject hidden malicious behaviors into DNNs such that the backdoor model behaves legitimately for benign inputs, yet invokes a predefined malicious behavior when its…

Cryptography and Security · Computer Science 2021-02-09 Shaofeng Li , Shiqing Ma , Minhui Xue , Benjamin Zi Hao Zhao