English
Related papers

Related papers: Shortcuts Everywhere and Nowhere: Exploring Multi-…

200 papers

Pre-trained models (PTMs) have been widely used in various downstream tasks. The parameters of PTMs are distributed on the Internet and may suffer backdoor attacks. In this work, we demonstrate the universal vulnerability of PTMs, where…

Computation and Language · Computer Science 2023-10-23 Zhengyan Zhang , Guangxuan Xiao , Yongwei Li , Tian Lv , Fanchao Qi , Zhiyuan Liu , Yasheng Wang , Xin Jiang , Maosong Sun

As an emerging approach to explore the vulnerability of deep neural networks (DNNs), backdoor learning has attracted increasing interest in recent years, and many seminal backdoor attack and defense algorithms are being developed…

Machine Learning · Computer Science 2024-07-30 Baoyuan Wu , Hongrui Chen , Mingda Zhang , Zihao Zhu , Shaokui Wei , Danni Yuan , Mingli Zhu , Ruotong Wang , Li Liu , Chao Shen

Machine learning (ML) models trained on data from potentially untrusted sources are vulnerable to poisoning. A small, maliciously crafted subset of the training inputs can cause the model to learn a "backdoor" task (e.g., misclassify inputs…

Cryptography and Security · Computer Science 2023-12-20 Eugene Bagdasaryan , Vitaly Shmatikov

Graph Neural Networks (GNNs) have achieved promising results in various tasks such as node classification and graph classification. Recent studies find that GNNs are vulnerable to adversarial attacks. However, effective backdoor attacks on…

Cryptography and Security · Computer Science 2023-03-03 Enyan Dai , Minhua Lin , Xiang Zhang , Suhang Wang

Backdoor attacks are commonly executed by contaminating training data, such that a trigger can activate predetermined harmful effects during the test phase. In this work, we present AnyDoor, a test-time backdoor attack against multimodal…

Computation and Language · Computer Science 2024-02-14 Dong Lu , Tianyu Pang , Chao Du , Qian Liu , Xianjun Yang , Min Lin

The vulnerabilities to backdoor attacks have recently threatened the trustworthiness of machine learning models in practical applications. Conventional wisdom suggests that not everyone can be an attacker since the process of designing the…

Cryptography and Security · Computer Science 2023-09-06 Sze Jue Yang , Quang Nguyen , Chee Seng Chan , Khoa D. Doan

Recent studies have revealed that deep neural networks (DNNs) are vulnerable to backdoor attacks, where attackers embed hidden backdoors in the DNN model by poisoning a few training samples. The attacked model behaves normally on benign…

Cryptography and Security · Computer Science 2022-02-09 Kunzhe Huang , Yiming Li , Baoyuan Wu , Zhan Qin , Kui Ren

Recent studies have revealed that GNNs are highly susceptible to multiple adversarial attacks. Among these, graph backdoor attacks pose one of the most prominent threats, where attackers cause models to misclassify by learning the…

Cryptography and Security · Computer Science 2024-10-21 Hao Sui , Bing Chen , Jiale Zhang , Chengcheng Zhu , Di Wu , Qinghua Lu , Guodong Long

Code LLMs are increasingly employed in software development. However, studies have shown that they are vulnerable to backdoor attacks: when a trigger (a specific input pattern) appears in the input, the backdoor will be activated and cause…

Cryptography and Security · Computer Science 2025-10-07 Chenyu Wang , Zhou Yang , Yaniv Harel , David Lo

Deep neural networks (DNNs) have gain its popularity in various scenarios in recent years. However, its excellent ability of fitting complex functions also makes it vulnerable to backdoor attacks. Specifically, a backdoor can remain hidden…

Cryptography and Security · Computer Science 2023-05-18 Xinrui Liu , Yu-an Tan , Yajie Wang , Kefan Qiu , Yuanzhang Li

The increasing demand for customized Large Language Models (LLMs) has led to the development of solutions like GPTs. These solutions facilitate tailored LLM creation via natural language prompts without coding. However, the trustworthiness…

Cryptography and Security · Computer Science 2024-05-29 Rui Zhang , Hongwei Li , Rui Wen , Wenbo Jiang , Yuan Zhang , Michael Backes , Yun Shen , Yang Zhang

Backdoor attacks are emerging threats to deep neural networks, which typically embed malicious behaviors into a victim model by injecting poisoned samples. Adversaries can activate the injected backdoor during inference by presenting the…

Cryptography and Security · Computer Science 2025-12-05 Bingyin Zhao , Yingjie Lao

Backdoor attacks on reinforcement learning implant a backdoor in a victim agent's policy. Once the victim observes the trigger signal, it will switch to the abnormal mode and fail its task. Most of the attacks assume the adversary can…

Multiagent Systems · Computer Science 2022-11-22 Shuo Chen , Yue Qiu , Jie Zhang

Deep speech classification tasks, including keyword spotting and speaker verification, are vital in speech-based human-computer interaction. Recently, the security of these technologies has been revealed to be susceptible to backdoor…

Sound · Computer Science 2025-06-11 Wenhan Yao , Fen Xiao , Xiarun Chen , Jia Liu , YongQiang He , Weiping Wen

As the curation of data for machine learning becomes increasingly automated, dataset tampering is a mounting threat. Backdoor attackers tamper with training data to embed a vulnerability in models that are trained on that data. This…

Machine Learning · Computer Science 2022-10-14 Hossein Souri , Liam Fowl , Rama Chellappa , Micah Goldblum , Tom Goldstein

Currently, sample-specific backdoor attacks (SSBAs) are the most advanced and malicious methods since they can easily circumvent most of the current backdoor defenses. In this paper, we reveal that SSBAs are not sufficiently stealthy due to…

Cryptography and Security · Computer Science 2025-03-17 Mingyan Zhu , Yiming Li , Junfeng Guo , Tao Wei , Shu-Tao Xia , Zhan Qin

Backdoor attacks compromise the integrity and reliability of machine learning models by embedding a hidden trigger during the training process, which can later be activated to cause unintended misbehavior. We propose a novel backdoor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Felix Hsieh , Huy H. Nguyen , AprilPyone MaungMaung , Dmitrii Usynin , Isao Echizen

Backdoors pose a serious threat to machine learning, as they can compromise the integrity of security-critical systems, such as self-driving cars. While different defenses have been proposed to address this threat, they all rely on the…

Cryptography and Security · Computer Science 2025-02-04 Alexander Warnecke , Julian Speith , Jan-Niklas Möller , Konrad Rieck , Christof Paar

Federated Learning (FL), a privacy-preserving decentralized machine learning framework, has been shown to be vulnerable to backdoor attacks. Current research primarily focuses on the Single-Label Backdoor Attack (SBA), wherein adversaries…

Cryptography and Security · Computer Science 2025-03-25 Ye Li , Yanchao Zhao , Chengcheng Zhu , Jiale Zhang

Recently, a special type of data poisoning (DP) attack targeting Deep Neural Network (DNN) classifiers, known as a backdoor, was proposed. These attacks do not seek to degrade classification accuracy, but rather to have the classifier learn…

Machine Learning · Computer Science 2020-08-20 Zhen Xiang , David J. Miller , George Kesidis