English
Related papers

Related papers: Handcrafted Backdoors in Deep Neural Networks

200 papers

Recent work has proposed the concept of backdoor attacks on deep neural networks (DNNs), where misbehaviors are hidden inside "normal" models, only to be triggered by very specific inputs. In practice, however, these attacks are difficult…

Machine Learning · Computer Science 2019-05-28 Yuanshun Yao , Huiying Li , Haitao Zheng , Ben Y. Zhao

Due to the increasing computational demand of Deep Neural Networks (DNNs), companies and organizations have begun to outsource the training process. However, the externally trained DNNs can potentially be backdoor attacked. It is crucial to…

Machine Learning · Computer Science 2023-07-04 Lu Pang , Tao Sun , Haibin Ling , Chao Chen

Deep neural networks have been shown to be vulnerable to backdoor attacks, which could be easily introduced to the training set prior to model training. Recent work has focused on investigating backdoor attacks on natural images or toy…

Cryptography and Security · Computer Science 2021-01-05 Munachiso Nwadike , Takumi Miyawaki , Esha Sarkar , Michail Maniatakos , Farah Shamout

The current state-of-the-art backdoor attacks against Reinforcement Learning (RL) rely upon unrealistically permissive access models, that assume the attacker can read (or even write) the victim's policy parameters, observations, or…

Machine Learning · Computer Science 2025-05-27 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah Erfani , Benjamin I. P. Rubinstein

Backdoor attack intends to inject hidden backdoor into the deep neural networks (DNNs), such that the prediction of the infected model will be maliciously changed if the hidden backdoor is activated by the attacker-defined trigger, while it…

Cryptography and Security · Computer Science 2021-02-02 Yiming Li , Tongqing Zhai , Baoyuan Wu , Yong Jiang , Zhifeng Li , Shutao Xia

Adversarial machine learning has exposed several security hazards of neural models and has become an important research topic in recent times. Thus far, the concept of an "adversarial perturbation" has exclusively been used with reference…

Machine Learning · Computer Science 2020-09-22 Siddhant Garg , Adarsh Kumar , Vibhor Goel , Yingyu Liang

It is common practice to outsource the training of machine learning models to cloud providers. Clients who do so gain from the cloud's economies of scale, but implicitly assume trust: the server should not deviate from the client's training…

Cryptography and Security · Computer Science 2025-04-02 Hengrui Jia , Sierra Wyllie , Akram Bin Sediq , Ahmed Ibrahim , Nicolas Papernot

DNNs' demand for massive data forces practitioners to collect data from the Internet without careful check due to the unacceptable cost, which brings potential risks of backdoor attacks. A backdoored model always predicts a target class in…

Machine Learning · Computer Science 2022-02-23 Yinghua Gao , Dongxian Wu , Jingfeng Zhang , Guanhao Gan , Shu-Tao Xia , Gang Niu , Masashi Sugiyama

Deep neural networks (DNNs) are vulnerable to backdoor attacks. The backdoor adversaries intend to maliciously control the predictions of attacked DNNs by injecting hidden backdoors that can be activated by adversary-specified trigger…

Cryptography and Security · Computer Science 2023-03-07 Tong Xu , Yiming Li , Yong Jiang , Shu-Tao Xia

Backdoor attacks pose a significant threat to neural networks, enabling adversaries to manipulate model outputs on specific inputs, often with devastating consequences, especially in critical applications. While backdoor attacks have been…

Machine Learning · Computer Science 2025-07-30 Zhen Guo , Abhinav Kumar , Reza Tourani

One major goal of the AI security community is to securely and reliably produce and deploy deep learning models for real-world applications. To this end, data poisoning based backdoor attacks on deep neural networks (DNNs) in the production…

Cryptography and Security · Computer Science 2022-05-30 Xiangyu Qi , Tinghao Xie , Ruizhe Pan , Jifeng Zhu , Yong Yang , Kai Bu

Recent works have demonstrated that deep learning models are vulnerable to backdoor poisoning attacks, where these attacks instill spurious correlations to external trigger patterns or objects (e.g., stickers, sunglasses, etc.). We find…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Tong Wu , Tianhao Wang , Vikash Sehwag , Saeed Mahloujifar , Prateek Mittal

Machine learning backdoors have the property that the machine learning model should work as expected on normal inputs, but when the input contains a specific $\textit{trigger}$, it behaves as the attacker desires. Detecting such triggers…

Cryptography and Security · Computer Science 2026-03-12 Eirik Høyheim , Magnus Wiik Eckhoff , Gudmund Grov , Robert Flood , David Aspinall

Modern neural networks are often trained on massive datasets that are web scraped with minimal human inspection. As a result of this insecure curation pipeline, an adversary can poison or backdoor the resulting model by uploading malicious…

Deep neural networks (DNNs) are vulnerable to the \emph{backdoor attack}, which intends to embed hidden backdoors in DNNs by poisoning training data. The attacked model behaves normally on benign samples, whereas its prediction will be…

Cryptography and Security · Computer Science 2021-04-06 Yiming Li , Yanjie Li , Yalei Lv , Yong Jiang , Shu-Tao Xia

Machine learning is vulnerable to a wide variety of attacks. It is now well understood that by changing the underlying data distribution, an adversary can poison the model trained with it or introduce backdoors. In this paper we present a…

Machine Learning · Computer Science 2021-06-08 Ilia Shumailov , Zakhar Shumaylov , Dmitry Kazhdan , Yiren Zhao , Nicolas Papernot , Murat A. Erdogdu , Ross Anderson

As ML models become increasingly complex and integral to high-stakes domains such as finance and healthcare, they also become more susceptible to sophisticated adversarial attacks. We investigate the threat posed by undetectable backdoors,…

Machine Learning · Computer Science 2024-09-10 Alkis Kalavasis , Amin Karbasi , Argyris Oikonomou , Katerina Sotiraki , Grigoris Velegkas , Manolis Zampetakis

Deep Neural Networks (DNNs) are known to be vulnerable to backdoor attacks. In Natural Language Processing (NLP), DNNs are often backdoored during the fine-tuning process of a large-scale Pre-trained Language Model (PLM) with poisoned…

Computation and Language · Computer Science 2022-10-19 Zhiyuan Zhang , Lingjuan Lyu , Xingjun Ma , Chenguang Wang , Xu Sun

Training deep neural networks (DNNs) usually requires massive training data and computational resources. Users who cannot afford this may prefer to outsource training to a third party or resort to publicly available pre-trained models.…

Cryptography and Security · Computer Science 2023-02-27 Najeeb Moharram Jebreel , Josep Domingo-Ferrer , Yiming Li

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

Computation and Language · Computer Science 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He
‹ Prev 1 3 4 5 6 7 10 Next ›