English
Related papers

Related papers: Detecting Backdoor Poisoning Attacks on Deep Neura…

200 papers

Clustering algorithms have been increasingly adopted in security applications to spot dangerous or illicit activities. However, they have not been originally devised to deal with deliberate attack attempts that may aim to subvert the…

Machine Learning · Computer Science 2018-11-27 Battista Biggio , Ignazio Pillai , Samuel Rota Bulò , Davide Ariu , Marcello Pelillo , Fabio Roli

Machine learning has become an important component for many systems and applications including computer vision, spam filtering, malware and network intrusion detection, among others. Despite the capabilities of machine learning algorithms…

Machine Learning · Statistics 2018-02-14 Andrea Paudice , Luis Muñoz-González , Andras Gyorgy , Emil C. Lupu

We investigate security concerns of the emergent instruction tuning paradigm, that models are trained on crowdsourced datasets with task instructions to achieve superior performance. Our studies demonstrate that an attacker can inject…

Computation and Language · Computer Science 2024-04-04 Jiashu Xu , Mingyu Derek Ma , Fei Wang , Chaowei Xiao , Muhao Chen

Machine learning algorithms have been widely used in intrusion detection systems, including Multi-layer Perceptron (MLP). In this study, we proposed a two-stage model that combines the Birch clustering algorithm and MLP classifier to…

Cryptography and Security · Computer Science 2022-11-01 Yuhua Yin , Julian Jang-Jaccard , Fariza Sabrina , Jin Kwak

Backdoor (Trojan) attacks are emerging threats against deep neural networks (DNN). A DNN being attacked will predict to an attacker-desired target class whenever a test sample from any source class is embedded with a backdoor pattern; while…

Cryptography and Security · Computer Science 2021-12-08 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Deep Neural Networks (DNNs) are susceptible to backdoor attacks, where adversaries poison training data to implant backdoor into the victim model. Current backdoor defenses on poisoned data often suffer from high computational costs or low…

Multimedia · Computer Science 2025-07-28 Binyan Xu , Fan Yang , Xilin Dai , Di Tang , Kehuan Zhang

Backdoor unlearning aims to remove backdoor-related information while preserving the model's original functionality. However, existing unlearning methods mainly focus on recovering trigger patterns but fail to restore the correct semantic…

Cryptography and Security · Computer Science 2025-07-15 Yanghao Su , Jie Zhang , Yiming Li , Tianwei Zhang , Qing Guo , Weiming Zhang , Nenghai Yu , Nils Lukas , Wenbo Zhou

Deep neural networks (DNNs) offer a means of addressing the challenging task of clustering high-dimensional data. DNNs can extract useful features, and so produce a lower dimensional representation, which is more amenable to clustering…

Machine Learning · Computer Science 2021-07-23 Louis Mahon , Thomas Lukasiewicz

Deep learning (DL) models for natural language-to-code generation have become integral to modern software development pipelines. However, their heavy reliance on large amounts of data, often collected from unsanitized online sources,…

Cryptography and Security · Computer Science 2025-09-01 Cristina Improta

Discovering new intents is a crucial task in dialogue systems. Most existing methods are limited in transferring the prior knowledge from known intents to new intents. They also have difficulties in providing high-quality supervised signals…

Computation and Language · Computer Science 2023-04-24 Hanlei Zhang , Hua Xu , Ting-En Lin , Rui Lyu

Machine learning systems are deployed in critical settings, but they might fail in unexpected ways, impacting the accuracy of their predictions. Poisoning attacks against machine learning induce adversarial modification of data used by a…

Machine Learning · Computer Science 2021-05-13 Matthew Jagielski , Giorgio Severi , Niklas Pousette Harger , Alina Oprea

Deep neural networks for image classification are well-known to be vulnerable to adversarial attacks. One such attack that has garnered recent attention is the adversarial backdoor attack, which has demonstrated the capability to perform…

Cryptography and Security · Computer Science 2022-06-09 Glenn Dawson , Muhammad Umer , Robi Polikar

Training deep neural networks (DNNs) usually requires massive training data and computational resources. Users who cannot afford this may prefer to outsource training to a third party or resort to publicly available pre-trained models.…

Cryptography and Security · Computer Science 2023-02-27 Najeeb Moharram Jebreel , Josep Domingo-Ferrer , Yiming Li

It has been proved that deep neural networks are facing a new threat called backdoor attacks, where the adversary can inject backdoors into the neural network model through poisoning the training dataset. When the input containing some…

Cryptography and Security · Computer Science 2021-03-16 Chuanshuai Chen , Jiazhu Dai

Poisoning attacks, in which an attacker adversarially manipulates the training dataset of a machine learning (ML) model, pose a significant threat to ML security. Beta Poisoning is a recently proposed poisoning attack that disrupts model…

Cryptography and Security · Computer Science 2025-08-05 Nilufer Gulciftci , M. Emre Gursoy

In big data era, machine learning is one of fundamental techniques in intrusion detection systems (IDSs). However, practical IDSs generally update their decision module by feeding new data then retraining learning models in a periodical…

Machine Learning · Computer Science 2018-03-13 Pan Li , Qiang Liu , Wentao Zhao , Dongxu Wang , Siqi Wang

Deep image classification models trained on vast amounts of web-scraped data are susceptible to data poisoning - a mechanism for backdooring models. A small number of poisoned samples seen during training can severely undermine a model's…

Cryptography and Security · Computer Science 2023-06-30 Nils Lukas , Florian Kerschbaum

Large amounts of incremental learning algorithms have been proposed to alleviate the catastrophic forgetting issue arises while dealing with sequential data on a time series. However, the adversarial robustness of incremental learners has…

Cryptography and Security · Computer Science 2023-05-31 Yiqi Zhong , Xianming Liu , Deming Zhai , Junjun Jiang , Xiangyang Ji

In-context learning, a paradigm bridging the gap between pre-training and fine-tuning, has demonstrated high efficacy in several NLP tasks, especially in few-shot settings. Despite being widely applied, in-context learning is vulnerable to…

Computation and Language · Computer Science 2024-10-10 Shuai Zhao , Meihuizi Jia , Luu Anh Tuan , Fengjun Pan , Jinming Wen

In a backdoor attack, an attacker injects corrupted examples into the training set. The goal of the attacker is to cause the final trained model to predict the attacker's desired target label when a predefined trigger is added to test…

Machine Learning · Computer Science 2022-10-13 Jonathan Hayase , Sewoong Oh