English
Related papers

Related papers: Activation Gradient based Poisoned Sample Detectio…

200 papers

As the capacity of deep neural networks (DNNs) increases, their need for huge amounts of data significantly grows. A common practice is to outsource the training process or collect more data over the Internet, which introduces the risks of…

Machine Learning · Computer Science 2023-11-14 Soroush Hashemifar , Saeed Parsa , Morteza Zakeri-Nasrabadi

Poisoning attacks can disproportionately influence model behaviour by making small changes to the training corpus. While defences against specific poisoning attacks do exist, they in general do not provide any guarantees, leaving them…

Machine Learning · Computer Science 2024-03-19 Shijie Liu , Andrew C. Cullen , Paul Montague , Sarah M. Erfani , Benjamin I. P. Rubinstein

Backdoor attacks pose an increasingly severe security threat to Deep Neural Networks (DNNs) during their development stage. In response, backdoor sample purification has emerged as a promising defense mechanism, aiming to eliminate backdoor…

Cryptography and Security · Computer Science 2024-05-21 Biao Yi , Sishuo Chen , Yiming Li , Tong Li , Baolei Zhang , Zheli Liu

Unsupervised Domain Adaptation (UDA) aims to generalize the knowledge learned from a well-labeled source domain to an unlabeled target domain. Recently, adversarial domain adaptation with two distinct classifiers (bi-classifier) has been…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Zhekai Du , Jingjing Li , Hongzu Su , Lei Zhu , Ke Lu

Consistency models are a new class of models that generate images by directly mapping noise to data, allowing for one-step generation and significantly accelerating the sampling process. However, their robustness against adversarial attacks…

Cryptography and Security · Computer Science 2025-02-18 Chengen Wang , Murat Kantarcioglu

Generalized Category Discovery (GCD) leverages labeled data to categorize unlabeled samples from known or unknown classes. Most previous methods jointly optimize supervised and unsupervised objectives and achieve promising results. However,…

Machine Learning · Computer Science 2026-04-17 Haiyang Zheng , Nan Pu , Yaqi Cai , Teng Long , Wenjing Li , Nicu Sebe , Zhun Zhong

Despite tremendous success of modern neural networks, they are known to be overconfident even when the model encounters inputs with unfamiliar conditions. Detecting such inputs is vital to preventing models from making naive predictions…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Jinsol Lee , Ghassan AlRegib

Although existing backdoor defenses have gained success in mitigating backdoor attacks, they still face substantial challenges. In particular, most of them rely on large amounts of clean data to weaken the backdoor mapping but generally…

Cryptography and Security · Computer Science 2026-01-15 Zhengxian Wu , Juan Wen , Wanli Peng , Yinghan Zhou , Changtong dou , Yiming Xue

Recently, a backdoor data poisoning attack was proposed, which adds mislabeled examples to the training set, with an embedded backdoor pattern, aiming to have the classifier learn to classify to a target class whenever the backdoor pattern…

Machine Learning · Computer Science 2023-07-17 Zhen Xiang , David J. Miller , Hang Wang , George Kesidis

Recently, it has been shown that deep learning models are vulnerable to Trojan attacks, where an attacker can install a backdoor during training time to make the resultant model misidentify samples contaminated with a small trigger patch.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Haripriya Harikumar , Vuong Le , Santu Rana , Sourangshu Bhattacharya , Sunil Gupta , Svetha Venkatesh

Backdoor data detection is traditionally studied in an end-to-end supervised learning (SL) setting. However, recent years have seen the proliferating adoption of self-supervised learning (SSL) and transfer learning (TL), due to their lesser…

Machine Learning · Computer Science 2023-08-08 Minzhou Pan , Yi Zeng , Lingjuan Lyu , Xue Lin , Ruoxi Jia

There have been several efforts in backdoor attacks, but these have primarily focused on the closed-set performance of classifiers (i.e., classification). This has left a gap in addressing the threat to classifiers' open-set performance,…

Machine Learning · Computer Science 2024-12-09 ZeinabSadat Taghavi , Hossein Mirzaei

While deep neural networks have shown impressive performance in many tasks, they are fragile to carefully designed adversarial attacks. We propose a novel adversarial training-based model by Attention Guided Knowledge Distillation and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Hong Wang , Yuefan Deng , Shinjae Yoo , Haibin Ling , Yuewei Lin

Backdoor data poisoning attacks have recently been demonstrated in computer vision research as a potential safety risk for machine learning (ML) systems. Traditional data poisoning attacks manipulate training data to induce unreliability of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Loc Truong , Chace Jones , Brian Hutchinson , Andrew August , Brenda Praggastis , Robert Jasper , Nicole Nichols , Aaron Tuor

Generalized Category Discovery (GCD) utilizes labeled samples of known classes to discover novel classes in unlabeled samples. Existing methods show effective performance on artificial datasets with balanced distributions. However,…

Artificial Intelligence · Computer Science 2025-07-31 Cuong Manh Hoang

Large language models require continuous adaptation to new tasks while preserving safety alignment. However, fine-tuning on even benign data often compromises safety behaviors, including refusal of harmful requests, truthfulness, and…

Machine Learning · Computer Science 2026-04-21 Thong Bach , Dung Nguyen , Thao Minh Le , Truyen Tran

Semi-supervised learning methods can train high-accuracy machine learning models with a fraction of the labeled training samples required for traditional supervised learning. Such methods do not typically involve close review of the…

Machine Learning · Computer Science 2022-12-07 Marissa Connor , Vincent Emanuele

Backdoor attacks remain significant security threats to generative large language models (LLMs). Since generative LLMs output sequences of high-dimensional token logits instead of low-dimensional classification logits, most existing…

Computation and Language · Computer Science 2024-12-04 Zongru Wu , Pengzhou Cheng , Lingyong Fang , Zhuosheng Zhang , Gongshen Liu

Backdoor (Trojan) attacks are emerging threats against deep neural networks (DNN). A DNN being attacked will predict to an attacker-desired target class whenever a test sample from any source class is embedded with a backdoor pattern; while…

Cryptography and Security · Computer Science 2021-12-08 Xi Li , Zhen Xiang , David J. Miller , George Kesidis

Backdoor attacks pose a significant security vulnerability for deep neural networks (DNNs), enabling them to operate normally on clean inputs but manipulate predictions when specific trigger patterns occur. Currently, post-training backdoor…

Cryptography and Security · Computer Science 2024-10-22 Yanghao Su , Jie Zhang , Ting Xu , Tianwei Zhang , Weiming Zhang , Nenghai Yu