中文
相关论文

相关论文: NCL: Textual Backdoor Defense Using Noise-augmente…

200 篇论文

Existing studies in backdoor defense have predominantly focused on the training phase, overlooking the critical aspect of testing time defense. This gap becomes pronounced in the context of LLMs deployed as Web Services, which typically…

计算与语言 · 计算机科学 2025-02-13 Wenjie Mo , Jiashu Xu , Qin Liu , Jiongxiao Wang , Jun Yan , Hadi Askari , Chaowei Xiao , Muhao Chen

This paper proposes a new defense against neural network backdooring attacks that are maliciously trained to mispredict in the presence of attacker-chosen triggers. Our defense is based on the intuition that the feature extraction layers of…

机器学习 · 计算机科学 2023-02-24 Hao Fu , Akshaj Kumar Veldanda , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Deep learning (DL) offers potential improvements throughout the CAD tool-flow, one promising application being lithographic hotspot detection. However, DL techniques have been shown to be especially vulnerable to inference and training time…

机器学习 · 计算机科学 2020-04-28 Kang Liu , Benjamin Tan , Gaurav Rajavendra Reddy , Siddharth Garg , Yiorgos Makris , Ramesh Karri

Backdoor data poisoning is an emerging form of adversarial attack usually against deep neural network image classifiers. The attacker poisons the training set with a relatively small set of images from one (or several) source class(es),…

机器学习 · 计算机科学 2020-10-16 Zhen Xiang , David J. Miller , George Kesidis

Recently, self-supervised learning (SSL) was shown to be vulnerable to patch-based data poisoning backdoor attacks. It was shown that an adversary can poison a small part of the unlabeled data so that when a victim trains an SSL model on…

计算机视觉与模式识别 · 计算机科学 2023-04-05 Ajinkya Tejankar , Maziar Sanjabi , Qifan Wang , Sinong Wang , Hamed Firooz , Hamed Pirsiavash , Liang Tan

Backdoors can be injected into NLP models to induce misbehavior when the input text contains a specific feature, known as a trigger, which the attacker secretly selects. Unlike fixed words, phrases, or sentences used in the static text…

密码学与安全 · 计算机科学 2024-09-12 Rui Zeng , Xi Chen , Yuwen Pu , Xuhong Zhang , Tianyu Du , Shouling Ji

While machine learning (ML) models are being increasingly trusted to make decisions in different and varying areas, the safety of systems using such models has become an increasing concern. In particular, ML models are often trained on data…

With the burgeoning advancements in the field of natural language processing (NLP), the demand for training data has increased significantly. To save costs, it has become common for users and businesses to outsource the labor-intensive task…

计算与语言 · 计算机科学 2024-08-22 Ziqiang Li , Yueqi Zeng , Pengfei Xia , Lei Liu , Zhangjie Fu , Bin Li

Data-poisoning backdoor attacks are serious security threats to machine learning models, where an adversary can manipulate the training dataset to inject backdoors into models. In this paper, we focus on in-training backdoor defense, aiming…

密码学与安全 · 计算机科学 2024-10-16 Shaokui Wei , Hongyuan Zha , Baoyuan Wu

Self-supervised Contrastive Learning (CL) has been recently shown to be very effective in preventing deep networks from overfitting noisy labels. Despite its empirical success, the theoretical understanding of the effect of contrastive…

机器学习 · 计算机科学 2022-07-06 Yihao Xue , Kyle Whitecross , Baharan Mirzasoleiman

Federated Learning (FL) allows multiple clients to collaboratively train a Neural Network (NN) model on their private data without revealing the data. Recently, several targeted poisoning attacks against FL have been introduced. These…

密码学与安全 · 计算机科学 2022-01-04 Phillip Rieger , Thien Duc Nguyen , Markus Miettinen , Ahmad-Reza Sadeghi

Recent studies have revealed that deep neural networks (DNNs) are vulnerable to backdoor attacks, where attackers embed hidden backdoors in the DNN model by poisoning a few training samples. The attacked model behaves normally on benign…

密码学与安全 · 计算机科学 2022-02-09 Kunzhe Huang , Yiming Li , Baoyuan Wu , Zhan Qin , Kui Ren

Deep learning models are well known to be susceptible to backdoor attack, where the attacker only needs to provide a tampered dataset on which the triggers are injected. Models trained on the dataset will passively implant the backdoor, and…

密码学与安全 · 计算机科学 2024-06-21 Zonghao Ying , Bin Wu

Deep learning models, while achieving state-of-the-art performance on many tasks, are susceptible to adversarial attacks that exploit inherent vulnerabilities in their architectures. Adversarial attacks manipulate the input data with…

计算机视觉与模式识别 · 计算机科学 2023-12-07 Shreyasi Mandal

In-context learning (ICL) has become a powerful, data-efficient paradigm for text classification using large language models. However, its robustness against realistic adversarial threats remains largely unexplored. We introduce ICL-Evader,…

密码学与安全 · 计算机科学 2026-01-30 Ningyuan He , Ronghong Huang , Qianqian Tang , Hongyu Wang , Xianghang Mi , Shanqing Guo

Federated Contrastive Learning (FCL) is an emerging privacy-preserving paradigm in distributed learning for unlabeled data. In FCL, distributed parties collaboratively learn a global encoder with unlabeled data, and the global encoder could…

密码学与安全 · 计算机科学 2023-11-29 Yao Huang , Kongyang Chen , Jiannong Cao , Jiaxing Shen , Shaowei Wang , Yun Peng , Weilong Peng , Kechao Cai

Recent studies have revealed a security threat to natural language processing (NLP) models, called the Backdoor Attack. Victim models can maintain competitive performance on clean samples while behaving abnormally on samples with a specific…

计算与语言 · 计算机科学 2021-03-30 Wenkai Yang , Lei Li , Zhiyuan Zhang , Xuancheng Ren , Xu Sun , Bin He

Contrastive Learning first extracts features from unlabeled data, followed by linear probing with labeled data. Adversarial Contrastive Learning (ACL) integrates Adversarial Training into the first phase to enhance feature robustness…

机器学习 · 计算机科学 2025-10-28 Ngoc N. Tran , Lam Tran , Hoang Phan , Anh Bui , Tung Pham , Toan Tran , Dinh Phung , Trung Le

Recently, backdoor attacks pose a new security threat to the training process of deep neural networks (DNNs). Attackers intend to inject hidden backdoors into DNNs, such that the attacked model performs well on benign samples, whereas its…

密码学与安全 · 计算机科学 2021-08-16 Yuezun Li , Yiming Li , Baoyuan Wu , Longkang Li , Ran He , Siwei Lyu

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…