中文
相关论文

相关论文: NT-ML: Backdoor Defense via Non-target Label Train…

200 篇论文

We investigate security concerns of the emergent instruction tuning paradigm, that models are trained on crowdsourced datasets with task instructions to achieve superior performance. Our studies demonstrate that an attacker can inject…

计算与语言 · 计算机科学 2024-04-04 Jiashu Xu , Mingyu Derek Ma , Fei Wang , Chaowei Xiao , Muhao Chen

Backdoor attacks against CNNs represent a new threat against deep learning systems, due to the possibility of corrupting the training set so to induce an incorrect behaviour at test time. To avoid that the trainer recognises the presence of…

密码学与安全 · 计算机科学 2019-03-01 Mauro Barni , Kassem Kallas , Benedetta Tondi

Federated Learning (FL) enables collaborative training of Deep Learning (DL) models where the data is retained locally. Like DL, FL has severe security weaknesses that the attackers can exploit, e.g., model inversion and backdoor attacks.…

密码学与安全 · 计算机科学 2023-03-01 Gorka Abad , Servio Paguada , Oguzhan Ersoy , Stjepan Picek , Víctor Julio Ramírez-Durán , Aitor Urbieta

Pre-trained general-purpose language models have been a dominating component in enabling real-world natural language processing (NLP) applications. However, a pre-trained model with backdoor can be a severe threat to the applications. Most…

计算与语言 · 计算机科学 2021-11-02 Lujia Shen , Shouling Ji , Xuhong Zhang , Jinfeng Li , Jing Chen , Jie Shi , Chengfang Fang , Jianwei Yin , Ting Wang

Backdoor attacks threaten Deep Neural Networks (DNNs). Towards stealthiness, researchers propose clean-label backdoor attacks, which require the adversaries not to alter the labels of the poisoned training datasets. Clean-label settings…

密码学与安全 · 计算机科学 2022-06-13 Nan Luo , Yuanzhang Li , Yajie Wang , Shangbo Wu , Yu-an Tan , Quanxin Zhang

Backdoor attacks become a significant security concern for deep neural networks in recent years. An image classification model can be compromised if malicious backdoors are injected into it. This corruption will cause the model to function…

密码学与安全 · 计算机科学 2024-03-13 Hongwei Zhang , Xiaoyin Xu , Dongsheng An , Xianfeng Gu , Min Zhang

Recent work has proposed the concept of backdoor attacks on deep neural networks (DNNs), where misbehaviors are hidden inside "normal" models, only to be triggered by very specific inputs. In practice, however, these attacks are difficult…

机器学习 · 计算机科学 2019-05-28 Yuanshun Yao , Huiying Li , Haitao Zheng , Ben Y. Zhao

The backdoor or Trojan attack is a severe threat to deep neural networks (DNNs). Researchers find that DNNs trained on benign data and settings can also learn backdoor behaviors, which is known as the natural backdoor. Existing works on…

机器学习 · 计算机科学 2022-10-28 Zhenting Wang , Hailun Ding , Juan Zhai , Shiqing Ma

Web-scraped datasets are vulnerable to data poisoning, which can be used for backdooring deep image classifiers during training. Since training on large datasets is expensive, a model is trained once and re-used many times. Unlike…

机器学习 · 计算机科学 2024-01-23 Benjamin Schneider , Nils Lukas , Florian Kerschbaum

Deep learning is becoming increasingly popular in real-life applications, especially in natural language processing (NLP). Users often choose training outsourcing or adopt third-party data and models due to data and computation resources…

计算与语言 · 计算机科学 2022-11-23 Xuan Sheng , Zhaoyang Han , Piji Li , Xiangmao Chang

Model Inversion (MI) attacks pose a significant threat to the privacy of Deep Neural Networks by recovering training data distribution from well-trained models. While existing defenses often rely on regularization techniques to reduce…

密码学与安全 · 计算机科学 2024-11-26 Zhen-Ting Liu , Shang-Tse Chen

Pre-trained language models allowed us to process downstream tasks with the help of fine-tuning, which aids the model to achieve fairly high accuracy in various Natural Language Processing (NLP) tasks. Such easily-downloaded language models…

计算与语言 · 计算机科学 2022-11-22 Jaechul Roh , Minhao Cheng , Yajun Fang

Textual backdoor attacks are a kind of practical threat to NLP systems. By injecting a backdoor in the training phase, the adversary could control model predictions via predefined triggers. As various attack and defense models have been…

机器学习 · 计算机科学 2022-11-02 Ganqu Cui , Lifan Yuan , Bingxiang He , Yangyi Chen , Zhiyuan Liu , Maosong Sun

The advent of Large Language Models (LLMs) has marked significant achievements in language processing and reasoning capabilities. Despite their advancements, LLMs face vulnerabilities to data poisoning attacks, where the adversary inserts…

Backdoor attack is a major threat to deep learning systems in safety-critical scenarios, which aims to trigger misbehavior of neural network models under attacker-controlled conditions. However, most backdoor attacks have to modify the…

机器学习 · 计算机科学 2023-08-24 Yizhen Yuan , Rui Kong , Shenghao Xie , Yuanchun Li , Yunxin Liu

Backdoor attacks change a small portion of training data by introducing hand-crafted triggers and rewiring the corresponding labels towards a desired target class. Training on such data injects a backdoor which causes malicious inference in…

机器学习 · 计算机科学 2024-09-05 Ivan Sabolić , Ivan Grubišić , Siniša Šegvić

Multimodal contrastive learning uses various data modalities to create high-quality features, but its reliance on extensive data sources on the Internet makes it vulnerable to backdoor attacks. These attacks insert malicious behaviors…

密码学与安全 · 计算机科学 2024-10-01 Kuanrong Liu , Siyuan Liang , Jiawei Liang , Pengwen Dai , Xiaochun Cao

Machine unlearning has emerged as a key component in ensuring ``Right to be Forgotten'', enabling the removal of specific data points from trained models. However, even when the unlearning is performed without poisoning the forget-set…

密码学与安全 · 计算机科学 2025-06-17 Marco Arazzi , Antonino Nocera , Vinod P

As machine learning systems grow in scale, so do their training data requirements, forcing practitioners to automate and outsource the curation of training data in order to achieve state-of-the-art performance. The absence of trustworthy…

The security threat of backdoor attacks is a central concern for deep neural networks (DNNs). Recently, without poisoned data, unlearning models with clean data and then learning a pruning mask have contributed to backdoor defense.…

密码学与安全 · 计算机科学 2024-05-31 Weilin Lin , Li Liu , Shaokui Wei , Jianze Li , Hui Xiong