中文
相关论文

相关论文: Backdoor Learning for NLP: Recent Advances, Challe…

200 篇论文

As large language models (LLMs) continue to evolve, it is critical to assess the security threats and vulnerabilities that may arise both during their training phase and after models have been deployed. This survey seeks to define and…

密码学与安全 · 计算机科学 2025-05-05 Francisco Aguilera-Martínez , Fernando Berzal

Pre-trained language models (PLMs) have demonstrated remarkable performance as few-shot learners. However, their security risks under such settings are largely unexplored. In this work, we conduct a pilot study showing that PLMs as few-shot…

机器学习 · 计算机科学 2023-09-26 Zhaohan Xi , Tianyu Du , Changjiang Li , Ren Pang , Shouling Ji , Jinghui Chen , Fenglong Ma , Ting Wang

Backdoor attacks pose a new threat to NLP models. A standard strategy to construct poisoned data in backdoor attacks is to insert triggers (e.g., rare words) into selected sentences and alter the original label to a target label. This…

计算与语言 · 计算机科学 2022-04-28 Leilei Gan , Jiwei Li , Tianwei Zhang , Xiaoya Li , Yuxian Meng , Fei Wu , Yi Yang , Shangwei Guo , Chun Fan

In a backdoor attack, an adversary inserts maliciously constructed backdoor examples into a training set to make the resulting model vulnerable to manipulation. Defending against such attacks typically involves viewing these inserted…

密码学与安全 · 计算机科学 2023-07-20 Alaa Khaddaj , Guillaume Leclerc , Aleksandar Makelov , Kristian Georgiev , Hadi Salman , Andrew Ilyas , Aleksander Madry

Adversarial attacks and defenses in machine learning and deep neural network have been gaining significant attention due to the rapidly growing applications of deep learning in the Internet and relevant scenarios. This survey provides a…

机器学习 · 计算机科学 2023-03-14 Yulong Wang , Tong Sun , Shenghong Li , Xin Yuan , Wei Ni , Ekram Hossain , H. Vincent Poor

Prompt-based approaches offer a cutting-edge solution to data privacy issues in continual learning, particularly in scenarios involving multiple data suppliers where long-term storage of private user data is prohibited. Despite delivering…

机器学习 · 计算机科学 2024-12-18 Trang Nguyen , Anh Tran , Nhat Ho

Recent studies have shown that deep neural networks (DNNs) are vulnerable to backdoor attacks, where a designed trigger is injected into the dataset, causing erroneous predictions when activated. In this paper, we propose a novel defense…

机器学习 · 计算机科学 2025-08-08 Wenjie Huo , Katinka Wolter

Large Language Models (LLMs) have become a cornerstone in the field of Natural Language Processing (NLP), offering transformative capabilities in understanding and generating human-like text. However, with their rising prominence, the…

Deep neural networks (DNNs) are vulnerable to backdoor attack, which does not affect the network's performance on clean data but would manipulate the network behavior once a trigger pattern is added. Existing defense methods have greatly…

机器学习 · 计算机科学 2025-04-08 Min Liu , Alberto Sangiovanni-Vincentelli , Xiangyu Yue

Deep learning has transformed AI applications but faces critical security challenges, including adversarial attacks, data poisoning, model theft, and privacy leakage. This survey examines these vulnerabilities, detailing their mechanisms…

Federated learning (FL) allows a set of agents to collaboratively train a model without sharing their potentially sensitive data. This makes FL suitable for privacy-preserving applications. At the same time, FL is susceptible to adversarial…

机器学习 · 计算机科学 2021-08-02 Mustafa Safa Ozdayi , Murat Kantarcioglu , Yulia R. Gel

Context: To reduce manual effort of extracting test cases from natural-language requirements, many approaches based on Natural Language Processing (NLP) have been proposed in the literature. Given the large amount of approaches in this…

软件工程 · 计算机科学 2020-03-25 Vahid Garousi , Sara Bauer , Michael Felderer

In this paper, we identify the state of data as being an important reason for failure in applied Natural Language Processing (NLP) projects. We argue that there is a gap between academic research in NLP and its application to problems…

计算与语言 · 计算机科学 2021-10-12 Fredrik Olsson , Magnus Sahlgren

Recent work has proposed the concept of backdoor attacks on deep neural networks (DNNs), where misbehaviors are hidden inside "normal" models, only to be triggered by very specific inputs. In practice, however, these attacks are difficult…

机器学习 · 计算机科学 2019-05-28 Yuanshun Yao , Huiying Li , Haitao Zheng , Ben Y. Zhao

Backdoor attacks are a significant threat to the performance and integrity of pre-trained language models. Although such models are routinely fine-tuned for downstream NLP tasks, recent work shows they remain vulnerable to backdoor attacks…

机器学习 · 计算机科学 2025-08-28 Santosh Chapagain , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

Backdoor attacks pose a significant security risk to graph learning models. Backdoors can be embedded into the target model by inserting backdoor triggers into the training dataset, causing the model to make incorrect predictions when the…

密码学与安全 · 计算机科学 2023-08-09 Zihan Guan , Mengnan Du , Ninghao Liu

Backdoor attack aims at inducing neural models to make incorrect predictions for poison data while keeping predictions on the clean dataset unchanged, which creates a considerable threat to current natural language processing (NLP) systems.…

计算与语言 · 计算机科学 2023-03-28 Xukun Zhou , Jiwei Li , Tianwei Zhang , Lingjuan Lyu , Muqiao Yang , Jun He

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

计算与语言 · 计算机科学 2026-04-21 San Kim , Gary Geunbae Lee

Backdoor attacks are among the most effective, practical, and stealthy attacks in deep learning. In this paper, we consider a practical scenario where a developer obtains a deep model from a third party and uses it as part of a…

密码学与安全 · 计算机科学 2025-03-28 Dorde Popovic , Amin Sadeghi , Ting Yu , Sanjay Chawla , Issa Khalil

Backdoor attacks pose a serious threat to deep reinforcement learning (DRL). Current defenses typically rely on reward anomalies to reverse-engineer triggers and model finetuning to remove backdoors. However, complex trigger patterns…

人工智能 · 计算机科学 2026-05-08 Yinbo Yu , Xueyu Yin , Jiadai Wang , Chunwei Tian , Sai Xu , Qi Zhu , Daoqiang Zhang