中文
相关论文

相关论文: Backdoor Learning for NLP: Recent Advances, Challe…

200 篇论文

Existing studies in backdoor defense have predominantly focused on the training phase, overlooking the critical aspect of testing time defense. This gap becomes pronounced in the context of LLMs deployed as Web Services, which typically…

计算与语言 · 计算机科学 2025-02-13 Wenjie Mo , Jiashu Xu , Qin Liu , Jiongxiao Wang , Jun Yan , Hadi Askari , Chaowei Xiao , Muhao Chen

Reinforcement learning (RL) is an actively growing field that is seeing increased usage in real-world, safety-critical applications -- making it paramount to ensure the robustness of RL algorithms against adversarial attacks. In this work…

机器学习 · 计算机科学 2024-10-22 Ethan Rathbun , Christopher Amato , Alina Oprea

The rise of pre-trained unified foundation models breaks down the barriers between different modalities and tasks, providing comprehensive support to users with unified architectures. However, the backdoor attack on pre-trained models poses…

密码学与安全 · 计算机科学 2023-02-27 Zenghui Yuan , Yixin Liu , Kai Zhang , Pan Zhou , Lichao Sun

The Large Language Models (LLMs) are poised to offer efficient and intelligent services for future mobile communication networks, owing to their exceptional capabilities in language comprehension and generation. However, the extremely high…

密码学与安全 · 计算机科学 2023-09-07 Haomiao Yang , Kunlan Xiang , Mengyu Ge , Hongwei Li , Rongxing Lu , Shui Yu

Recent developments in deep learning have led to great success in various natural language processing (NLP) tasks. However, these applications may involve data that contain sensitive information. Therefore, how to achieve good performance…

计算与语言 · 计算机科学 2023-10-24 Lijie Hu , Ivan Habernal , Lei Shen , Di Wang

Deep learning models are well known to be susceptible to backdoor attack, where the attacker only needs to provide a tampered dataset on which the triggers are injected. Models trained on the dataset will passively implant the backdoor, and…

密码学与安全 · 计算机科学 2024-06-21 Zonghao Ying , Bin Wu

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed by a backdoor…

密码学与安全 · 计算机科学 2025-03-07 Haiyang Yu , Tian Xie , Jiaping Gui , Pengyang Wang , Ping Yi , Yue Wu

Backdoor data poisoning, inserted within instruction examples used to fine-tune a foundation Large Language Model (LLM) for downstream tasks (\textit{e.g.,} sentiment prediction), is a serious security concern due to the evasive nature of…

密码学与安全 · 计算机科学 2024-08-23 Jayaram Raghuram , George Kesidis , David J. Miller

The rapid development of large language models (LLMs) has opened new avenues across various fields, including cybersecurity, which faces an evolving threat landscape and demand for innovative technologies. Despite initial explorations into…

密码学与安全 · 计算机科学 2024-12-05 Jie Zhang , Haoyu Bu , Hui Wen , Yongji Liu , Haiqiang Fei , Rongrong Xi , Lun Li , Yun Yang , Hongsong Zhu , Dan Meng

In the NLP community, recent years have seen a surge of research activities that address machines' ability to perform deep language understanding which goes beyond what is explicitly stated in text, rather relying on reasoning and knowledge…

计算与语言 · 计算机科学 2020-02-27 Shane Storks , Qiaozi Gao , Joyce Y. Chai

Backdoor attacks pose a significant security threat to natural language processing (NLP) systems, but existing methods lack explainable trigger mechanisms and fail to quantitatively model vulnerability patterns. This work pioneers the…

密码学与安全 · 计算机科学 2025-09-24 Gejian Zhao , Hanzhou Wu , Xinpeng Zhang

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

计算与语言 · 计算机科学 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

Since Deep Learning (DL) backdoor attacks have been revealed as one of the most insidious adversarial attacks, a number of countermeasures have been developed with certain assumptions defined in their respective threat models. However, the…

密码学与安全 · 计算机科学 2022-04-14 Huming Qiu , Hua Ma , Zhi Zhang , Alsharif Abuadbba , Wei Kang , Anmin Fu , Yansong Gao

The growing dependence on machine learning in real-world applications emphasizes the importance of understanding and ensuring its safety. Backdoor attacks pose a significant security risk due to their stealthy nature and potentially serious…

密码学与安全 · 计算机科学 2023-10-19 Ganghua Wang , Xun Xian , Jayanth Srinivasa , Ashish Kundu , Xuan Bi , Mingyi Hong , Jie Ding

Deep learning (DL) models for natural language processing (NLP) tasks often handle private data, demanding protection against breaches and disclosures. Data protection laws, such as the European Union's General Data Protection Regulation…

计算与语言 · 计算机科学 2022-05-23 Samuel Sousa , Roman Kern

Natural language processing (NLP) models are known to be vulnerable to backdoor attacks, which poses a newly arisen threat to NLP models. Prior online backdoor defense methods for NLP models only focus on the anomalies at either the input…

计算与语言 · 计算机科学 2022-10-17 Sishuo Chen , Wenkai Yang , Zhiyuan Zhang , Xiaohan Bi , Xu Sun

Recent research highlights concerns about the trustworthiness of third-party Pre-Trained Language Models (PTLMs) due to potential backdoor attacks. These backdoored PTLMs, however, are effective only for specific pre-defined downstream…

密码学与安全 · 计算机科学 2025-05-20 Rui Zhang , Yun Shen , Hongwei Li , Wenbo Jiang , Hanxiao Chen , Yuan Zhang , Guowen Xu , Yang Zhang

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

计算与语言 · 计算机科学 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

Dense retrieval systems have been widely used in various NLP applications. However, their vulnerabilities to potential attacks have been underexplored. This paper investigates a novel attack scenario where the attackers aim to mislead the…

计算与语言 · 计算机科学 2025-08-26 Quanyu Long , Yue Deng , LeiLei Gan , Wenya Wang , Sinno Jialin Pan

Backdoor attack has emerged as a major security threat to deep neural networks (DNNs). While existing defense methods have demonstrated promising results on detecting or erasing backdoors, it is still not clear whether robust training…

机器学习 · 计算机科学 2021-12-02 Yige Li , Xixiang Lyu , Nodens Koren , Lingjuan Lyu , Bo Li , Xingjun Ma