中文
相关论文

相关论文: Hidden Backdoors in Human-Centric Language Models

200 篇论文

The integration of large language models (LLMs) into robotic control pipelines enables natural language interfaces that translate user prompts into executable commands. However, this digital-to-physical interface introduces a critical and…

机器人学 · 计算机科学 2026-04-07 Mingyang Xie , Jin Wei-Kocsis

Deep speech classification has achieved tremendous success and greatly promoted the emergence of many real-world applications. However, backdoor attacks present a new security threat to it, particularly with untrustworthy third-party…

声音 · 计算机科学 2023-08-15 Zhe Ye , Terui Mao , Li Dong , Diqun Yan

While previous research backdoored neural networks by changing their parameters, recent work uncovered a more insidious threat: backdoors embedded within the definition of the network's architecture. This involves injecting common…

密码学与安全 · 计算机科学 2024-02-13 Harry Langford , Ilia Shumailov , Yiren Zhao , Robert Mullins , Nicolas Papernot

Recent studies have revealed that \textit{Backdoor Attacks} can threaten the safety of natural language processing (NLP) models. Investigating the strategies of backdoor attacks will help to understand the model's vulnerability. Most…

机器学习 · 计算机科学 2023-10-26 Weimin Lyu , Songzhu Zheng , Lu Pang , Haibin Ling , Chao Chen

In a backdoor attack on a machine learning model, an adversary produces a model that performs well on normal inputs but outputs targeted misclassifications on inputs containing a small trigger pattern. Model compression is a widely-used…

密码学与安全 · 计算机科学 2021-05-03 Yulong Tian , Fnu Suya , Fengyuan Xu , David Evans

Backdoor attacks are rapidly emerging threats to deep neural networks (DNNs). In the backdoor attack scenario, attackers usually implant the backdoor into the target model by manipulating the training dataset or training process. Then, the…

密码学与安全 · 计算机科学 2022-05-09 Nan Zhong , Zhenxing Qian , Xinpeng Zhang

Backdoor attacks have become a critical threat to deep neural networks (DNNs), drawing many research interests. However, most of the studied attacks employ a single type of trigger. Consequently, proposed backdoor defenders often rely on…

密码学与安全 · 计算机科学 2025-01-14 Duc Anh Vu , Anh Tuan Tran , Cong Tran , Cuong Pham

Backdoor attack introduces artificial vulnerabilities into the model by poisoning a subset of the training data via injecting triggers and modifying labels. Various trigger design strategies have been explored to attack text classifiers,…

计算与语言 · 计算机科学 2021-09-23 Zichao Li , Dheeraj Mekala , Chengyu Dong , Jingbo Shang

Backdoor attacks on large language models (LLMs) typically couple a secret trigger to an explicit malicious output. We show that this explicit association is unnecessary for common LLMs. We introduce a compliance-only backdoor: supervised…

机器学习 · 计算机科学 2025-11-18 Yuting Tan , Yi Huang , Zhuo Li

Backdoor attacks pose severe security threats to large language models (LLMs), where a model behaves normally under benign inputs but produces malicious outputs when a hidden trigger appears. Existing backdoor removal methods typically…

密码学与安全 · 计算机科学 2026-03-17 Jianwei Li , Jung-Eun Kim

Machine learning is vulnerable to adversarial manipulation. Previous literature has demonstrated that at the training stage attackers can manipulate data and data sampling procedures to control model behaviour. A common attack goal is to…

机器学习 · 计算机科学 2022-06-17 Mikel Bober-Irizar , Ilia Shumailov , Yiren Zhao , Robert Mullins , Nicolas Papernot

Deep anomaly detection on sequential data has garnered significant attention due to the wide application scenarios. However, deep learning-based models face a critical security threat - their vulnerability to backdoor attacks. In this…

机器学习 · 计算机科学 2024-02-19 He Cheng , Shuhan Yuan

Backdoor attacks become a significant security concern for deep neural networks in recent years. An image classification model can be compromised if malicious backdoors are injected into it. This corruption will cause the model to function…

密码学与安全 · 计算机科学 2024-03-13 Hongwei Zhang , Xiaoyin Xu , Dongsheng An , Xianfeng Gu , Min Zhang

Natural language processing (NLP) models may leak private information in different ways, including membership inference, reconstruction or attribute inference attacks. Sensitive information may not be explicit in the text, but hidden in…

计算与语言 · 计算机科学 2024-07-01 Pedro Faustini , Shakila Mahjabin Tonni , Annabelle McIver , Qiongkai Xu , Mark Dras

With the thriving of deep learning and the widespread practice of using pre-trained networks, backdoor attacks have become an increasing security threat drawing many research interests in recent years. A third-party model can be poisoned in…

密码学与安全 · 计算机科学 2021-03-05 Anh Nguyen , Anh Tran

Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by…

密码学与安全 · 计算机科学 2022-02-17 Yiming Li , Yong Jiang , Zhifeng Li , Shu-Tao Xia

Backdoor attacks pose a critical threat by embedding hidden triggers into inputs, causing models to misclassify them into target labels. While extensive research has focused on mitigating these attacks in object recognition models through…

计算机视觉与模式识别 · 计算机科学 2025-04-09 Kyle Stein , Andrew Arash Mahyari , Guillermo Francia , Eman El-Sheikh

Modern NLP models are often trained over large untrusted datasets, raising the potential for a malicious adversary to compromise model behaviour. For instance, backdoors can be implanted through crafting training instances with a specific…

计算与语言 · 计算机科学 2023-10-23 Xuanli He , Qiongkai Xu , Jun Wang , Benjamin Rubinstein , Trevor Cohn

Prompt-based learning has been widely applied in many low-resource NLP tasks such as few-shot scenarios. However, this paradigm has been shown to be vulnerable to backdoor attacks. Most of the existing attack methods focus on inserting…

计算与语言 · 计算机科学 2023-11-30 Zihao Tan , Qingliang Chen , Yongjian Huang , Chen Liang

While text-to-image synthesis currently enjoys great popularity among researchers and the general public, the security of these models has been neglected so far. Many text-guided image generation models rely on pre-trained text encoders…

机器学习 · 计算机科学 2023-08-10 Lukas Struppek , Dominik Hintersdorf , Kristian Kersting