中文
相关论文

相关论文: BadPre: Task-agnostic Backdoor Attacks to Pre-trai…

200 篇论文

Textual backdoor attacks pose significant security threats. Current detection approaches, typically relying on intermediate feature representation or reconstructing potential triggers, are task-specific and less effective beyond sentence…

计算与语言 · 计算机科学 2024-03-27 Weimin Lyu , Xiao Lin , Songzhu Zheng , Lu Pang , Haibin Ling , Susmit Jha , Chao Chen

Dense retrieval systems have been widely used in various NLP applications. However, their vulnerabilities to potential attacks have been underexplored. This paper investigates a novel attack scenario where the attackers aim to mislead the…

计算与语言 · 计算机科学 2025-08-26 Quanyu Long , Yue Deng , LeiLei Gan , Wenya Wang , Sinno Jialin Pan

The implications of backdoor attacks on English-centric large language models (LLMs) have been widely examined - such attacks can be achieved by embedding malicious behaviors during training and activated under specific conditions that…

计算与语言 · 计算机科学 2025-03-18 Xuanli He , Jun Wang , Qiongkai Xu , Pasquale Minervini , Pontus Stenetorp , Benjamin I. P. Rubinstein , Trevor Cohn

Backdoor attack intends to inject hidden backdoor into the deep neural networks (DNNs), such that the prediction of infected models will be maliciously changed if the hidden backdoor is activated by the attacker-defined trigger. Currently,…

密码学与安全 · 计算机科学 2021-04-27 Yiming Li , Tongqing Zhai , Yong Jiang , Zhifeng Li , Shu-Tao Xia

With the prosperity of large language models (LLMs), powerful LLM-based intelligent agents have been developed to provide customized services with a set of user-defined tools. State-of-the-art methods for constructing LLM agents adopt…

计算与语言 · 计算机科学 2024-06-06 Yifei Wang , Dizhan Xue , Shengjie Zhang , Shengsheng Qian

With the development of technology, large language models (LLMs) have dominated the downstream natural language processing (NLP) tasks. However, because of the LLMs' instruction-following abilities and inability to distinguish the…

密码学与安全 · 计算机科学 2025-10-07 Yulin Chen , Haoran Li , Yuan Sui , Yangqiu Song , Bryan Hooi

Pre-trained language models (PLMs) have attracted enormous attention over the past few years with their unparalleled performances. Meanwhile, the soaring cost to train PLMs as well as their amazing generalizability have jointly contributed…

计算与语言 · 计算机科学 2024-06-10 Tianrong Zhang , Zhaohan Xi , Ting Wang , Prasenjit Mitra , Jinghui Chen

Recently, a series of pioneer studies have shown the potency of pre-trained models in sequential recommendation, illuminating the path of building an omniscient unified pre-trained recommendation model for different downstream…

信息检索 · 计算机科学 2023-05-09 Yiqing Wu , Ruobing Xie , Zhao Zhang , Yongchun Zhu , FuZhen Zhuang , Jie Zhou , Yongjun Xu , Qing He

Backdoor attacks significantly compromise the security of large language models by triggering them to output specific and controlled content. Currently, triggers for textual backdoor attacks fall into two categories: fixed-token triggers…

密码学与安全 · 计算机科学 2025-04-01 Jingyi Zheng , Tianyi Hu , Tianshuo Cong , Xinlei He

Large pre-trained language models (PLMs) have proven to be a crucial component of modern natural language processing systems. PLMs typically need to be fine-tuned on task-specific downstream datasets, which makes it hard to claim the…

计算与语言 · 计算机科学 2023-02-13 Chenxi Gu , Chengsong Huang , Xiaoqing Zheng , Kai-Wei Chang , Cho-Jui Hsieh

Human language encompasses a wide range of intricate and diverse implicit features, which attackers can exploit to launch adversarial or backdoor attacks, compromising DNN models for NLP tasks. Existing model-oriented defenses often require…

机器学习 · 计算机科学 2025-09-26 Yi Jiang , Oubo Ma , Yong Yang , Tong Zhang , Shouling Ji

The democratization of pre-trained language models through open-source initiatives has rapidly advanced innovation and expanded access to cutting-edge technologies. However, this openness also brings significant security risks, including…

计算与语言 · 计算机科学 2024-06-04 Ansh Arora , Xuanli He , Maximilian Mozes , Srinibas Swain , Mark Dras , Qiongkai Xu

Adversarial attack research in natural language processing (NLP) has made significant progress in designing powerful attack methods and defence approaches. However, few efforts have sought to identify which source samples are the most…

计算与语言 · 计算机科学 2023-06-26 Vyas Raina , Mark Gales

Recently, ChatGPT has gained significant attention in research due to its ability to interact with humans effectively. The core idea behind this model is reinforcement learning (RL) fine-tuning, a new paradigm that allows language models to…

密码学与安全 · 计算机科学 2023-04-25 Jiawen Shi , Yixin Liu , Pan Zhou , Lichao Sun

Prompts have significantly improved the performance of pretrained Large Language Models (LLMs) on various downstream tasks recently, making them increasingly indispensable for a diverse range of LLM application scenarios. However, the…

计算与语言 · 计算机科学 2023-12-19 Hongwei Yao , Jian Lou , Zhan Qin

Backdoor attacks are a significant threat to the performance and integrity of pre-trained language models. Although such models are routinely fine-tuned for downstream NLP tasks, recent work shows they remain vulnerable to backdoor attacks…

机器学习 · 计算机科学 2025-08-28 Santosh Chapagain , Shah Muhammad Hamdi , Soukaina Filali Boubrahimi

With the burgeoning advancements in the field of natural language processing (NLP), the demand for training data has increased significantly. To save costs, it has become common for users and businesses to outsource the labor-intensive task…

计算与语言 · 计算机科学 2024-08-22 Ziqiang Li , Yueqi Zeng , Pengfei Xia , Lei Liu , Zhangjie Fu , Bin Li

Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yong Li , Han Gao

Backdoor attacks have severely threatened deep neural network (DNN) models in the past several years. These attacks can occur in almost every stage of the deep learning pipeline. Although the attacked model behaves normally on benign…

计算机视觉与模式识别 · 计算机科学 2024-05-21 Yangming Chen

Large language models (LLMs) have demonstrated superior performance compared to previous methods on various tasks, and often serve as the foundation models for many researches and services. However, the untrustworthy third-party LLMs may…

密码学与安全 · 计算机科学 2024-04-02 Hai Huang , Zhengyu Zhao , Michael Backes , Yun Shen , Yang Zhang