中文
相关论文

相关论文: TextGuard: Provable Defense against Backdoor Attac…

200 篇论文

Federated graph learning (FedGL) is an emerging federated learning (FL) framework that extends FL to learn graph data from diverse sources. FL for non-graph data has shown to be vulnerable to backdoor attacks, which inject a shared backdoor…

密码学与安全 · 计算机科学 2024-07-15 Yuxin Yang , Qiang Li , Jinyuan Jia , Yuan Hong , Binghui Wang

Defenses against security threats have been an interest of recent studies. Recent works have shown that it is not difficult to attack a natural language processing (NLP) model while defending against them is still a cat-mouse game. Backdoor…

密码学与安全 · 计算机科学 2022-05-31 Sangeet Sagar , Abhinav Bhatt , Abhijith Srinivas Bidaralli

Multi-label classification, which predicts a set of labels for an input, has many applications. However, multiple recent studies showed that multi-label classification is vulnerable to adversarial examples. In particular, an attacker can…

密码学与安全 · 计算机科学 2022-10-04 Jinyuan Jia , Wenjie Qu , Neil Zhenqiang Gong

Backdoor attacks represent a subtle yet effective class of cyberattacks targeting AI models, primarily due to their stealthy nature. The model behaves normally on clean data but exhibits malicious behavior only when the attacker embeds a…

机器学习 · 计算机科学 2025-09-29 Sujeevan Aseervatham , Achraf Kerzazi , Younès Bennani

Because state-of-the-art language models are expensive to train, most practitioners must make use of one of the few publicly available language models or language model APIs. This consolidation of trust increases the potency of backdoor…

密码学与安全 · 计算机科学 2023-07-28 Nikhil Kandpal , Matthew Jagielski , Florian Tramèr , Nicholas Carlini

In a backdoor attack, an adversary inserts maliciously constructed backdoor examples into a training set to make the resulting model vulnerable to manipulation. Defending against such attacks typically involves viewing these inserted…

密码学与安全 · 计算机科学 2023-07-20 Alaa Khaddaj , Guillaume Leclerc , Aleksandar Makelov , Kristian Georgiev , Hadi Salman , Andrew Ilyas , Aleksander Madry

The deployment of Large Reasoning Models (LRMs) in high-stakes decision-making pipelines has introduced a novel and opaque attack surface: reasoning backdoors. In these attacks, the model's intermediate Chain-of-Thought (CoT) is manipulated…

密码学与安全 · 计算机科学 2026-03-04 Zhen Guo , Shanghao Shi , Hao Li , Shamim Yazdani , Ning Zhang , Reza Tourani

Backdoor attacks have emerged as one of the major security threats to deep learning models as they can easily control the model's test-time predictions by pre-injecting a backdoor trigger into the model at training time. While backdoor…

机器学习 · 计算机科学 2023-02-07 Yujing Jiang , Xingjun Ma , Sarah Monazam Erfani , James Bailey

Textual backdoor attack, as a novel attack model, has been shown to be effective in adding a backdoor to the model during training. Defending against such backdoor attacks has become urgent and important. In this paper, we propose AttDef,…

计算与语言 · 计算机科学 2023-08-08 Jiazhao Li , Zhuofeng Wu , Wei Ping , Chaowei Xiao , V. G. Vinod Vydiswaran

Backdoor attacks pose a persistent security risk to deep neural networks (DNNs) due to their stealth and durability. While recent research has explored leveraging model unlearning mechanisms to enhance backdoor concealment, existing attack…

密码学与安全 · 计算机科学 2025-10-16 Baogang Song , Dongdong Zhao , Jianwen Xiang , Qiben Xu , Zizhuo Yu

Gaze estimation models are widely used in applications such as driver attention monitoring and human-computer interaction. While many methods for gaze estimation exist, they rely heavily on data-hungry deep learning to achieve high…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Lingyu Du , Yupei Liu , Jinyuan Jia , Guohao Lan

With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection of intellectual…

计算与语言 · 计算机科学 2024-04-03 Ying Zhou , Ben He , Le Sun

Backdoor attacks are a kind of insidious security threat against machine learning models. After being injected with a backdoor in training, the victim model will produce adversary-specified outputs on the inputs embedded with predesigned…

计算与语言 · 计算机科学 2021-06-04 Fanchao Qi , Mukai Li , Yangyi Chen , Zhengyan Zhang , Zhiyuan Liu , Yasheng Wang , Maosong Sun

Recent studies have shown that deep neural networks (DNNs) are vulnerable to adversarial attacks, including evasion and backdoor (poisoning) attacks. On the defense side, there have been intensive efforts on improving both empirical and…

机器学习 · 计算机科学 2023-08-04 Maurice Weber , Xiaojun Xu , Bojan Karlaš , Ce Zhang , Bo Li

The rapid growth of natural language processing (NLP) and pre-trained language models have enabled accurate text classification in a variety of settings. However, text classification models are susceptible to backdoor attacks, where an…

密码学与安全 · 计算机科学 2024-12-30 A. Dilara Yavuz , M. Emre Gursoy

Backdoor attacks pose a serious threat to deep reinforcement learning (DRL). Current defenses typically rely on reward anomalies to reverse-engineer triggers and model finetuning to remove backdoors. However, complex trigger patterns…

人工智能 · 计算机科学 2026-05-08 Yinbo Yu , Xueyu Yin , Jiadai Wang , Chunwei Tian , Sai Xu , Qi Zhu , Daoqiang Zhang

Research on backdoor attacks in Federated Learning (FL) has accelerated in recent years, with new attacks and defenses continually proposed in an escalating arms race. However, the evaluation of these methods remains neither standardized…

密码学与安全 · 计算机科学 2025-11-26 Thinh Dao , Dung Thuy Nguyen , Khoa D Doan , Kok-Seng Wong

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

In this paper, we introduce GradEscape, the first gradient-based evader designed to attack AI-generated text (AIGT) detectors. GradEscape overcomes the undifferentiable computation problem, caused by the discrete nature of text, by…

密码学与安全 · 计算机科学 2025-10-31 Wenlong Meng , Shuguo Fan , Chengkun Wei , Min Chen , Yuwei Li , Yuanchao Zhang , Zhikun Zhang , Wenzhi Chen

Recently, a special type of data poisoning (DP) attack targeting Deep Neural Network (DNN) classifiers, known as a backdoor, was proposed. These attacks do not seek to degrade classification accuracy, but rather to have the classifier learn…

机器学习 · 计算机科学 2020-08-20 Zhen Xiang , David J. Miller , George Kesidis