中文
相关论文

相关论文: Learning to Ignore Adversarial Attacks

200 篇论文

Although pre-trained language models (PrLMs) have achieved significant success, recent studies demonstrate that PrLMs are vulnerable to adversarial attacks. By generating adversarial examples with slight perturbations on different levels…

计算与语言 · 计算机科学 2022-08-23 Jiayi Wang , Rongzhou Bao , Zhuosheng Zhang , Hai Zhao

Currently, Automatic Speech Recognition (ASR) models are deployed in an extensive range of applications. However, recent studies have demonstrated the possibility of adversarial attack on these models which could potentially suppress or…

声音 · 计算机科学 2025-09-09 Zheng Jie Wong , Bingquan Shen

Despite excellent performance on many tasks, NLP systems are easily fooled by small adversarial perturbations of inputs. Existing procedures to defend against such perturbations are either (i) heuristic in nature and susceptible to stronger…

计算与语言 · 计算机科学 2020-05-05 Erik Jones , Robin Jia , Aditi Raghunathan , Percy Liang

To guarantee safe and robust deployment of large language models (LLMs) at scale, it is critical to accurately assess their adversarial robustness. Existing adversarial attacks typically target harmful responses in single-point greedy…

机器学习 · 计算机科学 2026-02-24 Tim Beyer , Yan Scholten , Leo Schwinn , Stephan Günnemann

Pre-trained language models (PLMs) have driven substantial progress in natural language processing but remain vulnerable to adversarial attacks, raising concerns about their robustness in real-world applications. Previous studies have…

计算与语言 · 计算机科学 2025-10-17 Yang Wang , Chenghao Xiao , Yizhi Li , Stuart E. Middleton , Noura Al Moubayed , Chenghua Lin

Large language models memorize parts of their training data. Memorizing short snippets and facts is required to answer questions about the world and to be fluent in any language. But models have also been shown to reproduce long verbatim…

计算与语言 · 计算机科学 2024-11-18 Michael Aerni , Javier Rando , Edoardo Debenedetti , Nicholas Carlini , Daphne Ippolito , Florian Tramèr

Adversarial Training has proved to be an effective training paradigm to enforce robustness against adversarial examples in modern neural network architectures. Despite many efforts, explanations of the foundational principles underpinning…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Mattia Carletti , Matteo Terzi , Gian Antonio Susto

Adversarial examples are carefully perturbed in-puts for fooling machine learning models. A well-acknowledged defense method against such examples is adversarial training, where adversarial examples are injected into training data to…

机器学习 · 计算机科学 2019-05-17 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Adversarial examples are malicious inputs designed to fool machine learning models. They often transfer from one model to another, allowing attackers to mount black box attacks without knowledge of the target model's parameters. Adversarial…

计算机视觉与模式识别 · 计算机科学 2017-02-14 Alexey Kurakin , Ian Goodfellow , Samy Bengio

Recent years have seen the wide application of NLP models in crucial areas such as finance, medical treatment, and news media, raising concerns of the model robustness and vulnerabilities. In this paper, we propose a novel prompt-based…

计算与语言 · 计算机科学 2022-03-22 Yuting Yang , Pei Huang , Juan Cao , Jintao Li , Yun Lin , Jin Song Dong , Feifei Ma , Jian Zhang

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

机器学习 · 计算机科学 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

机器学习 · 计算机科学 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

Deep reinforcement learning models are vulnerable to adversarial attacks that can decrease a victim's cumulative expected reward by manipulating the victim's observations. Despite the efficiency of previous optimization-based methods for…

机器学习 · 计算机科学 2023-02-28 You Qiaoben , Chengyang Ying , Xinning Zhou , Hang Su , Jun Zhu , Bo Zhang

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to…

计算与语言 · 计算机科学 2020-06-02 Ying Xu , Xu Zhong , Antonio Jose Jimeno Yepes , Jey Han Lau

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Transfer-based adversarial attacks raise a severe threat to real-world deep learning systems since they do not require access to target models. Adversarial training (AT), which is recognized as the strongest defense against white-box…

密码学与安全 · 计算机科学 2023-10-17 Yulong Yang , Chenhao Lin , Xiang Ji , Qiwei Tian , Qian Li , Hongshan Yang , Zhibo Wang , Chao Shen

In this paper, we present an approach to improve the robustness of BERT language models against word substitution-based adversarial attacks by leveraging adversarial perturbations for self-supervised contrastive learning. We create a…

计算与语言 · 计算机科学 2022-05-25 Zhao Meng , Yihan Dong , Mrinmaya Sachan , Roger Wattenhofer

With the boom of Large Language Models (LLMs), the research of solving Math Word Problem (MWP) has recently made great progress. However, there are few studies to examine the security of LLMs in math solving ability. Instead of attacking…

计算与语言 · 计算机科学 2023-09-06 Zihao Zhou , Qiufeng Wang , Mingyu Jin , Jie Yao , Jianan Ye , Wei Liu , Wei Wang , Xiaowei Huang , Kaizhu Huang

Adversarial training has proven to be effective in hardening networks against adversarial examples. However, the gained robustness is limited by network capacity and number of training samples. Consequently, to build more robust models, it…

机器学习 · 计算机科学 2020-06-02 Zheng Xu , Ali Shafahi , Tom Goldstein

Neural ranking models (NRMs) have undergone significant development and have become integral components of information retrieval (IR) systems. Unfortunately, recent research has unveiled the vulnerability of NRMs to adversarial document…

信息检索 · 计算机科学 2023-08-01 Xuanang Chen , Ben He , Le Sun , Yingfei Sun