中文
相关论文

相关论文: Generating Natural Language Adversarial Examples t…

200 篇论文

An automatic speech recognition (ASR) system based on a deep neural network is vulnerable to attack by an adversarial example, especially if the command-dependent ASR fails. A defense method against adversarial examples is proposed to…

声音 · 计算机科学 2021-10-19 Mingyu Dong , Diqun Yan , Yongkang Gong , Rangding Wang

Recently, the textual adversarial attack models become increasingly popular due to their successful in estimating the robustness of NLP models. However, existing works have obvious deficiencies. (1) They usually consider only a single…

计算与语言 · 计算机科学 2021-09-10 Yangyi Chen , Jin Su , Wei Wei

Deep neural networks are vulnerable to adversarial examples, which can mislead classifiers by adding imperceptible perturbations. An intriguing property of adversarial examples is their good transferability, making black-box attacks…

计算机视觉与模式识别 · 计算机科学 2019-04-08 Yinpeng Dong , Tianyu Pang , Hang Su , Jun Zhu

Adversarial examples are important for understanding the behavior of neural models, and can improve their robustness through adversarial training. Recent work in natural language processing generated adversarial examples by assuming…

机器学习 · 计算机科学 2019-04-05 Yotam Gil , Yoav Chai , Or Gorodissky , Jonathan Berant

Adversarial examples are maliciously modified inputs created to fool deep neural networks (DNN). The discovery of such inputs presents a major issue to the expansion of DNN-based solutions. Many researchers have already contributed to the…

计算机视觉与模式识别 · 计算机科学 2019-08-27 Alessandro Cennamo , Ido Freeman , Anton Kummert

Existing black box search methods have achieved high success rate in generating adversarial attacks against NLP models. However, such search methods are inefficient as they do not consider the amount of queries required to generate…

计算与语言 · 计算机科学 2021-09-13 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

With the development of large language models (LLMs), detecting whether text is generated by a machine becomes increasingly challenging in the face of malicious use cases like the spread of false information, protection of intellectual…

计算与语言 · 计算机科学 2024-04-03 Ying Zhou , Ben He , Le Sun

Recent studies on adversarial examples expose vulnerabilities of natural language processing (NLP) models. Existing techniques for generating adversarial examples are typically driven by deterministic hierarchical rules that are agnostic to…

密码学与安全 · 计算机科学 2024-03-25 Mingze Ni , Zhensu Sun , Wei Liu

We present FireBERT, a set of three proof-of-concept NLP classifiers hardened against TextFooler-style word-perturbation by producing diverse alternatives to original samples. In one approach, we co-tune BERT against the training data and…

计算与语言 · 计算机科学 2020-08-11 Gunnar Mein , Kevin Hartman , Andrew Morris

With the advent of Large Vision-Language Models (LVLMs), new attack vectors, such as cognitive bias, prompt injection, and jailbreaking, have emerged. Understanding these attacks promotes system robustness improvement and neural networks…

计算机视觉与模式识别 · 计算机科学 2025-05-20 Chiyu Zhang , Lu Zhou , Xiaogang Xu , Jiafei Wu , Zhe Liu

Recently, unsupervised adversarial training (AT) has been highlighted as a means of achieving robustness in models without any label information. Previous studies in unsupervised AT have mostly focused on implementing self-supervised…

机器学习 · 计算机科学 2023-10-27 Minseon Kim , Hyeonjeong Ha , Sooel Son , Sung Ju Hwang

Efficiently building an adversarial attacker for natural language processing (NLP) tasks is a real challenge. Firstly, as the sentence space is discrete, it is difficult to make small perturbations along the direction of gradients.…

计算与语言 · 计算机科学 2020-07-14 Huangzhao Zhang , Hao Zhou , Ning Miao , Lei Li

Text classifiers are vulnerable to adversarial examples -- correctly-classified examples that are deliberately transformed to be misclassified while satisfying acceptability constraints. The conventional approach to finding adversarial…

计算与语言 · 计算机科学 2024-05-21 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

Language models can be manipulated by adversarial attacks, which introduce subtle perturbations to input data. While recent attack methods can achieve a relatively high attack success rate (ASR), we've observed that the generated…

计算与语言 · 计算机科学 2024-09-24 Yibo Wang , Xiangjue Dong , James Caverlee , Philip S. Yu

With the boom of Large Language Models (LLMs), the research of solving Math Word Problem (MWP) has recently made great progress. However, there are few studies to examine the security of LLMs in math solving ability. Instead of attacking…

计算与语言 · 计算机科学 2023-09-06 Zihao Zhou , Qiufeng Wang , Mingyu Jin , Jie Yao , Jianan Ye , Wei Liu , Wei Wang , Xiaowei Huang , Kaizhu Huang

Transfer-based attack adopts the adversarial examples generated on the surrogate model to attack various models, making it applicable in the physical world and attracting increasing interest. Recently, various adversarial attacks have…

计算机视觉与模式识别 · 计算机科学 2023-11-03 Zhijin Ge , Hongying Liu , Xiaosen Wang , Fanhua Shang , Yuanyuan Liu

Offensive language detection is an ever-growing natural language processing (NLP) application. This growth is mainly because of the widespread usage of social networks, which becomes a mainstream channel for people to communicate, work, and…

计算与语言 · 计算机科学 2021-06-29 Ehab Hamdy

The deep learning algorithm has achieved great success in the field of computer vision, but some studies have pointed out that the deep learning model is vulnerable to attacks adversarial examples and makes false decisions. This challenges…

机器学习 · 计算机科学 2021-09-21 Tiangang Li

With the excellent accuracy and feasibility, the Neural Networks have been widely applied into the novel intelligent applications and systems. However, with the appearance of the Adversarial Attack, the NN based system performance becomes…

计算机视觉与模式识别 · 计算机科学 2018-06-14 Fuxun Yu , Qide Dong , Xiang Chen

Adversarial prompts generated using gradient-based methods exhibit outstanding performance in performing automatic jailbreak attacks against safety-aligned LLMs. Nevertheless, due to the discrete nature of texts, the input gradient of LLMs…

密码学与安全 · 计算机科学 2024-11-04 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen