English
Related papers

Related papers: Single Word Change is All You Need: Using LLMs to …

200 papers

Adversarial examples are inputs intentionally perturbed with the aim of forcing a machine learning model to produce a wrong prediction, while the changes are not easily detectable by a human. Although this topic has been intensively studied…

Machine Learning · Computer Science 2021-02-16 Jon Vadillo , Roberto Santana

In recent years, large pre-trained language models (PLMs) have achieved remarkable performance on many natural language processing benchmarks. Despite their success, prior studies have shown that PLMs are vulnerable to attacks from…

Computation and Language · Computer Science 2024-02-06 Shuguang Chen , Leonardo Neves , Thamar Solorio

In response to adversarial text attacks, attack detection models have been proposed and shown to successfully identify text modified by adversaries. Attack detection models can be leveraged to provide an additional check for NLP models and…

Computation and Language · Computer Science 2025-09-26 Jonathan Rusert

Adversarial examples --- perturbations to the input of a model that elicit large changes in the output --- have been shown to be an effective way of assessing the robustness of sequence-to-sequence (seq2seq) models. However, these…

Computation and Language · Computer Science 2019-03-20 Paul Michel , Xian Li , Graham Neubig , Juan Miguel Pino

Neural models based on pre-trained transformers, such as BERT or XLM-RoBERTa, demonstrate SOTA results in many NLP tasks, including non-topical classification, such as genre identification. However, often these approaches exhibit low…

Computation and Language · Computer Science 2021-07-07 Mikhail Lepekhin , Serge Sharoff

Reinforcement learning (RL) has achieved remarkable success in fields like robotics and autonomous driving, but adversarial attacks designed to mislead RL systems remain challenging. Existing approaches often rely on modifying the…

Machine Learning · Computer Science 2025-07-25 Junyong Jiang , Buwei Tian , Chenxing Xu , Songze Li , Lu Dong

In this paper, we present an effective method to craft text adversarial samples, revealing one important yet underestimated fact that DNN-based text classifiers are also prone to adversarial sample attack. Specifically, confronted with…

Cryptography and Security · Computer Science 2019-01-08 Bin Liang , Hongcheng Li , Miaoqiang Su , Pan Bian , Xirong Li , Wenchang Shi

Image classifiers often suffer from adversarial examples, which are generated by strategically adding a small amount of noise to input images to trick classifiers into misclassification. Over the years, many defense mechanisms have been…

Machine Learning · Computer Science 2020-01-22 Huangyi Ge , Sze Yiu Chau , Bruno Ribeiro , Ninghui Li

Adversarial training is one of the best-performing methods in improving the robustness of deep language models. However, robust models come at the cost of high time consumption, as they require multi-step gradient ascents or word…

Computation and Language · Computer Science 2023-06-28 Songyang Gao , Shihan Dou , Yan Liu , Xiao Wang , Qi Zhang , Zhongyu Wei , Jin Ma , Ying Shan

Pre-trained contextualized language models (PrLMs) have led to strong performance gains in downstream natural language understanding tasks. However, PrLMs can still be easily fooled by adversarial word substitution, which is one of the most…

Computation and Language · Computer Science 2021-06-01 Rongzhou Bao , Jiayi Wang , Hai Zhao

Textual adversarial attacks expose the vulnerabilities of text classifiers and can be used to improve their robustness. Existing context-aware methods solely consider the gold label probability and use the greedy search when searching an…

Computation and Language · Computer Science 2022-08-18 Huijun Liu , Jie Yu , Shasha Li , Jun Ma , Bin Ji

There has been recently a growing interest in studying adversarial examples on natural language models in the black-box setting. These methods attack natural language classifiers by perturbing certain important words until the classifier…

Machine Learning · Computer Science 2021-05-04 Mahmoud Hossam , Trung Le , He Zhao , Viet Huynh , Dinh Phung

Adversarial example generation methods in NLP rely on models like language models or sentence encoders to determine if potential adversarial examples are valid. In these methods, a valid adversarial example fools the model being attacked,…

Computation and Language · Computer Science 2020-10-07 John X. Morris

Adversarial examples are inputs to machine learning models designed to cause the model to make a mistake. They are useful for understanding the shortcomings of machine learning models, interpreting their results, and for regularisation. In…

Machine Learning · Computer Science 2018-08-28 Pasquale Minervini , Sebastian Riedel

Adversarial attacking aims to fool deep neural networks with adversarial examples. In the field of natural language processing, various textual adversarial attack models have been proposed, varying in the accessibility to the victim model.…

Computation and Language · Computer Science 2020-09-22 Yuan Zang , Bairu Hou , Fanchao Qi , Zhiyuan Liu , Xiaojun Meng , Maosong Sun

In recent years, deep learning has shown performance breakthroughs in many applications, such as image detection, image segmentation, pose estimation, and speech recognition. However, this comes with a major concern: deep networks have been…

Machine Learning · Computer Science 2019-01-11 Felix Kreuk , Assi Barak , Shir Aviv-Reuven , Moran Baruch , Benny Pinkas , Joseph Keshet

Today text classification models have been widely used. However, these classifiers are found to be easily fooled by adversarial examples. Fortunately, standard attacking methods generate adversarial texts in a pair-wise way, that is, an…

Computation and Language · Computer Science 2020-03-24 Yankun Ren , Jianbin Lin , Siliang Tang , Jun Zhou , Shuang Yang , Yuan Qi , Xiang Ren

Machine learning models are vulnerable to tiny adversarial input perturbations optimized to cause a very large output error. To measure this vulnerability, we need reliable methods that can find such adversarial perturbations. For image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Levente Halmosi , Bálint Mohos , Márk Jelasity

While there has been substantial research using adversarial attacks to analyze NLP models, each attack is implemented in its own code repository. It remains challenging to develop NLP attacks and utilize them to improve model performance.…

Computation and Language · Computer Science 2020-10-06 John X. Morris , Eli Lifland , Jin Yong Yoo , Jake Grigsby , Di Jin , Yanjun Qi

Word-level textual adversarial attacks have demonstrated notable efficacy in misleading Natural Language Processing (NLP) models. Despite their success, the underlying reasons for their effectiveness and the fundamental characteristics of…

Computation and Language · Computer Science 2024-04-16 Ning Lu , Shengcai Liu , Zhirui Zhang , Qi Wang , Haifeng Liu , Ke Tang