English
Related papers

Related papers: Generating Textual Adversaries with Minimal Pertur…

200 papers

We proposes a novel algorithm, ANTHRO, that inductively extracts over 600K human-written text perturbations in the wild and leverages them for realistic adversarial attack. Unlike existing character-based attacks which often deductively…

Machine Learning · Computer Science 2022-03-22 Thai Le , Jooyoung Lee , Kevin Yen , Yifan Hu , Dongwon Lee

Robustness of huge Transformer-based models for natural language processing is an important issue due to their capabilities and wide adoption. One way to understand and improve robustness of these models is an exploration of an adversarial…

Adversarial purification is a successful defense mechanism against adversarial attacks without requiring knowledge of the form of the incoming attack. Generally, adversarial purification aims to remove the adversarial perturbations…

Computation and Language · Computer Science 2023-05-04 Linyang Li , Demin Song , Xipeng Qiu

Deep neural networks (DNNs) have achieved remarkable success in various tasks (e.g., image classification, speech recognition, and natural language processing (NLP)). However, researchers have demonstrated that DNN-based models are…

Computation and Language · Computer Science 2021-04-22 Wenqi Wang , Run Wang , Lina Wang , Zhibo Wang , Aoshuang Ye

Adversarial examples are carefully constructed modifications to an input that completely change the output of a classifier but are imperceptible to humans. Despite these successful attacks for continuous data (such as image and audio…

Machine Learning · Computer Science 2019-04-08 Qi Lei , Lingfei Wu , Pin-Yu Chen , Alexandros G. Dimakis , Inderjit S. Dhillon , Michael Witbrock

This paper concerns corpus poisoning attacks in dense information retrieval, where an adversary attempts to compromise the ranking performance of a search algorithm by injecting a small number of maliciously generated documents into the…

Information Retrieval · Computer Science 2026-03-17 Yongkang Li , Panagiotis Eustratiadis , Simon Lupart , Evangelos Kanoulas

State-of-the-art attacks on NLP models lack a shared definition of a what constitutes a successful attack. We distill ideas from past work into a unified framework: a successful natural language adversarial example is a perturbation that…

Computation and Language · Computer Science 2021-12-23 John X. Morris , Eli Lifland , Jack Lanchantin , Yangfeng Ji , Yanjun Qi

Although various techniques have been proposed to generate adversarial samples for white-box attacks on text, little attention has been paid to black-box attacks, which are more realistic scenarios. In this paper, we present a novel…

Computation and Language · Computer Science 2018-05-24 Ji Gao , Jack Lanchantin , Mary Lou Soffa , Yanjun Qi

This study focused on efficient text generation using generative adversarial networks (GAN). Assuming that the goal is to generate a paragraph of a user-defined topic and sentimental tendency, conventionally the whole network has to be…

Computation and Language · Computer Science 2020-06-23 Chenhan Yuan , Yi-chin Huang , Cheng-Hung Tsai

In this paper, we present an effective method to craft text adversarial samples, revealing one important yet underestimated fact that DNN-based text classifiers are also prone to adversarial sample attack. Specifically, confronted with…

Cryptography and Security · Computer Science 2019-01-08 Bin Liang , Hongcheng Li , Miaoqiang Su , Pan Bian , Xirong Li , Wenchang Shi

Recent work has explored integrating autoregressive language models with energy-based models (EBMs) to enhance text generation capabilities. However, learning effective EBMs for text is challenged by the discrete nature of language. This…

Computation and Language · Computer Science 2023-11-14 Xuwang Yin

Following great success in the image processing field, the idea of adversarial training has been applied to tasks in the natural language processing (NLP) field. One promising approach directly applies adversarial training developed in the…

Machine Learning · Computer Science 2018-05-09 Motoki Sato , Jun Suzuki , Hiroyuki Shindo , Yuji Matsumoto

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

Computation and Language · Computer Science 2023-07-25 Neel Bhandari , Pin-Yu Chen

Large language models have many beneficial applications, but can they also be used to attack content-filtering algorithms in social media platforms? We investigate the challenge of generating adversarial examples to test the robustness of…

Computation and Language · Computer Science 2025-09-04 Piotr Przybyła , Euan McGill , Horacio Saggion

Adversarial attacks against machine learning models have threatened various real-world applications such as spam filtering and sentiment analysis. In this paper, we propose a novel framework, learning to DIScriminate Perturbations (DISP),…

Computation and Language · Computer Science 2019-09-10 Yichao Zhou , Jyun-Yu Jiang , Kai-Wei Chang , Wei Wang

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

Computation and Language · Computer Science 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

We propose to generate adversarial samples by modifying activations of upper layers encoding semantically meaningful concepts. The original sample is shifted towards a target sample, yielding an adversarial sample, by using the modified…

Machine Learning · Computer Science 2022-03-22 Johannes Schneider , Giovanni Apruzzese

Word-level adversarial attacks have shown success in NLP models, drastically decreasing the performance of transformer-based models in recent years. As a countermeasure, adversarial defense has been explored, but relatively few efforts have…

Computation and Language · Computer Science 2022-03-04 KiYoon Yoo , Jangho Kim , Jiho Jang , Nojun Kwak

Adversarial purification is a defense mechanism for safeguarding classifiers against adversarial attacks without knowing the type of attacks or training of the classifier. These techniques characterize and eliminate adversarial…

Cryptography and Security · Computer Science 2024-02-13 Raha Moraffah , Shubh Khandelwal , Amrita Bhattacharjee , Huan Liu

We design, implement, and evaluate adversarial decoding, a new, generic text generation technique that produces readable documents for different adversarial objectives. Prior methods either produce easily detectable gibberish, or cannot…

Computation and Language · Computer Science 2025-03-07 Collin Zhang , Tingwei Zhang , Vitaly Shmatikov