English
Related papers

Related papers: Generating Textual Adversaries with Minimal Pertur…

200 papers

The increasing capabilities of Large Language Models (LLMs) have raised concerns about their misuse in AI-generated plagiarism and social engineering. While various AI-generated text detectors have been proposed to mitigate these risks,…

Computation and Language · Computer Science 2025-10-31 Yize Cheng , Vinu Sankar Sadasivan , Mehrdad Saberi , Shoumik Saha , Soheil Feizi

In text classification, creating an adversarial example means subtly perturbing a few words in a sentence without changing its meaning, causing it to be misclassified by a classifier. A concerning observation is that a significant portion…

Computation and Language · Computer Science 2025-07-15 Lei Xu , Sarah Alnegheimish , Laure Berti-Equille , Alfredo Cuesta-Infante , Kalyan Veeramachaneni

This paper introduces a novel adversarial algorithm for attacking the state-of-the-art speech-to-text systems, namely DeepSpeech, Kaldi, and Lingvo. Our approach is based on developing an extension for the conventional distortion condition…

Sound · Computer Science 2021-03-16 Mohammad Esmaeilpour , Patrick Cardinal , Alessandro Lameiras Koerich

In this paper, we propose novel generative models for creating adversarial examples, slightly perturbed images resembling natural images but maliciously crafted to fool pre-trained models. We present trainable deep neural networks for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Omid Poursaeed , Isay Katsman , Bicheng Gao , Serge Belongie

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

Machine Learning · Computer Science 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Many adversarial attacks target natural language processing systems, most of which succeed through modifying the individual tokens of a document. Despite the apparent uniqueness of each of these attacks, fundamentally they are simply a…

Computation and Language · Computer Science 2024-01-09 Tom Roth , Yansong Gao , Alsharif Abuadbba , Surya Nepal , Wei Liu

Traditional adversarial attacks concentrate on manipulating clean examples in the pixel space by adding adversarial perturbations. By contrast, semantic adversarial attacks focus on changing semantic attributes of clean examples, such as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Chenan Wang , Jinhao Duan , Chaowei Xiao , Edward Kim , Matthew Stamm , Kaidi Xu

Adversarial attacks on machine learning algorithms have been a key deterrent to the adoption of AI in many real-world use cases. They significantly undermine the ability of high-performance neural networks by forcing misclassifications.…

Machine Learning · Computer Science 2024-04-04 Nandish Chattopadhyay , Atreya Goswami , Anupam Chattopadhyay

Adversarial examples pose a significant challenge to deep neural networks (DNNs) across both image and text domains, with the intent to degrade model performance through meticulously altered inputs. Adversarial texts, however, are distinct…

Machine Learning · Computer Science 2025-01-24 Shakila Mahjabin Tonni , Pedro Faustini , Mark Dras

Text-based adversarial attacks are becoming more commonplace and accessible to general internet users. As these attacks proliferate, the need to address the gap in model robustness becomes imminent. While retraining on adversarial data may…

Computation and Language · Computer Science 2022-06-10 Joanna Bitton , Maya Pavlova , Ivan Evtimov

This paper introduces a novel adversarial attack method targeting text classification models, termed the Modified Word Saliency-based Adversarial At-tack (MWSAA). The technique builds upon the concept of word saliency to strategically…

Computation and Language · Computer Science 2025-05-13 Hetvi Waghela , Sneha Rakshit , Jaydip Sen

Neural text detectors aim to decide the characteristics that distinguish neural (machine-generated) from human texts. To challenge such detectors, adversarial attacks can alter the statistical characteristics of the generated text, making…

Cryptography and Security · Computer Science 2023-02-14 Gongbo Liang , Jesus Guerrero , Izzat Alsmadi

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

Computation and Language · Computer Science 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li

The research field of adversarial machine learning witnessed a significant interest in the last few years. A machine learner or model is secure if it can deliver main objectives with acceptable accuracy, efficiency, etc. while at the same…

Machine Learning · Computer Science 2021-01-22 Izzat Alsmadi

Standard accuracy metrics have shown that Math Word Problem (MWP) solvers have achieved high performance on benchmark datasets. However, the extent to which existing MWP solvers truly understand language and its relation with numbers is…

Computation and Language · Computer Science 2021-09-14 Vivek Kumar , Rishabh Maheshwary , Vikram Pudi

Current adversarial attack research reveals the vulnerability of learning-based classifiers against carefully crafted perturbations. However, most existing attack methods have inherent limitations in cross-dataset generalization as they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Cheng Luo , Qinliang Lin , Weicheng Xie , Bizhu Wu , Jinheng Xie , Linlin Shen

Adversarial attacks can generate adversarial inputs by applying small but intentionally worst-case perturbations to samples from the dataset, which leads to even state-of-the-art deep neural networks outputting incorrect answers with high…

Machine Learning · Computer Science 2024-01-08 Shorya Sharma

Adversarial ranking attacks have gained increasing attention due to their success in probing vulnerabilities, and, hence, enhancing the robustness, of neural ranking models. Conventional attack methods employ perturbations at a single…

Information Retrieval · Computer Science 2024-04-12 Yu-An Liu , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

Text classifiers are vulnerable to adversarial examples -- correctly-classified examples that are deliberately transformed to be misclassified while satisfying acceptability constraints. The conventional approach to finding adversarial…

Computation and Language · Computer Science 2024-05-21 Tom Roth , Inigo Jauregi Unanue , Alsharif Abuadbba , Massimo Piccardi

We propose a novel gradient-based attack against transformer-based language models that searches for an adversarial example in a continuous space of token probabilities. Our algorithm mitigates the gap between adversarial loss for…

Computation and Language · Computer Science 2023-02-13 Piotr Gaiński , Klaudia Bałazy