English
Related papers

Related papers: Single Word Change is All You Need: Using LLMs to …

200 papers

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

An adversarial attack paradigm explores various scenarios for the vulnerability of deep learning models: minor changes of the input can force a model failure. Most of the state of the art frameworks focus on adversarial attacks for images…

Machine Learning · Computer Science 2020-06-22 I. Fursov , A. Zaytsev , N. Kluchnikov , A. Kravchenko , E. Burnaev

Deep neural networks are vulnerable to adversarial attacks, where a small perturbation to an input alters the model prediction. In many cases, malicious inputs intentionally crafted for one model can fool another model. In this paper, we…

Machine Learning · Computer Science 2021-09-23 Liping Yuan , Xiaoqing Zheng , Yi Zhou , Cho-Jui Hsieh , Kai-wei Chang

Generating high-quality and interpretable adversarial examples in the text domain is a much more daunting task than it is in the image domain. This is due partly to the discrete nature of text, partly to the problem of ensuring that the…

Machine Learning · Computer Science 2019-05-31 Samuel Barham , Soheil Feizi

Currently, natural language processing (NLP) models are wildly used in various scenarios. However, NLP models, like all deep models, are vulnerable to adversarially generated text. Numerous works have been working on mitigating the…

Computation and Language · Computer Science 2023-02-14 Lujia Shen , Xuhong Zhang , Shouling Ji , Yuwen Pu , Chunpeng Ge , Xing Yang , Yanghe Feng

Recently, it has been shown that, in spite of the significant performance of deep neural networks in different fields, those are vulnerable to adversarial examples. In this paper, we propose a gradient-based adversarial attack against…

Computation and Language · Computer Science 2022-03-14 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

In malware behavioral analysis, the list of accessed and created files very often indicates whether the examined file is malicious or benign. However, malware authors are trying to avoid detection by generating random filenames and/or…

Machine Learning · Computer Science 2021-10-26 Marek Galovic , Branislav Bosansky , Viliam Lisy

Adversarial attacks are a type of attack on machine learning models where an attacker deliberately modifies the inputs to cause the model to make incorrect predictions. Adversarial attacks can have serious consequences, particularly in…

Machine Learning · Computer Science 2025-09-15 Prathyusha Devabhakthini , Sasmita Parida , Raj Mani Shukla , Suvendu Chandan Nayak , Tapadhir Das

For both human readers and pre-trained language models (PrLMs), lexical diversity may lead to confusion and inaccuracy when understanding the underlying semantic meanings of given sentences. By substituting complex words with simple…

Computation and Language · Computer Science 2021-01-01 Rongzhou Bao , Jiayi Wang , Zhuosheng Zhang , Hai Zhao

Discovering the existence of universal adversarial perturbations had large theoretical and practical impacts on the field of adversarial learning. In the text domain, most universal studies focused on adversarial prefixes which are added to…

Machine Learning · Computer Science 2022-06-22 Gallil Maimon , Lior Rokach

Language models can achieve high accuracy on natural language tasks such as NLI, but performance suffers on manually created adversarial examples. We investigate the performance of a language model trained on the Stanford Natural Language…

Computation and Language · Computer Science 2024-10-31 Chris Achard

In various real-world applications such as machine translation, sentiment analysis, and question answering, a pivotal role is played by NLP models, facilitating efficient communication and decision-making processes in domains ranging from…

Computation and Language · Computer Science 2024-04-09 Roopkatha Dey , Aivy Debnath , Sayak Kumar Dutta , Kaustav Ghosh , Arijit Mitra , Arghya Roy Chowdhury , Jaydip Sen

Large Language Models (LLMs) are valuable for text classification, but their vulnerabilities must not be disregarded. They lack robustness against adversarial examples, so it is pertinent to understand the impacts of different types of…

Computation and Language · Computer Science 2024-06-13 João Vitorino , Eva Maia , Isabel Praça

Current adversarial attack research reveals the vulnerability of learning-based classifiers against carefully crafted perturbations. However, most existing attack methods have inherent limitations in cross-dataset generalization as they…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Cheng Luo , Qinliang Lin , Weicheng Xie , Bizhu Wu , Jinheng Xie , Linlin Shen

The growth of hateful online content, or hate speech, has been associated with a global increase in violent crimes against minorities [23]. Harmful online content can be produced easily, automatically and anonymously. Even though, some form…

Computation and Language · Computer Science 2023-10-09 David Herel , Hugo Cisneros , Tomas Mikolov

Deep neural networks (DNNs) are vulnerable to adversarial examples, perturbations to correctly classified examples which can cause the model to misclassify. In the image domain, these perturbations are often virtually indistinguishable to…

Computation and Language · Computer Science 2018-09-26 Moustafa Alzantot , Yash Sharma , Ahmed Elgohary , Bo-Jhang Ho , Mani Srivastava , Kai-Wei Chang

Neural networks are part of many contemporary NLP systems, yet their empirical successes come at the price of vulnerability to adversarial attacks. Previous work has used adversarial training and data augmentation to partially mitigate such…

Computation and Language · Computer Science 2019-12-23 Po-Sen Huang , Robert Stanforth , Johannes Welbl , Chris Dyer , Dani Yogatama , Sven Gowal , Krishnamurthy Dvijotham , Pushmeet Kohli

What fundamentally distinguishes an adversarial attack from a misclassification due to limited model expressivity or finite data? In this work, we investigate this question in the setting of high-dimensional binary classification, where…

Machine Learning · Statistics 2025-06-17 Matteo Vilucchio , Lenka Zdeborová , Bruno Loureiro

Research on adversarial robustness in language models is currently fragmented across applications and attacks, obscuring shared vulnerabilities. In this work, we propose unifying the study of adversarial robustness in text scoring models…

Computation and Language · Computer Science 2026-02-03 Manveer Singh Tamber , Hosna Oyarhoseini , Jimmy Lin

Recent models have achieved human level performance on the Stanford Question Answering Dataset when using F1 scores to evaluate the reading comprehension task. Yet, teaching machines to comprehend text has not been solved in the general…

Computation and Language · Computer Science 2024-01-19 Ariel Marcus