English
Related papers

Related papers: Identifying Adversarial Attacks on Text Classifier…

200 papers

Natural Language Processing (NLP) models based on Machine Learning (ML) are susceptible to adversarial attacks -- malicious algorithms that imperceptibly modify input text to force models into making incorrect predictions. However,…

Computation and Language · Computer Science 2023-05-26 Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy

Neural ranking models (NRMs) have undergone significant development and have become integral components of information retrieval (IR) systems. Unfortunately, recent research has unveiled the vulnerability of NRMs to adversarial document…

Information Retrieval · Computer Science 2023-08-01 Xuanang Chen , Ben He , Le Sun , Yingfei Sun

We propose algorithms to create adversarial attacks to assess model robustness in text classification problems. They can be used to create white box attacks and black box attacks while at the same time preserving the semantics and syntax of…

Computation and Language · Computer Science 2020-08-17 Rahul Singh , Tarun Joshi , Vijayan N. Nair , Agus Sudjianto

The burgeoning success of deep learning has raised the security and privacy concerns as more and more tasks are accompanied with sensitive data. Adversarial attacks in deep learning have emerged as one of the dominating security threat to a…

Machine Learning · Computer Science 2019-01-01 Wenqi Wei , Ling Liu , Margaret Loper , Stacey Truex , Lei Yu , Mehmet Emre Gursoy , Yanzhao Wu

Recent studies have shown that deep neural networks are vulnerable to intentionally crafted adversarial examples, and various methods have been proposed to defend against adversarial word-substitution attacks for neural NLP models. However,…

Computation and Language · Computer Science 2021-10-07 Zongyi Li , Jianhan Xu , Jiehang Zeng , Linyang Li , Xiaoqing Zheng , Qi Zhang , Kai-Wei Chang , Cho-Jui Hsieh

With the development of high computational devices, deep neural networks (DNNs), in recent years, have gained significant popularity in many Artificial Intelligence (AI) applications. However, previous efforts have shown that DNNs were…

Computation and Language · Computer Science 2019-04-12 Wei Emma Zhang , Quan Z. Sheng , Ahoud Alhazmi , Chenliang Li

Adversarial examples are input examples that are specifically crafted to deceive machine learning classifiers. State-of-the-art adversarial example detection methods characterize an input example as adversarial either by quantifying the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yuhang Wu , Sunpreet S. Arora , Yanhong Wu , Hao Yang

Neural Machine Translation (NMT) models have been shown to be vulnerable to adversarial attacks, wherein carefully crafted perturbations of the input can mislead the target model. In this paper, we introduce ACT, a novel adversarial attack…

Computation and Language · Computer Science 2024-02-23 Sahar Sadrizadeh , Ljiljana Dolamic , Pascal Frossard

This paper presents a framework which enables a user to more easily make corrections to adversarial texts. While attack algorithms have been demonstrated to automatically build adversaries, changes made by the algorithms can often have poor…

Human-Computer Interaction · Computer Science 2020-12-21 Brandon Laughlin , Christopher Collins , Karthik Sankaranarayanan , Khalil El-Khatib

An ever-growing body of work has demonstrated the rich information content available in eye movements for user modelling, e.g. for predicting users' activities, cognitive processes, or even personality traits. We show that state-of-the-art…

Cryptography and Security · Computer Science 2020-06-02 Inken Hagestedt , Michael Backes , Andreas Bulling

While there has been substantial research using adversarial attacks to analyze NLP models, each attack is implemented in its own code repository. It remains challenging to develop NLP attacks and utilize them to improve model performance.…

Computation and Language · Computer Science 2020-10-06 John X. Morris , Eli Lifland , Jin Yong Yoo , Jake Grigsby , Di Jin , Yanjun Qi

Machine learning algorithms are often vulnerable to adversarial examples that have imperceptible alterations from the original counterparts but can fool the state-of-the-art models. It is helpful to evaluate or even improve the robustness…

Computation and Language · Computer Science 2020-04-10 Di Jin , Zhijing Jin , Joey Tianyi Zhou , Peter Szolovits

Adversarial attacks refer to a set of methods that perturb the input to a classification model in order to fool the classifier. In this paper we apply different gradient based adversarial attack algorithms on five deep learning models…

Machine Learning · Computer Science 2019-08-16 Vinod Subramanian , Emmanouil Benetos , Ning Xu , SKoT McDonald , Mark Sandler

Adversarial attacks have emerged as a major challenge to the trustworthy deployment of machine learning models, particularly in computer vision applications. These attacks have a varied level of potency and can be implemented in both white…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Nandish Chattopadhyay , Abdul Basit , Bassem Ouni , Muhammad Shafique

Adversarial attack serves as a major challenge for neural network models in NLP, which precludes the model's deployment in safety-critical applications. A recent line of work, detection-based defense, aims to distinguish adversarial…

Computation and Language · Computer Science 2023-02-07 Lingfeng Shen , Ze Zhang , Haiyun Jiang , Ying Chen

Discovering the existence of universal adversarial perturbations had large theoretical and practical impacts on the field of adversarial learning. In the text domain, most universal studies focused on adversarial prefixes which are added to…

Machine Learning · Computer Science 2022-06-22 Gallil Maimon , Lior Rokach

Adversarial attacks dramatically change the output of an otherwise accurate learning system using a seemingly inconsequential modification to a piece of input data. Paradoxically, empirical evidence indicates that even systems which are…

Machine Learning · Computer Science 2024-09-13 Oliver J. Sutton , Qinghua Zhou , Ivan Y. Tyukin , Alexander N. Gorban , Alexander Bastounis , Desmond J. Higham

Adversarial attacks against machine learning models have threatened various real-world applications such as spam filtering and sentiment analysis. In this paper, we propose a novel framework, learning to DIScriminate Perturbations (DISP),…

Computation and Language · Computer Science 2019-09-10 Yichao Zhou , Jyun-Yu Jiang , Kai-Wei Chang , Wei Wang

Despite numerous attempts to defend deep learning based image classifiers, they remain susceptible to the adversarial attacks. This paper proposes a technique to identify susceptible classes, those classes that are more easily subverted. To…

Machine Learning · Computer Science 2019-06-03 Rangeet Pan , Md Johirul Islam , Shibbir Ahmed , Hridesh Rajan

Text-based adversarial attacks are becoming more commonplace and accessible to general internet users. As these attacks proliferate, the need to address the gap in model robustness becomes imminent. While retraining on adversarial data may…

Computation and Language · Computer Science 2022-06-10 Joanna Bitton , Maya Pavlova , Ivan Evtimov