English
Related papers

Related papers: A Simple Yet Efficient Method for Adversarial Word…

200 papers

Defenses against security threats have been an interest of recent studies. Recent works have shown that it is not difficult to attack a natural language processing (NLP) model while defending against them is still a cat-mouse game. Backdoor…

Cryptography and Security · Computer Science 2022-05-31 Sangeet Sagar , Abhinav Bhatt , Abhijith Srinivas Bidaralli

We focus on the problem of adversarial attacks against models on discrete sequential data in the black-box setting where the attacker aims to craft adversarial examples with limited query access to the victim model. Existing black-box…

Machine Learning · Computer Science 2022-06-20 Deokjae Lee , Seungyong Moon , Junhyeok Lee , Hyun Oh Song

In this paper, we present a generic, query-efficient black-box attack against API call-based machine learning malware classifiers. We generate adversarial examples by modifying the malware's API call sequences and non-sequential features…

Cryptography and Security · Computer Science 2020-10-06 Ishai Rosenberg , Asaf Shabtai , Yuval Elovici , Lior Rokach

An adversarial example is an input transformed by small perturbations that machine learning models consistently misclassify. While there are a number of methods proposed to generate adversarial examples for text data, it is not trivial to…

Computation and Language · Computer Science 2020-06-02 Ying Xu , Xu Zhong , Antonio Jose Jimeno Yepes , Jey Han Lau

Recent studies show that neural natural language processing (NLP) models are vulnerable to backdoor attacks. Injected with backdoors, models perform normally on benign examples but produce attacker-specified predictions when the backdoor is…

Computation and Language · Computer Science 2021-06-14 Fanchao Qi , Yuan Yao , Sophia Xu , Zhiyuan Liu , Maosong Sun

To launch black-box attacks against a Deep Neural Network (DNN) based Face Recognition (FR) system, one needs to build \textit{substitute} models to simulate the target model, so the adversarial examples discovered from substitute models…

Machine Learning · Computer Science 2018-08-23 Di Tang , XiaoFeng Wang , Kehuan Zhang

The use of large language models (LLMs) in peer review systems has attracted growing attention, making it essential to examine their potential vulnerabilities. Prior attacks rely on prompt injection, which alters manuscript content and…

Computation and Language · Computer Science 2026-01-13 Masahiro Kaneko

Machine learning has seen tremendous advances in the past few years, which has lead to deep learning models being deployed in varied applications of day-to-day life. Attacks on such models using perturbations, particularly in real-life…

Machine Learning · Computer Science 2020-02-10 Siddhant Bhambri , Sumanyu Muku , Avinash Tulasi , Arun Balaji Buduru

The transferability of adversarial examples across deep neural networks (DNNs) is the crux of many black-box attacks. Many prior efforts have been devoted to improving the transferability via increasing the diversity in inputs of some…

Machine Learning · Computer Science 2023-07-20 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Traditional decision-based black-box adversarial attacks on image classifiers aim to generate adversarial examples by slightly modifying input images while keeping the number of queries low, where each query involves sending an input to the…

Machine Learning · Computer Science 2025-06-10 Mahdi Salmani , Alireza Abdollahpoorrostam , Seyed-Mohsen Moosavi-Dezfooli

Adversarial attacks are carried out to reveal the vulnerability of deep neural networks. Textual adversarial attacking is challenging because text is discrete and a small perturbation can bring significant change to the original input.…

Computation and Language · Computer Science 2020-12-10 Yuan Zang , Fanchao Qi , Chenghao Yang , Zhiyuan Liu , Meng Zhang , Qun Liu , Maosong Sun

Existing textual adversarial attacks usually utilize the gradient or prediction confidence to generate adversarial examples, making it hard to be deployed in real-world applications. To this end, we consider a rarely investigated but more…

Computation and Language · Computer Science 2022-10-25 Zhen Yu , Xiaosen Wang , Wanxiang Che , Kun He

Machine Learning (ML) and Deep Learning (DL) models have achieved state-of-the-art performance on multiple learning tasks, from vision to natural language modelling. With the growing adoption of ML and DL to many areas of computer science,…

Machine Learning · Computer Science 2019-06-11 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

We propose the first general-purpose gradient-based attack against transformer models. Instead of searching for a single adversarial example, we search for a distribution of adversarial examples parameterized by a continuous-valued matrix,…

Computation and Language · Computer Science 2021-04-29 Chuan Guo , Alexandre Sablayrolles , Hervé Jégou , Douwe Kiela

In text classification, creating an adversarial example means subtly perturbing a few words in a sentence without changing its meaning, causing it to be misclassified by a classifier. A concerning observation is that a significant portion…

Computation and Language · Computer Science 2025-07-15 Lei Xu , Sarah Alnegheimish , Laure Berti-Equille , Alfredo Cuesta-Infante , Kalyan Veeramachaneni

Despite recent success on various tasks, deep learning techniques still perform poorly on adversarial examples with small perturbations. While optimization-based methods for adversarial attacks are well-explored in the field of computer…

Computation and Language · Computer Science 2023-06-09 Lifan Yuan , Yichi Zhang , Yangyi Chen , Wei Wei

Explainable AI is a strong strategy implemented to understand complex black-box model predictions in a human interpretable language. It provides the evidence required to execute the use of trustworthy and reliable AI systems. On the other…

Computation and Language · Computer Science 2025-03-12 Esther Chiramal , Kelvin Soh Boon Kai

Several years of research have shown that machine-learning systems are vulnerable to adversarial examples, both in theory and in practice. Until now, such attacks have primarily targeted visual models, exploiting the gap between human and…

Computation and Language · Computer Science 2021-12-14 Nicholas Boucher , Ilia Shumailov , Ross Anderson , Nicolas Papernot

We present a method for adversarial input generation against black box models for reading comprehension based question answering. Our approach is composed of two steps. First, we approximate a victim black box model via model extraction…

Machine Learning · Computer Science 2020-11-03 Naveen Jafer Nizar , Ari Kobren

Deep learning based systems are susceptible to adversarial attacks, where a small, imperceptible change at the input alters the model prediction. However, to date the majority of the approaches to detect these attacks have been designed for…

Computation and Language · Computer Science 2022-09-27 Vyas Raina , Mark Gales