English
Related papers

Related papers: Sample Attackability in Natural Language Adversari…

200 papers

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Pre-trained language models (PLMs) have been widely used to underpin various downstream tasks. However, the adversarial attack task has found that PLMs are vulnerable to small perturbations. Mainstream methods adopt a detached two-stage…

Computation and Language · Computer Science 2023-05-30 Xuanjie Fang , Sijie Cheng , Yang Liu , Wei Wang

Adversarial examples are inputs to machine learning models designed by an adversary to cause an incorrect output. So far, adversarial examples have been studied most extensively in the image domain. In this domain, adversarial examples can…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-10 Yao Qin , Nicholas Carlini , Ian Goodfellow , Garrison Cottrell , Colin Raffel

Deep neural networks have been shown to be vulnerable to adversarial examples deliberately constructed to misclassify victim models. As most adversarial examples have restricted their perturbations to $L_{p}$-norm, existing defense methods…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Hanieh Naderi , Leili Goli , Shohreh Kasaei

Extensive studies have demonstrated that deep neural networks (DNNs) are vulnerable to adversarial attacks. Despite the significant progress in the attack success rate that has been made recently, the adversarial noise generated by most of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Renyang Liu , Jinhong Zhang , Haoran Li , Jin Zhang , Yuanyu Wang , Wei Zhou

Although deep neural networks have achieved state-of-the-art performance in various machine learning tasks, adversarial examples, constructed by adding small non-random perturbations to correctly classified inputs, successfully fool highly…

Computation and Language · Computer Science 2022-05-02 Na Liu , Mark Dras , Wei Emma Zhang

Explanation methods have emerged as an important tool to highlight the features responsible for the predictions of neural networks. There is mounting evidence that many explanation methods are rather unreliable and susceptible to malicious…

Computation and Language · Computer Science 2022-06-27 Shriya Atmakuri , Tejas Chheda , Dinesh Kandula , Nishant Yadav , Taesung Lee , Hessel Tuinhof

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

Machine Learning · Statistics 2018-01-09 Martin Gubri

Evaluating on adversarial examples has become a standard procedure to measure robustness of deep learning models. Due to the difficulty of creating white-box adversarial examples for discrete text input, most analyses of the robustness of…

Computation and Language · Computer Science 2018-06-26 Javid Ebrahimi , Daniel Lowd , Dejing Dou

Language Models today provide a high accuracy across a large number of downstream tasks. However, they remain susceptible to adversarial attacks, particularly against those where the adversarial examples maintain considerable similarity to…

Computation and Language · Computer Science 2023-07-25 Neel Bhandari , Pin-Yu Chen

Deep Neural Networks (DNNs) have demonstrated exceptional performance on most recognition tasks such as image classification and segmentation. However, they have also been shown to be vulnerable to adversarial examples. This phenomenon has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Anurag Arnab , Ondrej Miksik , Philip H. S. Torr

Recent studies have revealed that NLP predictive models are vulnerable to adversarial attacks. Most existing studies focused on designing attacks to evaluate the robustness of NLP models in the English language alone. Literature has seen an…

Computation and Language · Computer Science 2023-06-09 Hanyu Liu , Chengyuan Cai , Yanjun Qi

Machine learning researchers have long noticed the phenomenon that the model training process will be more effective and efficient when the training samples are densely sampled around the underlying decision boundary. While this observation…

Machine Learning · Computer Science 2021-09-24 Honggang Yu , Shihfeng Zeng , Teng Zhang , Ing-Chao Lin , Yier Jin

Machine learning models are vulnerable to adversarial examples formed by applying small carefully chosen perturbations to inputs that cause unexpected classification errors. In this paper, we perform experiments on various adversarial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Andras Rozsa , Manuel Günther , Terrance E. Boult

Despite the recent advances in a wide spectrum of applications, machine learning models, especially deep neural networks, have been shown to be vulnerable to adversarial attacks. Attackers add carefully-crafted perturbations to input, where…

Machine Learning · Computer Science 2020-10-08 Ninghao Liu , Mengnan Du , Ruocheng Guo , Huan Liu , Xia Hu

The existence of adversarial examples has been a mystery for years and attracted much interest. A well-known theory by \citet{ilyas2019adversarial} explains adversarial vulnerability from a data perspective by showing that one can extract…

Machine Learning · Computer Science 2024-05-07 Ang Li , Yifei Wang , Yiwen Guo , Yisen Wang

This tutorial aims to introduce the fundamentals of adversarial robustness of deep learning, presenting a well-structured review of up-to-date techniques to assess the vulnerability of various types of deep learning models to adversarial…

Machine Learning · Computer Science 2021-08-25 Wenjie Ruan , Xinping Yi , Xiaowei Huang

Deep neural networks (DNNs) and natural language processing (NLP) systems have developed rapidly and have been widely used in various real-world fields. However, they have been shown to be vulnerable to backdoor attacks. Specifically, the…

Computation and Language · Computer Science 2023-01-26 Jiali Wei , Ming Fan , Wenjing Jiao , Wuxia Jin , Ting Liu

Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to…

Machine Learning · Computer Science 2020-10-23 Akhilan Boopathy , Sijia Liu , Gaoyuan Zhang , Cynthia Liu , Pin-Yu Chen , Shiyu Chang , Luca Daniel

DNA Language Models, such as GROVER, DNABERT2 and the Nucleotide Transformer, operate on DNA sequences that inherently contain sequencing errors, mutations, and laboratory-induced noise, which may significantly impact model performance.…

Computation and Language · Computer Science 2025-03-04 Hyunwoo Yoo , Haebin Shin , Kaidi Xu , Gail Rosen