English
Related papers

Related papers: MINIMAL: Mining Models for Data Free Universal Adv…

200 papers

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou

Machine learning models are susceptible to adversarial perturbations: small changes to input that can cause large changes in output. It is also demonstrated that there exist input-agnostic perturbations, called universal adversarial…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Konda Reddy Mopuri , Aditya Ganeshan , R. Venkatesh Babu

Adversarial examples are intentionally crafted data with the purpose of deceiving neural networks into misclassification. When we talk about strategies to create such examples, we usually refer to perturbation-based methods that fabricate…

Computer Vision and Pattern Recognition · Computer Science 2018-06-28 Shih-hong Tsai

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

Machine Learning · Computer Science 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Adversarial examples causing evasive predictions are widely used to evaluate and improve the robustness of machine learning models. However, current studies focus on supervised learning tasks, relying on the ground-truth data label, a…

Machine Learning · Computer Science 2021-12-09 Chia-Yi Hsu , Pin-Yu Chen , Songtao Lu , Sijia Liu , Chia-Mu Yu

Pre-trained language models (PLMs) have been widely used to underpin various downstream tasks. However, the adversarial attack task has found that PLMs are vulnerable to small perturbations. Mainstream methods adopt a detached two-stage…

Computation and Language · Computer Science 2023-05-30 Xuanjie Fang , Sijie Cheng , Yang Liu , Wei Wang

Deep neural networks (DNNs) are known vulnerable to adversarial attacks. That is, adversarial examples, obtained by adding delicately crafted distortions onto original legal inputs, can mislead a DNN to classify them as any target labels.…

Machine Learning · Computer Science 2018-04-11 Pu Zhao , Sijia Liu , Yanzhi Wang , Xue Lin

Adversarial examples are carefully constructed modifications to an input that completely change the output of a classifier but are imperceptible to humans. Despite these successful attacks for continuous data (such as image and audio…

Machine Learning · Computer Science 2019-04-08 Qi Lei , Lingfei Wu , Pin-Yu Chen , Alexandros G. Dimakis , Inderjit S. Dhillon , Michael Witbrock

The vulnerability of deep neural networks to adversarial examples has motivated an increasing number of defense strategies for promoting model robustness. However, the progress is usually hampered by insufficient robustness evaluations. As…

Machine Learning · Computer Science 2021-10-19 Xiao Yang , Yinpeng Dong , Wenzhao Xiang , Tianyu Pang , Hang Su , Jun Zhu

Many word-level adversarial attack approaches for textual data have been proposed in recent studies. However, due to the massive search space consisting of combinations of candidate words, the existing approaches face the problem of…

Computation and Language · Computer Science 2022-11-15 Xingyi Zhao , Lu Zhang , Depeng Xu , Shuhan Yuan

Neural networks are susceptible to adversarial examples-small input perturbations that cause models to fail. Adversarial training is one of the solutions that stops adversarial examples; models are exposed to attacks during training and…

Machine Learning · Computer Science 2022-07-05 Maximilian Kaufmann , Yiren Zhao , Ilia Shumailov , Robert Mullins , Nicolas Papernot

Popular Natural Language Inference (NLI) datasets have been shown to be tainted by hypothesis-only biases. Adversarial learning may help models ignore sensitive biases and spurious correlations in data. We evaluate whether adversarial…

Computation and Language · Computer Science 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

Adversarial examples, generated by applying small perturbations to input features, are widely used to fool classifiers and measure their robustness to noisy inputs. However, little work has been done to evaluate the robustness of ranking…

Information Retrieval · Computer Science 2020-08-06 Nisarg Raval , Manisha Verma

Adversarial attacks alter NLP model predictions by perturbing test-time inputs. However, it is much less understood whether, and how, predictions can be manipulated with small, concealed changes to the training data. In this work, we…

Computation and Language · Computer Science 2021-04-13 Eric Wallace , Tony Z. Zhao , Shi Feng , Sameer Singh

With the boom in the natural language processing (NLP) field these years, backdoor attacks pose immense threats against deep neural network models. However, previous works hardly consider the effect of the poisoning rate. In this paper, our…

Cryptography and Security · Computer Science 2023-11-27 Yueqi Zeng , Ziqiang Li , Pengfei Xia , Lei Liu , Bin Li

Natural Language Inference (NLI) datasets contain annotation artefacts resulting in spurious correlations between the natural language utterances and their respective entailment classes. These artefacts are exploited by neural networks even…

Machine Learning · Computer Science 2021-05-28 Joe Stacey , Pasquale Minervini , Haim Dubossarsky , Sebastian Riedel , Tim Rocktäschel

Machine Learning (ML) models are applied in a variety of tasks such as network intrusion detection or Malware classification. Yet, these models are vulnerable to a class of malicious inputs known as adversarial examples. These are slightly…

Cryptography and Security · Computer Science 2017-10-18 Kathrin Grosse , Praveen Manoharan , Nicolas Papernot , Michael Backes , Patrick McDaniel

Over the last few years, Contextualized Pre-trained Neural Language Models, such as BERT, GPT, have shown significant gains in various NLP tasks. To enhance the robustness of existing pre-trained models, one way is adversarial examples…

Computation and Language · Computer Science 2021-10-05 Wenqian Ye , Fei Xu , Yaojia Huang , Cassie Huang , Ji A

Recent research has revealed that natural language processing (NLP) models are vulnerable to adversarial examples. However, the current techniques for generating such examples rely on deterministic heuristic rules, which fail to produce…

Computation and Language · Computer Science 2023-12-29 Mingze Ni , Zhensu Sun , Wei Liu

Evaluating adversarial robustness amounts to finding the minimum perturbation needed to have an input sample misclassified. The inherent complexity of the underlying optimization requires current gradient-based attacks to be carefully…

Machine Learning · Computer Science 2021-11-22 Maura Pintor , Fabio Roli , Wieland Brendel , Battista Biggio