English
Related papers

Related papers: White-to-Black: Efficient Distillation of Black-Bo…

200 papers

We study an important task of attacking natural language processing models in a black box setting. We propose an attack strategy that crafts semantically similar adversarial examples on text classification and entailment tasks. Our proposed…

Computation and Language · Computer Science 2020-12-25 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Deep learning models are known to be vulnerable to adversarial examples. A practical adversarial attack should require as little as possible knowledge of attacked models. Current substitute attacks need pre-trained models to generate…

Cryptography and Security · Computer Science 2020-04-01 Mingyi Zhou , Jing Wu , Yipeng Liu , Xiaolin Huang , Shuaicheng Liu , Xiang Zhang , Ce Zhu

In the scenario of black-box adversarial attack, the target model's parameters are unknown, and the attacker aims to find a successful adversarial perturbation based on query feedback under a query budget. Due to the limited feedback…

Machine Learning · Computer Science 2023-01-03 Fei Yin , Yong Zhang , Baoyuan Wu , Yan Feng , Jingyi Zhang , Yanbo Fan , Yujiu Yang

Deep neural networks (DNNs) have been found to be vulnerable to adversarial examples resulting from adding small-magnitude perturbations to inputs. Such adversarial examples can mislead DNNs to produce adversary-selected results. Different…

Cryptography and Security · Computer Science 2019-02-15 Chaowei Xiao , Bo Li , Jun-Yan Zhu , Warren He , Mingyan Liu , Dawn Song

Adversarial attacks against Deep Neural Networks have been widely studied. One significant feature that makes such attacks particularly powerful is transferability, where the adversarial examples generated from one model can be effective…

Cryptography and Security · Computer Science 2020-09-29 Renzhi Wang , Tianwei Zhang , Xiaofei Xie , Lei Ma , Cong Tian , Felix Juefei-Xu , Yang Liu

Modern applications of artificial neural networks have yielded remarkable performance gains in a wide range of tasks. However, recent studies have discovered that such modelling strategy is vulnerable to Adversarial Examples, i.e. examples…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 João Monteiro , Isabela Albuquerque , Zahid Akhtar , Tiago H. Falk

Powerful adversarial attack methods are vital for understanding how to construct robust deep neural networks (DNNs) and for thoroughly testing defense techniques. In this paper, we propose a black-box adversarial attack algorithm that can…

Machine Learning · Computer Science 2019-12-11 Yandong Li , Lijun Li , Liqiang Wang , Tong Zhang , Boqing Gong

We consider adversarial examples for image classification in the black-box decision-based setting. Here, an attacker cannot access confidence scores, but only the final label. Most attacks for this scenario are either unreliable or…

Machine Learning · Statistics 2021-04-30 Thomas Brunner , Frederik Diehl , Michael Truong Le , Alois Knoll

Deep neural network classifiers suffer from adversarial vulnerability: well-crafted, unnoticeable changes to the input data can affect the classifier decision. In this regard, the study of powerful adversarial attacks can help shed light on…

Machine Learning · Computer Science 2020-07-07 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

The success of deep learning research has catapulted deep models into production systems that our society is becoming increasingly dependent on, especially in the image and video domains. However, recent work has shown that these largely…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Nathan Inkawhich , Matthew Inkawhich , Yiran Chen , Hai Li

We introduce a grey-box adversarial attack and defence framework for sentiment classification. We address the issues of differentiability, label preservation and input reconstruction for adversarial attack and defence in one unified…

Machine Learning · Computer Science 2021-03-23 Ying Xu , Xu Zhong , Antonio Jimeno Yepes , Jey Han Lau

Deep neural networks are powerful and popular learning models that achieve state-of-the-art pattern recognition performance on many computer vision, speech, and language processing tasks. However, these networks have also been shown…

Machine Learning · Computer Science 2016-12-20 Nina Narodytska , Shiva Prasad Kasiviswanathan

We propose the first general-purpose gradient-based attack against transformer models. Instead of searching for a single adversarial example, we search for a distribution of adversarial examples parameterized by a continuous-valued matrix,…

Computation and Language · Computer Science 2021-04-29 Chuan Guo , Alexandre Sablayrolles , Hervé Jégou , Douwe Kiela

Recent research has proved that deep neural networks (DNNs) are vulnerable to adversarial examples, the legitimate input added with imperceptible and well-designed perturbations can fool DNNs easily in the testing stage. However, most of…

Machine Learning · Computer Science 2021-01-26 Yixiang Wang , Jiqiang Liu , Xiaolin Chang

We study adversarial examples in a black-box setting where the adversary only has API access to the target model and each query is expensive. Prior work on black-box adversarial examples follows one of two main strategies: (1) transfer…

Cryptography and Security · Computer Science 2019-12-03 Fnu Suya , Jianfeng Chi , David Evans , Yuan Tian

We present a new method for black-box adversarial attack. Unlike previous methods that combined transfer-based and scored-based methods by using the gradient or initialization of a surrogate white-box model, this new method tries to learn a…

Machine Learning · Computer Science 2020-01-07 Zhichao Huang , Tong Zhang

Evaluating on adversarial examples has become a standard procedure to measure robustness of deep learning models. Due to the difficulty of creating white-box adversarial examples for discrete text input, most analyses of the robustness of…

Computation and Language · Computer Science 2018-06-26 Javid Ebrahimi , Daniel Lowd , Dejing Dou

The adversarial machine learning literature is largely partitioned into evasion attacks on testing data and poisoning attacks on training data. In this work, we show that adversarial examples, originally intended for attacking pre-trained…

Machine Learning · Computer Science 2021-06-22 Liam Fowl , Micah Goldblum , Ping-yeh Chiang , Jonas Geiping , Wojtek Czaja , Tom Goldstein

Adversarial examples are artificially modified input samples which lead to misclassifications, while not being detectable by humans. These adversarial examples are a challenge for many tasks such as image and text classification, especially…

Computation and Language · Computer Science 2019-08-22 Marcus Soll , Tobias Hinz , Sven Magg , Stefan Wermter

Due to their complex nature, it is hard to characterize the ways in which machine learning models can misbehave or be exploited when deployed. Recent work on adversarial examples, i.e. inputs with minor perturbations that result in…

Machine Learning · Computer Science 2018-02-27 Zhengli Zhao , Dheeru Dua , Sameer Singh