English
Related papers

Related papers: GeoDA: a geometric framework for black-box adversa…

200 papers

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

Machine Learning · Computer Science 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial attacks, even in a black-box scenario. However, most of the existing black-box attack algorithms need to make a huge amount of queries to perform…

Machine Learning · Statistics 2018-09-11 Yali Du , Meng Fang , Jinfeng Yi , Jun Cheng , Dacheng Tao

Many studies have been done to prove the vulnerability of neural networks to adversarial example. A trained and well-behaved model can be fooled by a visually imperceptible perturbation, i.e., an originally correctly classified image could…

Computer Vision and Pattern Recognition · Computer Science 2019-06-24 YiGui Luo , RuiJia Yang , Wei Sha , WeiYi Ding , YouTeng Sun , YiSi Wang

Recent works have shown that deep neural networks are vulnerable to adversarial examples that find samples close to the original image but can make the model misclassify. Even with access only to the model's output, an attacker can employ…

Machine Learning · Computer Science 2023-10-03 Quang H. Nguyen , Yingjie Lao , Tung Pham , Kok-Seng Wong , Khoa D. Doan

We study the problem of attacking video recognition models in the black-box setting, where the model information is unknown and the adversary can only make queries to detect the predicted top-1 class and its probability. Compared with the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Zhipeng Wei , Jingjing Chen , Xingxing Wei , Linxi Jiang , Tat-Seng Chua , Fengfeng Zhou , Yu-Gang Jiang

In the last decade, deep neural networks have proven to be very powerful in computer vision tasks, starting a revolution in the computer vision and machine learning fields. However, deep neural networks, usually, are not robust to…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Hao Qiu , Leonardo Lucio Custode , Giovanni Iacca

Failure cases of black-box deep learning, e.g. adversarial examples, might have severe consequences in healthcare. Yet such failures are mostly studied in the context of real-world images with calibrated attacks. To demystify the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-14 David Kügler , Alexander Distergoft , Arjan Kuijper , Anirban Mukhopadhyay

Deep neural networks have recently achieved tremendous success in image classification. Recent studies have however shown that they are easily misled into incorrect classification decisions by adversarial examples. Adversaries can even…

Machine Learning · Computer Science 2019-03-27 Yujia Liu , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Jie Wang , Zhaoxia Yin , Jing Jiang , Yang Du

The evaluation of robustness against adversarial manipulation of neural networks-based classifiers is mainly tested with empirical attacks as methods for the exact computation, even when available, do not scale to large networks. We propose…

Machine Learning · Computer Science 2020-07-21 Francesco Croce , Matthias Hein

Generating adversarial examples in a black-box setting retains a significant challenge with vast practical application prospects. In particular, existing black-box attacks suffer from the need for excessive queries, as it is non-trivial to…

Computer Vision and Pattern Recognition · Computer Science 2020-05-11 Jie Li , Rongrong Ji , Hong Liu , Jianzhuang Liu , Bineng Zhong , Cheng Deng , Qi Tian

Researchers have repeatedly shown that it is possible to craft adversarial attacks on deep classifiers (small perturbations that significantly change the class label), even in the "black-box" setting where one only has query access to the…

Machine Learning · Computer Science 2021-02-02 Devin Willmott , Anit Kumar Sahu , Fatemeh Sheikholeslami , Filipe Condessa , Zico Kolter

The goal of this paper is to analyze the geometric properties of deep neural network classifiers in the input space. We specifically study the topology of classification regions created by deep networks, as well as their associated decision…

Computer Vision and Pattern Recognition · Computer Science 2017-05-29 Alhussein Fawzi , Seyed-Mohsen Moosavi-Dezfooli , Pascal Frossard , Stefano Soatto

Clustering algorithms play a fundamental role as tools in decision-making and sensible automation processes. Due to the widespread use of these applications, a robustness analysis of this family of algorithms against adversarial noise has…

Machine Learning · Computer Science 2021-11-11 Antonio Emanuele Cinà , Alessandro Torcinovich , Marcello Pelillo

We present a novel framework for generating adversarial benchmarks to evaluate the robustness of image classification models. Our framework allows users to customize the types of distortions to be optimally applied to images, which helps…

Adversarial training has been shown as an effective approach to improve the robustness of image classifiers against white-box attacks. However, its effectiveness against black-box attacks is more nuanced. In this work, we demonstrate that…

Machine Learning · Computer Science 2021-07-27 Ali Rahmati , Seyed-Mohsen Moosavi-Dezfooli , Huaiyu Dai

Black-box adversarial attack on vision-language pre-trained models is a practical and challenging task, as text and image perturbations need to be considered simultaneously, and only the predicted results are accessible. Research on this…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Han Liu , Jiaqi Li , Zhi Xu , Xiaotong Zhang , Xiaoming Xu , Fenglong Ma , Yuanman Li , Hong Yu

In this paper, we propose novel generative models for creating adversarial examples, slightly perturbed images resembling natural images but maliciously crafted to fool pre-trained models. We present trainable deep neural networks for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-09 Omid Poursaeed , Isay Katsman , Bicheng Gao , Serge Belongie

Many machine learning models are susceptible to adversarial attacks, with decision-based black-box attacks representing the most critical threat in real-world applications. These attacks are extremely stealthy, generating adversarial…

Machine Learning · Computer Science 2024-06-13 Feiyang Wang , Xingquan Zuo , Hai Huang , Gang Chen

The generation of feasible adversarial examples is necessary for properly assessing models that work in constrained feature space. However, it remains a challenging task to enforce constraints into attacks that were designed for computer…

Artificial Intelligence · Computer Science 2022-05-04 Thibault Simonetto , Salijona Dyrmishi , Salah Ghamizi , Maxime Cordy , Yves Le Traon