English
Related papers

Related papers: Black-box Adversarial Attacks with Limited Queries…

200 papers

Assessing the robustness of deep neural networks against out-of-distribution inputs is crucial, especially in safety-critical domains like autonomous driving, but also in safety systems where malicious actors can digitally alter inputs to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Paul Gavrikov , Janis Keuper

Though deep neural networks have achieved state-of-the-art performance in visual classification, recent studies have shown that they are all vulnerable to the attack of adversarial examples. Small and often imperceptible perturbations to…

Machine Learning · Computer Science 2018-06-05 Pinlong Zhao , Zhouyu Fu , Ou wu , Qinghua Hu , Jun Wang

Machine learning (ML) models are known to be vulnerable to a number of attacks that target the integrity of their predictions or the privacy of their training data. To carry out these attacks, a black-box adversary must typically possess…

Cryptography and Security · Computer Science 2023-09-06 Dudi Biton , Aditi Misra , Efrat Levy , Jaidip Kotak , Ron Bitton , Roei Schuster , Nicolas Papernot , Yuval Elovici , Ben Nassi

Black-box adversarial attacks have demonstrated strong potential to compromise machine learning models by iteratively querying the target model or leveraging transferability from a local surrogate model. Recently, such attacks can be…

Machine Learning · Computer Science 2024-09-09 Hanbin Hong , Xinyu Zhang , Binghui Wang , Zhongjie Ba , Yuan Hong

Adversarial attacks have exposed a significant security vulnerability in state-of-the-art machine learning models. Among these models include deep reinforcement learning agents. The existing methods for attacking reinforcement learning…

Machine Learning · Computer Science 2020-01-17 Matthew Inkawhich , Yiran Chen , Hai Li

We study an important and challenging task of attacking natural language processing models in a hard label black box setting. We propose a decision-based attack strategy that crafts high quality adversarial examples on text classification…

Computation and Language · Computer Science 2021-04-30 Rishabh Maheshwary , Saket Maheshwary , Vikram Pudi

Deep neural networks (DNNs) are known for their vulnerability to adversarial examples. These are examples that have undergone small, carefully crafted perturbations, and which can easily fool a DNN into making misclassifications at test…

Machine Learning · Computer Science 2019-07-01 Linxi Jiang , Xingjun Ma , Shaoxiang Chen , James Bailey , Yu-Gang Jiang

Nowadays, autonomous driving has attracted much attention from both industry and academia. Convolutional neural network (CNN) is a key component in autonomous driving, which is also increasingly adopted in pervasive computing such as…

Signal Processing · Electrical Eng. & Systems 2020-02-07 Yao Deng , Xi Zheng , Tianyi Zhang , Chen Chen , Guannan Lou , Miryung Kim

The discovery of adversarial examples has raised concerns about the practical deployment of deep learning systems. In this paper, we demonstrate that adversarial examples are capable of manipulating deep learning systems across three…

Cryptography and Security · Computer Science 2019-02-05 Samuel G. Finlayson , Hyung Won Chung , Isaac S. Kohane , Andrew L. Beam

The landscape of adversarial attacks against text classifiers continues to grow, with new attacks developed every year and many of them available in standard toolkits, such as TextAttack and OpenAttack. In response, there is a growing body…

Computation and Language · Computer Science 2022-01-24 Zhouhang Xie , Jonathan Brophy , Adam Noack , Wencong You , Kalyani Asthana , Carter Perkins , Sabrina Reis , Sameer Singh , Daniel Lowd

A distribution inference attack aims to infer statistical properties of data used to train machine learning models. These attacks are sometimes surprisingly potent, but the factors that impact distribution inference risk are not well…

Machine Learning · Computer Science 2024-04-09 Anshuman Suri , Yifu Lu , Yanjin Chen , David Evans

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou

Deep Learning has become popular due to its vast applications in almost all domains. However, models trained using deep learning are prone to failure for adversarial samples and carry a considerable risk in sensitive applications. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Satyadwyoom Kumar , Saurabh Gupta , Arun Balaji Buduru

In recent years, Deep Learning(DL) techniques have been extensively deployed for computer vision tasks, particularly visual classification problems, where new algorithms reported to achieve or even surpass the human performance. While many…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Dou Goodman

Recent studies have revealed that vision transformers (ViTs) face similar security risks from adversarial attacks as deep convolutional neural networks (CNNs). However, directly applying attack methodology on CNNs to ViTs has been…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Chao Zhou , Xiaowen Shi , Yuan-Gen Wang

This paper considers attacks against machine learning algorithms used in remote sensing applications, a domain that presents a suite of challenges that are not fully addressed by current research focused on natural image data such as…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Wojciech Czaja , Neil Fendley , Michael Pekala , Christopher Ratto , I-Jeng Wang

Neural networks are vulnerable to adversarial examples, malicious inputs crafted to fool trained models. Adversarial examples often exhibit black-box transfer, meaning that adversarial examples for one model can fool another model. However,…

Machine Learning · Computer Science 2020-03-02 Qian Huang , Isay Katsman , Horace He , Zeqi Gu , Serge Belongie , Ser-Nam Lim

We study the most practical problem setup for evaluating adversarial robustness of a machine learning system with limited access: the hard-label black-box attack setting for generating adversarial examples, where limited model queries are…

Machine Learning · Computer Science 2020-02-17 Minhao Cheng , Simranjit Singh , Patrick Chen , Pin-Yu Chen , Sijia Liu , Cho-Jui Hsieh

We study the query-based attack against image retrieval to evaluate its robustness against adversarial examples under the black-box setting, where the adversary only has query access to the top-k ranked unlabeled images from the database.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Xiaodan Li , Jinfeng Li , Yuefeng Chen , Shaokai Ye , Yuan He , Shuhui Wang , Hang Su , Hui Xue

A wide range of defenses have been proposed to harden neural networks against adversarial attacks. However, a pattern has emerged in which the majority of adversarial defenses are quickly broken by new attacks. Given the lack of success at…

Machine Learning · Computer Science 2020-02-05 Ali Shafahi , W. Ronny Huang , Christoph Studer , Soheil Feizi , Tom Goldstein