English
Related papers

Related papers: Query-Efficient Black-box Adversarial Attacks Guid…

200 papers

Enhancing our understanding of adversarial examples is crucial for the secure application of machine learning models in real-world scenarios. A prevalent method for analyzing adversarial examples is through a frequency-based approach.…

Machine Learning · Computer Science 2024-04-17 Zhun Zhang , Yi Zeng , Qihe Liu , Shijie Zhou

Depending on how much information an adversary can access to, adversarial attacks can be classified as white-box attack and black-box attack. For white-box attack, optimization-based attack algorithms such as projected gradient descent…

Machine Learning · Computer Science 2019-09-17 Jinghui Chen , Dongruo Zhou , Jinfeng Yi , Quanquan Gu

We present a method for adversarial input generation against black box models for reading comprehension based question answering. Our approach is composed of two steps. First, we approximate a victim black box model via model extraction…

Machine Learning · Computer Science 2020-11-03 Naveen Jafer Nizar , Ari Kobren

A hard challenge in developing practical face recognition (FR) attacks is due to the black-box nature of the target FR model, i.e., inaccessible gradient and parameter information to attackers. While recent research took an important step…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Zexin Li , Bangjie Yin , Taiping Yao , Juefeng Guo , Shouhong Ding , Simin Chen , Cong Liu

Current black-box adversarial attacks either require multiple queries or diffusion models to produce adversarial samples that can impair the target model performance. However, these methods require training a surrogate loss or diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Joana C. Costa , Tiago Roxo , Hugo Proença , Pedro R. M. Inácio

Neural networks have become pervasive across various applications, including security-related products. However, their widespread adoption has heightened concerns regarding vulnerability to adversarial attacks. With emerging regulations and…

Cryptography and Security · Computer Science 2025-11-10 Disesdi Susanna Cox , Niklas Bunzel

We demonstrate that model-based derivative free optimisation algorithms can generate adversarial targeted misclassification of deep networks using fewer network queries than non-model-based methods. Specifically, we consider the black-box…

Machine Learning · Computer Science 2020-02-25 Giuseppe Ughi , Vinayak Abrol , Jared Tanner

Adversarial attacks pose significant challenges for detecting adversarial attacks at an early stage. We propose attack-agnostic detection on reinforcement learning-based interactive recommendation systems. We first craft adversarial…

Machine Learning · Computer Science 2020-06-16 Yuanjiang Cao , Xiaocong Chen , Lina Yao , Xianzhi Wang , Wei Emma Zhang

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

Machine Learning · Computer Science 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Recent work has shown it is possible to construct adversarial examples that cause an aligned language model to emit harmful strings or perform harmful behavior. Existing attacks work either in the white-box setting (with full access to the…

Computation and Language · Computer Science 2024-12-10 Jonathan Hayase , Ema Borevkovic , Nicholas Carlini , Florian Tramèr , Milad Nasr

Face Recognition (FR) models have been shown to be vulnerable to adversarial examples that subtly alter benign facial images, exposing blind spots in these systems, as well as protecting user privacy. End-to-end FR systems first obtain…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Roland Croft , Brian Du , Darcy Joseph , Sharath Kumar

Deep learning models suffer from a phenomenon called adversarial attacks: we can apply minor changes to the model input to fool a classifier for a particular example. The literature mostly considers adversarial attacks on models with images…

Machine Learning · Computer Science 2020-10-13 Ivan Fursov , Alexey Zaytsev , Nikita Kluchnikov , Andrey Kravchenko , Evgeny Burnaev

Adversarial examples are of wide concern due to their impact on the reliability of contemporary machine learning systems. Effective adversarial examples are mostly found via white-box attacks. However, in some cases they can be transferred…

Machine Learning · Computer Science 2019-07-16 Deyan Petrov , Timothy M. Hospedales

Transferable adversarial attack is always in the spotlight since deep learning models have been demonstrated to be vulnerable to adversarial samples. However, existing physical attack methods do not pay enough attention on transferability…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yu Zhang , Zhiqiang Gong , Yichuang Zhang , YongQian Li , Kangcheng Bin , Jiahao Qi , Wei Xue , Ping Zhong

Machine learning security has recently become a prominent topic in the natural language processing (NLP) area. The existing black-box adversarial attack suffers prohibitively from the high model querying complexity, resulting in easily…

Cryptography and Security · Computer Science 2023-10-17 Wenjie Lv , Zhen Wang , Yitao Zheng , Zhehua Zhong , Qi Xuan , Tianyi Chen

Adversarial attacks on deep neural networks traditionally rely on a constrained optimization paradigm, where an optimization procedure is used to obtain a single adversarial perturbation for a given input example. In this work we frame the…

Machine Learning · Computer Science 2020-01-22 Avishek Joey Bose , Andre Cianflone , William L. Hamilton

Vision transformers (ViTs) have been successfully deployed in a variety of computer vision tasks, but they are still vulnerable to adversarial samples. Transfer-based attacks use a local model to generate adversarial samples and directly…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Jianping Zhang , Yizhan Huang , Weibin Wu , Michael R. Lyu

The transferability of adversarial examples across deep neural networks (DNNs) is the crux of many black-box attacks. Many prior efforts have been devoted to improving the transferability via increasing the diversity in inputs of some…

Machine Learning · Computer Science 2023-07-20 Qizhang Li , Yiwen Guo , Wangmeng Zuo , Hao Chen

Deep learning has come a long way and has enjoyed an unprecedented success. Despite high accuracy, however, deep models are brittle and are easily fooled by imperceptible adversarial perturbations. In contrast to common inference-time…

Computer Vision and Pattern Recognition · Computer Science 2020-05-14 Ali Borji

Despite the huge success of Deep Neural Networks (DNNs) in a wide spectrum of machine learning and data mining tasks, recent research shows that this powerful tool is susceptible to maliciously crafted adversarial examples. Up until now,…

Cryptography and Security · Computer Science 2020-02-07 Zhuanghua Liu , Ivor W. Tsang