English
Related papers

Related papers: Simple Black-box Adversarial Attacks

200 papers

Injecting adversarial examples during training, known as adversarial training, can improve robustness against one-step attacks, but not for unknown iterative attacks. To address this challenge, we first show iteratively generated…

Machine Learning · Statistics 2018-03-20 Taesik Na , Jong Hwan Ko , Saibal Mukhopadhyay

Current multi-task adversarial text attacks rely on abundant access to shared internal features and numerous queries, often limited to a single task type. As a result, these attacks are less effective against practical scenarios involving…

Cryptography and Security · Computer Science 2025-08-15 Wenqiang Wang , Yan Xiao , Hao Lin , Yangshijie Zhang , Xiaochun Cao

Recent advancements in diffusion models have enabled high-fidelity and photorealistic image generation across diverse applications. However, these models also present security and privacy risks, including copyright violations, sensitive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jiacheng Shi , Yanfu Zhang , Huajie Shao , Ashley Gao

The goal of No-Reference Image Quality Assessment (NR-IQA) is to predict the perceptual quality of an image in line with its subjective evaluation. To put the NR-IQA models into practice, it is essential to study their potential loopholes…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Yu Ran , Ao-Xiang Zhang , Mingjie Li , Weixuan Tang , Yuan-Gen Wang

Black-box hard-label adversarial attack on text is a practical and challenging task, as the text data space is inherently discrete and non-differentiable, and only the predicted label is accessible. Research on this problem is still in the…

Computation and Language · Computer Science 2024-02-06 Han Liu , Zhi Xu , Xiaotong Zhang , Feng Zhang , Fenglong Ma , Hongyang Chen , Hong Yu , Xianchao Zhang

Deep neural networks (DNNs) have achieved state-of-the-art performance in many tasks but have shown extreme vulnerabilities to attacks generated by adversarial examples. Many works go with a white-box attack that assumes total access to the…

Cryptography and Security · Computer Science 2022-03-10 Phoenix Williams , Ke Li

Watermarking techniques are vital for protecting intellectual property and preventing fraudulent use of media. Most previous watermarking schemes designed for diffusion models embed a secret key in the initial noise. The resulting pattern…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Anubhav Jain , Yuya Kobayashi , Naoki Murata , Yuhta Takida , Takashi Shibuya , Yuki Mitsufuji , Niv Cohen , Nasir Memon , Julian Togelius

We present a simple technique that allows capsule models to detect adversarial images. In addition to being trained to classify images, the capsule model is trained to reconstruct the images from the pose parameters and identity of the…

Machine Learning · Computer Science 2018-11-19 Nicholas Frosst , Sara Sabour , Geoffrey Hinton

Black-box query-based attacks constitute significant threats to Machine Learning as a Service (MLaaS) systems since they can generate adversarial examples without accessing the target model's architecture and parameters. Traditional defense…

Cryptography and Security · Computer Science 2025-06-27 Ping Guo , Xiang Li , Zhiyuan Yang , Xi Lin , Qingchuan Zhao , Qingfu Zhang

Deep neural networks are highly vulnerable to adversarial examples, which are inputs with small, carefully crafted perturbations that cause misclassification -- making adversarial attacks a critical tool for evaluating robustness. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Hanrui Wang , Ching-Chun Chang , Chun-Shien Lu , Christopher Leckie , Isao Echizen

Convolutional Neural Networks have achieved significant success across multiple computer vision tasks. However, they are vulnerable to carefully crafted, human-imperceptible adversarial noise patterns which constrain their deployment in…

Computer Vision and Pattern Recognition · Computer Science 2020-01-08 Aamir Mustafa , Salman H. Khan , Munawar Hayat , Jianbing Shen , Ling Shao

Deep neural networks have shown their vulnerability to adversarial attacks. In this paper, we focus on sparse adversarial attack based on the $\ell_0$ norm constraint, which can succeed by only modifying a few pixels of an image. Despite a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Ziwen He , Wei Wang , Jing Dong , Tieniu Tan

Deep neural networks are vulnerable to adversarial examples, even in the black-box setting, where the attacker is restricted solely to query access. Existing black-box approaches to generating adversarial examples typically require a…

Machine Learning · Computer Science 2019-07-02 Moustafa Alzantot , Yash Sharma , Supriyo Chakraborty , Huan Zhang , Cho-Jui Hsieh , Mani Srivastava

One way of designing a robust machine learning algorithm is to generate authentic adversarial images which can trick the algorithms as much as possible. In this study, we propose a new method to generate adversarial images which are very…

Image and Video Processing · Electrical Eng. & Systems 2020-01-31 Adil Kaan Akan , Mehmet Ali Genc , Fatos T. Yarman Vural

Deep neural networks can be exploited using natural adversarial samples, which do not impact human perception. Current approaches often rely on deep neural networks' white-box nature to generate these adversarial samples or synthetically…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Shashank Kotyan , Po-Yuan Mao , Pin-Yu Chen , Danilo Vasconcellos Vargas

Clustering algorithms are used in a large number of applications and play an important role in modern machine learning-- yet, adversarial attacks on clustering algorithms seem to be broadly overlooked unlike supervised learning. In this…

Machine Learning · Computer Science 2019-11-19 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

We introduce a feature scattering-based adversarial training approach for improving model robustness against adversarial attacks. Conventional adversarial training approaches leverage a supervised scheme (either targeted or non-targeted) in…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Haichao Zhang , Jianyu Wang

Adversarial examples have been demonstrated to threaten many computer vision tasks including object detection. However, the existing attacking methods for object detection have two limitations: poor transferability, which denotes that the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Xingxing Wei , Siyuan Liang , Ning Chen , Xiaochun Cao

In general, adversarial perturbations superimposed on inputs are realistic threats for a deep neural network (DNN). In this paper, we propose a practical generation method of such adversarial perturbation to be applied to black-box attacks…

Machine Learning · Computer Science 2020-02-19 Hisaichi Shibata , Shouhei Hanaoka , Yukihiro Nomura , Naoto Hayashi , Osamu Abe

While image-to-text models have demonstrated significant advancements in various vision-language tasks, they remain susceptible to adversarial attacks. Existing white-box attacks on image-to-text models require access to the architecture,…

Artificial Intelligence · Computer Science 2024-08-20 Qingyuan Zeng , Zhenzhong Wang , Yiu-ming Cheung , Min Jiang