English
Related papers

Related papers: Breaking Free: How to Hack Safety Guardrails in Bl…

200 papers

It has been well demonstrated that adversarial examples, i.e., natural images with visually imperceptible perturbations added, generally exist for deep networks to fail on image classification. In this paper, we extend adversarial examples…

Computer Vision and Pattern Recognition · Computer Science 2017-07-24 Cihang Xie , Jianyu Wang , Zhishuai Zhang , Yuyin Zhou , Lingxi Xie , Alan Yuille

While a substantial body of prior work has explored adversarial example generation for natural language understanding tasks, these examples are often unrealistic and diverge from the real-world data distributions. In this work, we introduce…

Computation and Language · Computer Science 2022-11-09 Saadia Gabriel , Hamid Palangi , Yejin Choi

Deep computer vision systems being vulnerable to imperceptible and carefully crafted noise have raised questions regarding the robustness of their decisions. We take a step back and approach this problem from an orthogonal direction. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders , Zeynep Akata

Adversarial generative models, such as Generative Adversarial Networks (GANs), are widely applied for generating various types of data, i.e., images, text, and audio. Accordingly, its promising performance has led to the GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Zhiyu Zhu , Huaming Chen , Xinyi Wang , Jiayu Zhang , Zhibo Jin , Kim-Kwang Raymond Choo , Jun Shen , Dong Yuan

We consider adversarial examples for image classification in the black-box decision-based setting. Here, an attacker cannot access confidence scores, but only the final label. Most attacks for this scenario are either unreliable or…

Machine Learning · Statistics 2021-04-30 Thomas Brunner , Frederik Diehl , Michael Truong Le , Alois Knoll

Deep Learning has become popular due to its vast applications in almost all domains. However, models trained using deep learning are prone to failure for adversarial samples and carry a considerable risk in sensitive applications. Most of…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Satyadwyoom Kumar , Saurabh Gupta , Arun Balaji Buduru

Fooling deep neural networks (DNNs) with the black-box optimization has become a popular adversarial attack fashion, as the structural prior knowledge of DNNs is always unknown. Nevertheless, recent black-box adversarial attacks may…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Jie Wang , Zhaoxia Yin , Jing Jiang , Yang Du

Deep neural networks (DNNs) are vulnerable to adversarial examples, perturbations to correctly classified examples which can cause the model to misclassify. In the image domain, these perturbations are often virtually indistinguishable to…

Computation and Language · Computer Science 2018-09-26 Moustafa Alzantot , Yash Sharma , Ahmed Elgohary , Bo-Jhang Ho , Mani Srivastava , Kai-Wei Chang

Unrestricted adversarial examples (UAEs), allow the attacker to create non-constrained adversarial examples without given clean samples, posing a severe threat to the safety of deep learning models. Recent works utilize diffusion models to…

Machine Learning · Computer Science 2025-04-17 Zeyu Dai , Shengcai Liu , Rui He , Jiahao Wu , Ning Lu , Wenqi Fan , Qing Li , Ke Tang

Machine Learning (ML) and Deep Learning (DL) models have achieved state-of-the-art performance on multiple learning tasks, from vision to natural language modelling. With the growing adoption of ML and DL to many areas of computer science,…

Machine Learning · Computer Science 2019-06-11 Anshuman Chhabra , Abhishek Roy , Prasant Mohapatra

Adversarial attacks that generate small L_p-norm perturbations to mislead classifiers have limited success in black-box settings and with unseen classifiers. These attacks are also not robust to defenses that use denoising filters and to…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Ali Shahin Shamsabadi , Ricardo Sanchez-Matilla , Andrea Cavallaro

This paper proposes a black-box adversarial attack method to automatic speech recognition systems. Some studies have attempted to attack neural networks for speech recognition; however, these methods did not consider the robustness of…

Sound · Computer Science 2024-07-09 Shoma Ishida , Satoshi Ono

Recent studies have shown that attackers can force deep learning models to misclassify so-called "adversarial examples": maliciously generated images formed by making imperceptible modifications to pixel values. With growing interest in…

Cryptography and Security · Computer Science 2017-08-03 Andrew P. Norton , Yanjun Qi

Clustering algorithms play a fundamental role as tools in decision-making and sensible automation processes. Due to the widespread use of these applications, a robustness analysis of this family of algorithms against adversarial noise has…

Machine Learning · Computer Science 2021-11-11 Antonio Emanuele Cinà , Alessandro Torcinovich , Marcello Pelillo

The deep neural network is vulnerable to adversarial examples. Adding imperceptible adversarial perturbations to images is enough to make them fail. Most existing research focuses on attacking image classifiers or anchor-based object…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Quanyu Liao , Xin Wang , Bin Kong , Siwei Lyu , Youbing Yin , Qi Song , Xi Wu

The deep neural network (DNN) models for object detection using camera images are widely adopted in autonomous vehicles. However, DNN models are shown to be susceptible to adversarial image perturbations. In the existing methods of…

Robotics · Computer Science 2023-03-17 Hyung-Jin Yoon , Hamidreza Jafarnejadsani , Petros Voulgaris

Black box attacks, where adversaries have limited knowledge of the target model, pose a significant threat to machine learning systems. Adversarial examples generated with a substitute model often suffer from limited transferability to the…

Machine Learning · Computer Science 2024-10-22 Bar Avraham , Yisroel Mirsky

Neural networks are vulnerable to adversarial examples, which are malicious inputs crafted to fool pre-trained models. Adversarial examples often exhibit black-box attacking transferability, which allows that adversarial examples crafted…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 ZhaoXin Huan , Yulong Wang , Xiaolu Zhang , Lin Shang , Chilin Fu , Jun Zhou

Adversarial patch attacks pose a severe threat to deep neural networks, yet most existing approaches rely on unrealistic white-box assumptions, untargeted objectives, or produce visually conspicuous patches that limit real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Roie Kazoom , Alon Goldberg , Hodaya Cohen , Ofer Hadar

Deep neural networks (DNNs) have demonstrated impressive performance on many challenging machine learning tasks. However, DNNs are vulnerable to adversarial inputs generated by adding maliciously crafted perturbations to the benign inputs.…

Machine Learning · Computer Science 2019-10-29 Ka-Ho Chow , Wenqi Wei , Yanzhao Wu , Ling Liu