English
Related papers

Related papers: CARBEN: Composite Adversarial Robustness Benchmark

200 papers

Textual adversarial attacks can discover models' weaknesses by adding semantic-preserved but misleading perturbations to the inputs. The long-lasting adversarial attack-and-defense arms race in Natural Language Processing (NLP) is…

Computation and Language · Computer Science 2023-05-31 Yangyi Chen , Hongcheng Gao , Ganqu Cui , Lifan Yuan , Dehan Kong , Hanlu Wu , Ning Shi , Bo Yuan , Longtao Huang , Hui Xue , Zhiyuan Liu , Maosong Sun , Heng Ji

Standard adversarial attacks change the predicted class label of a selected image by adding specially tailored small perturbations to its pixels. In contrast, a universal perturbation is an update that can be added to any image in a broad…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Ali Shafahi , Mahyar Najibi , Zheng Xu , John Dickerson , Larry S. Davis , Tom Goldstein

The field of adversarial robustness has attracted significant attention in machine learning. Contrary to the common approach of training models that are accurate in average case, it aims at training models that are accurate for worst case…

Machine Learning · Computer Science 2020-10-12 Oriol Barbany Mayor

The literature on adversarial attacks in computer vision typically focuses on pixel-level perturbations. These tend to be very difficult to interpret. Recent work that manipulates the latent representations of image generators to create…

Machine Learning · Computer Science 2023-09-12 Stephen Casper , Max Nadeau , Dylan Hadfield-Menell , Gabriel Kreiman

As responsible AI gains importance in machine learning algorithms, properties such as fairness, adversarial robustness, and causality have received considerable attention in recent years. However, despite their individual significance,…

Machine Learning · Computer Science 2023-08-21 Ahmad-Reza Ehyaei , Kiarash Mohammadi , Amir-Hossein Karimi , Samira Samadi , Golnoosh Farnadi

Almost all adversarial attacks are formulated to add an imperceptible perturbation to an image in order to fool a model. Here, we consider the opposite which is adversarial examples that can fool a human but not a model. A large enough and…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Ali Borji

Contrastive learning (CL) has recently emerged as an effective approach to learning representation in a range of downstream tasks. Central to this approach is the selection of positive (similar) and negative (dissimilar) sets to provide the…

Machine Learning · Computer Science 2021-10-25 Anh Bui , Trung Le , He Zhao , Paul Montague , Seyit Camtepe , Dinh Phung

Discrete adversarial attacks are symbolic perturbations to a language input that preserve the output label but lead to a prediction error. While such attacks have been extensively explored for the purpose of evaluating model robustness,…

Machine Learning · Computer Science 2021-11-02 Maor Ivgi , Jonathan Berant

Benefiting from the rapid development of deep learning, 2D and 3D computer vision applications are deployed in many safe-critical systems, such as autopilot and identity authentication. However, deep learning models are not trustworthy…

Machine Learning · Computer Science 2023-10-03 Yanjie Li , Bin Xie , Songtao Guo , Yuanyuan Yang , Bin Xiao

Deep learning models are widely employed in safety-critical applications yet remain susceptible to adversarial attacks -- imperceptible perturbations that can significantly degrade model performance. Conventional defense mechanisms…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Eylon Mizrahi , Raz Lapid , Moshe Sipper

Adversarial attacks have proved to be the major impediment in the progress on research towards reliable machine learning solutions. Carefully crafted perturbations, imperceptible to human vision, can be added to images to force…

Artificial Intelligence · Computer Science 2020-11-24 Nandish Chattopadhyay , Lionell Yip En Zhi , Bryan Tan Bing Xing , Anupam Chattopadhyay

While deep neural networks have achieved remarkable success in various computer vision tasks, they often fail to generalize to new domains and subtle variations of input images. Several defenses have been proposed to improve the robustness…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Omid Poursaeed , Tianxing Jiang , Harry Yang , Serge Belongie , SerNam Lim

Adversarial robustness refers to a model's ability to resist perturbation of inputs, while distribution robustness evaluates the performance of the model under data shifts. Although both aim to ensure reliable performance, prior work has…

Machine Learning · Computer Science 2026-01-26 Yipei Wang , Zhaoying Pan , Xiaoqian Wang

Owing to the susceptibility of deep learning systems to adversarial attacks, there has been a great deal of work in developing (both empirically and certifiably) robust classifiers. While most work has defended against a single type of…

Machine Learning · Computer Science 2020-07-30 Pratyush Maini , Eric Wong , J. Zico Kolter

Adversarial training has achieved substantial performance in defending image retrieval against adversarial examples. However, existing studies in deep metric learning (DML) still suffer from two major limitations: weak adversary and model…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Qiwei Tian , Chenhao Lin , Zhengyu Zhao , Qian Li , Chao Shen

In this paper we establish rigorous benchmarks for image classifier robustness. Our first benchmark, ImageNet-C, standardizes and expands the corruption robustness topic, while showing which classifiers are preferable in safety-critical…

Machine Learning · Computer Science 2019-04-01 Dan Hendrycks , Thomas Dietterich

Deep neural networks are capable of state-of-the-art performance in many classification tasks. However, they are known to be vulnerable to adversarial attacks -- small perturbations to the input that lead to a change in classification. We…

Artificial Intelligence · Computer Science 2023-06-06 Lucas Beerens , Desmond J. Higham

The vulnerability of machine learning models to adversarial attacks remains a critical security challenge. Traditional defenses, such as adversarial training, typically robustify models by minimizing a worst-case loss. However, these…

Machine Learning · Statistics 2025-10-13 Pablo G. Arce , Roi Naveiro , David Ríos Insua

Deep learning models, while achieving state-of-the-art performance on many tasks, are susceptible to adversarial attacks that exploit inherent vulnerabilities in their architectures. Adversarial attacks manipulate the input data with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Shreyasi Mandal

Robustness to adversarial perturbations has been explored in many areas of computer vision. This robustness is particularly relevant in vision-based reinforcement learning, as the actions of autonomous agents might be safety-critic or…

Machine Learning · Computer Science 2022-08-23 Eugene Bykovets , Yannick Metz , Mennatallah El-Assady , Daniel A. Keim , Joachim M. Buhmann