English
Related papers

Related papers: Alignment and Adversarial Robustness: Are More Hum…

200 papers

Adversarial training has been proven to be an effective technique for improving the adversarial robustness of models. However, there seems to be an inherent trade-off between optimizing the model for accuracy and robustness. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Elahe Arani , Fahad Sarfraz , Bahram Zonooz

Adversarial datasets should validate AI robustness by providing samples on which humans perform well, but models do not. However, as models evolve, datasets can become obsolete. Measuring whether a dataset remains adversarial is hindered by…

Computation and Language · Computer Science 2025-02-20 Yoo Yeon Sung , Maharshi Gor , Eve Fleisig , Ishani Mondal , Jordan Lee Boyd-Graber

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu

The rapid development of machine learning (ML) and artificial intelligence (AI) applications requires the training of large numbers of models. This growing demand highlights the importance of training models without human supervision, while…

Machine Learning · Computer Science 2025-05-26 Alexey Boldyrev , Fedor Ratnikov , Andrey Shevelev

A Very recent trend has emerged to couple the notion of interpretability and adversarial robustness, unlike earlier efforts which solely focused on good interpretations or robustness against adversaries. Works have shown that adversarially…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Puneet Mangla , Vedant Singh , Vineeth N Balasubramanian

Non-adversarial robustness, also known as natural robustness, is a property of deep learning models that enables them to maintain performance even when faced with distribution shifts caused by natural variations in data. However, achieving…

Machine Learning · Computer Science 2023-05-25 Gorana Gojić , Vladimir Vincan , Ognjen Kundačina , Dragiša Mišković , Dinu Dragan

Neural Networks have been shown to be sensitive to common perturbations such as blur, Gaussian noise, rotations, etc. They are also vulnerable to some artificial malicious corruptions called adversarial examples. The adversarial examples…

Machine Learning · Computer Science 2019-10-10 Alfred Laugros , Alice Caplier , Matthieu Ospici

He et al. (2018) have called into question the utility of pre-training by showing that training from scratch can often yield similar performance to pre-training. We show that although pre-training may not improve performance on traditional…

Machine Learning · Computer Science 2019-10-22 Dan Hendrycks , Kimin Lee , Mantas Mazeika

Pretrained models from self-supervision are prevalently used in fine-tuning downstream tasks faster or for better accuracy. However, gaining robustness from pretraining is left unexplored. We introduce adversarial training into…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Tianlong Chen , Sijia Liu , Shiyu Chang , Yu Cheng , Lisa Amini , Zhangyang Wang

Current research on defending against adversarial examples focuses primarily on achieving robustness against a single attack type such as $\ell_2$ or $\ell_{\infty}$-bounded attacks. However, the space of possible perturbations is much…

Machine Learning · Computer Science 2024-10-10 Sihui Dai , Chong Xiang , Tong Wu , Prateek Mittal

Model fingerprinting has emerged as a promising paradigm for claiming model ownership. However, robustness evaluations of these schemes have mostly focused on benign perturbations such as incremental fine-tuning, model merging, and…

Cryptography and Security · Computer Science 2025-10-01 Anshul Nasery , Edoardo Contente , Alkin Kaz , Pramod Viswanath , Sewoong Oh

In adversarial machine learning, there was a common belief that robustness and accuracy hurt each other. The belief was challenged by recent studies where we can maintain the robustness and improve the accuracy. However, the other…

Machine Learning · Computer Science 2021-06-01 Jingfeng Zhang , Jianing Zhu , Gang Niu , Bo Han , Masashi Sugiyama , Mohan Kankanhalli

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

Computation and Language · Computer Science 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

Machine Learning · Computer Science 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Adversarial examples are a pervasive phenomenon of machine learning models where seemingly imperceptible perturbations to the input lead to misclassifications for otherwise statistically accurate models. In this paper we study how the…

Machine Learning · Computer Science 2020-02-11 Marc Khoury

The robustness of deep neural networks (DNNs) against adversarial attacks has been studied extensively in hopes of both better understanding how deep learning models converge and in order to ensure the security of these models in…

Machine Learning · Computer Science 2023-07-11 Jovon Craig , Josh Andle , Theodore S. Nowak , Salimeh Yasaei Sekeh

Deep computer vision systems being vulnerable to imperceptible and carefully crafted noise have raised questions regarding the robustness of their decisions. We take a step back and approach this problem from an orthogonal direction. We…

Computer Vision and Pattern Recognition · Computer Science 2019-04-18 Sadaf Gulshad , Jan Hendrik Metzen , Arnold Smeulders , Zeynep Akata

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nuoyan Zhou , Nannan Wang , Decheng Liu , Dawei Zhou , Xinbo Gao

Making classifiers robust to adversarial examples is hard. Thus, many defenses tackle the seemingly easier task of detecting perturbed inputs. We show a barrier towards this goal. We prove a general hardness reduction between detection and…

Machine Learning · Computer Science 2022-06-17 Florian Tramèr

This work tackles an intriguing and fundamental open challenge in representation learning: Given a well-trained deep learning model, can it be reprogrammed to enhance its robustness against adversarial or noisy input perturbations without…

Machine Learning · Computer Science 2024-10-08 Zhichao Hou , MohamadAli Torkamani , Hamid Krim , Xiaorui Liu