English
Related papers

Related papers: Position: Towards Resilience Against Adversarial E…

200 papers

Deep neural networks have been successfully applied in various machine learning tasks. However, studies show that neural networks are susceptible to adversarial attacks. This exposes a potential threat to neural network-based intelligent…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Haimin Zhang , Min Xu

Defending against adversarial examples remains an open problem. A common belief is that randomness at inference increases the cost of finding adversarial inputs. An example of such a defense is to apply a random transformation to inputs…

Machine Learning · Computer Science 2022-10-13 Yue Gao , Ilia Shumailov , Kassem Fawaz , Nicolas Papernot

Adversarial robustness is a critical measure of a neural network's ability to withstand adversarial attacks at inference time. While robust training techniques have improved defenses against individual $\ell_p$-norm attacks (e.g., $\ell_2$…

Artificial Intelligence · Computer Science 2025-08-26 Ren Wang , Yuxuan Li , Can Chen , Dakuo Wang , Jinjun Xiong , Pin-Yu Chen , Sijia Liu , Mohammad Shahidehpour , Alfred Hero

Recent continual learning approaches have primarily focused on mitigating catastrophic forgetting. Nevertheless, two critical areas have remained relatively unexplored: 1) evaluating the robustness of proposed methods and 2) ensuring the…

Machine Learning · Computer Science 2023-10-10 Hikmat Khan , Pir Masoom Shah , Syed Farhan Alam Zaidi , Saif ul Islam , Qasim Zia

We propose algorithms to create adversarial attacks to assess model robustness in text classification problems. They can be used to create white box attacks and black box attacks while at the same time preserving the semantics and syntax of…

Computation and Language · Computer Science 2020-08-17 Rahul Singh , Tarun Joshi , Vijayan N. Nair , Agus Sudjianto

Despite the remarkable success of deep neural networks, significant concerns have emerged about their robustness to adversarial perturbations to inputs. While most attacks aim to ensure that these are imperceptible, physical perturbation…

Machine Learning · Computer Science 2020-10-09 Liang Tong , Minzhe Guo , Atul Prakash , Yevgeniy Vorobeychik

We explore adversarial robustness in the setting in which it is acceptable for a classifier to abstain---that is, output no class---on adversarial examples. Adversarial examples are small perturbations of normal inputs to a classifier that…

Machine Learning · Computer Science 2019-11-27 Cassidy Laidlaw , Soheil Feizi

Deep neural networks are highly vulnerable to adversarial examples, i.e.,small perturbations that can significantly degrade model performance. While adversarial training has become the primary defense strategy, most studies focus on…

Machine Learning · Computer Science 2026-05-14 Lilin Zhang , Yimo Guo , Yue Li , Jiancheng Shi , Xianggen Liu

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

Computation and Language · Computer Science 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran

Despite significant advances, deep networks remain highly susceptible to adversarial attack. One fundamental challenge is that small input perturbations can often produce large movements in the network's final-layer feature space. In this…

Machine Learning · Computer Science 2023-04-20 Maria-Florina Balcan , Avrim Blum , Dravyansh Sharma , Hongyang Zhang

Recent work has extensively shown that randomized perturbations of neural networks can improve robustness to adversarial attacks. The literature is, however, lacking a detailed compare-and-contrast of the latest proposals to understand what…

Machine Learning · Computer Science 2020-06-09 Adam Dziedzic , Sanjay Krishnan

Adversarial robustness evaluates the worst-case performance scenario of a machine learning model to ensure its safety and reliability. This study is the first to investigate the robustness of visually grounded dialog models towards textual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-07 Lu Yu , Verena Rieser

Adversarial attacks and defenses in machine learning and deep neural network have been gaining significant attention due to the rapidly growing applications of deep learning in the Internet and relevant scenarios. This survey provides a…

Machine Learning · Computer Science 2023-03-14 Yulong Wang , Tong Sun , Shenghong Li , Xin Yuan , Wei Ni , Ekram Hossain , H. Vincent Poor

Deep neural networks have been known to be vulnerable to adversarial examples, which are inputs that are modified slightly to fool the network into making incorrect predictions. This has led to a significant amount of research on evaluating…

Machine Learning · Computer Science 2024-12-10 Alireza Abdollahpoorrostam , Mahed Abroshan , Seyed-Mohsen Moosavi-Dezfooli

Crafting adversarial examples has become an important technique to evaluate the robustness of deep neural networks (DNNs). However, most existing works focus on attacking the image classification problem since its input space is continuous…

Machine Learning · Computer Science 2020-04-22 Minhao Cheng , Jinfeng Yi , Pin-Yu Chen , Huan Zhang , Cho-Jui Hsieh

Deep neural networks have been shown to suffer from a surprising weakness: their classification outputs can be changed by small, non-random perturbations of their inputs. This adversarial example phenomenon has been explained as originating…

Machine Learning · Computer Science 2016-08-30 Thomas Tanay , Lewis Griffin

Adversarial training provides a principled approach for training robust neural networks. From an optimization perspective, adversarial training is essentially solving a bilevel optimization problem. The leader problem is trying to learn a…

Machine Learning · Computer Science 2021-05-04 Haoming Jiang , Zhehui Chen , Yuyang Shi , Bo Dai , Tuo Zhao

In the field of high-energy physics, deep learning algorithms continue to gain in relevance and provide performance improvements over traditional methods, for example when identifying rare signals or finding complex patterns. From an…

High Energy Physics - Experiment · Physics 2026-05-15 Annika Stein

Recent work has demonstrated that neural networks are vulnerable to adversarial examples. To escape from the predicament, many works try to harden the model in various ways, in which adversarial training is an effective way which learns…

Machine Learning · Computer Science 2020-02-04 Kejiang Chen , Hang Zhou , Yuefeng Chen , Xiaofeng Mao , Yuhong Li , Yuan He , Hui Xue , Weiming Zhang , Nenghai Yu