English
Related papers

Related papers: Improving the Adversarial Robustness of NLP Models…

200 papers

Adversarial attacks have received increasing attention and it has been widely recognized that classical DNNs have weak adversarial robustness. The most commonly used adversarial defense method, adversarial training, improves the adversarial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Nuolin Sun , Linyuan Wang , Dongyang Li , Bin Yan , Lei Li

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Deep neural networks (DNNs) are vulnerable to small adversarial perturbations, which are tiny changes to the input data that appear insignificant but cause the model to produce drastically different outputs. Many defense methods require…

Machine Learning · Computer Science 2025-07-01 Sedjro Salomon Hotegni , Sebastian Peitz

Deep neural networks have been shown to perform poorly on adversarial examples. To address this, several techniques have been proposed to increase robustness of a model for image classification tasks. However, in video understanding tasks,…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Divya Choudhary , Palash Goyal , Saurabh Sahu

Understanding how backdoor data influences neural network training dynamics remains a complex and underexplored challenge. In this paper, we present a rigorous analysis of the impact of backdoor data on the learning process, with a…

Machine Learning · Computer Science 2025-12-01 Xinyu Liu , Xu Zhang , Can Chen , Ren Wang

The Information Bottleneck (IB) principle facilitates effective representation learning by preserving label-relevant information while compressing irrelevant information. However, its strong reliance on accurate labels makes it inherently…

Machine Learning · Computer Science 2025-12-12 Yi Huang , Qingyun Sun , Yisen Gao , Haonan Yuan , Xingcheng Fu , Jianxin Li

The Information Bottleneck (IB) objective uses information theory to formulate a task-performance versus robustness trade-off. It has been successfully applied in the standard discriminative classification setting. We pose the question…

Machine Learning · Computer Science 2021-01-13 Lynton Ardizzone , Radek Mackowiak , Carsten Rother , Ullrich Köthe

Deep transformer neural network models have improved the predictive accuracy of intelligent text processing systems in the biomedical domain. They have obtained state-of-the-art performance scores on a wide variety of biomedical and…

Computation and Language · Computer Science 2021-11-17 Milad Moradi , Matthias Samwald

Modern Natural Language Processing (NLP) models are known to be sensitive to input perturbations and their performance can decrease when applied to real-world, noisy data. However, it is still unclear why models are less robust to some…

Computation and Language · Computer Science 2022-03-21 Yunxiang Zhang , Liangming Pan , Samson Tan , Min-Yen Kan

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

Neural and Evolutionary Computing · Computer Science 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

In this paper, we present a novel nonlinear programming-based approach to fine-tune pre-trained neural networks to improve robustness against adversarial attacks while maintaining high accuracy on clean data. Our method introduces…

Machine Learning · Computer Science 2024-10-28 Shudian Zhao , Jan Kronqvist

Deep neural networks are highly vulnerable to adversarial examples, i.e.,small perturbations that can significantly degrade model performance. While adversarial training has become the primary defense strategy, most studies focus on…

Machine Learning · Computer Science 2026-05-14 Lilin Zhang , Yimo Guo , Yue Li , Jiancheng Shi , Xianggen Liu

The vulnerability to slight input perturbations is a worrying yet intriguing property of deep neural networks (DNNs). Despite many previous works studying the reason behind such adversarial behavior, the relationship between the…

Machine Learning · Statistics 2019-06-07 Yujun Shi , Benben Liao , Guangyong Chen , Yun Liu , Ming-Ming Cheng , Jiashi Feng

Deep neural networks are vulnerable to adversarial noise. Adversarial Training (AT) has been demonstrated to be the most effective defense strategy to protect neural networks from being fooled. However, we find AT omits to learning robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Nuoyan Zhou , Nannan Wang , Decheng Liu , Dawei Zhou , Xinbo Gao

Despite excellent performance on many tasks, NLP systems are easily fooled by small adversarial perturbations of inputs. Existing procedures to defend against such perturbations are either (i) heuristic in nature and susceptible to stronger…

Computation and Language · Computer Science 2020-05-05 Erik Jones , Robin Jia , Aditi Raghunathan , Percy Liang

Adversarial training, originally designed to resist test-time adversarial examples, has shown to be promising in mitigating training-time availability attacks. This defense ability, however, is challenged in this paper. We identify a novel…

Machine Learning · Computer Science 2022-10-11 Lue Tao , Lei Feng , Hongxin Wei , Jinfeng Yi , Sheng-Jun Huang , Songcan Chen

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

Recent studies have revealed that GNNs are vulnerable to adversarial attacks. Most existing robust graph learning methods measure model robustness based on label information, rendering them infeasible when label information is not…

Machine Learning · Computer Science 2023-06-09 Jihong Wang , Minnan Luo , Jundong Li , Ziqi Liu , Jun Zhou , Qinghua Zheng

Lifted neural networks (i.e. neural architectures explicitly optimizing over respective network potentials to determine the neural activities) can be combined with a type of adversarial training to gain robustness for internal as well as…

Machine Learning · Computer Science 2025-03-12 Christopher Zach

In the context of statistical learning, the Information Bottleneck method seeks a right balance between accuracy and generalization capability through a suitable tradeoff between compression complexity, measured by minimum description…

Information Theory · Computer Science 2021-02-16 Mohammad Mahdi Mahvari , Mari Kobayashi , Abdellatif Zaidi