English
Related papers

Related papers: Understanding Catastrophic Overfitting in Adversar…

200 papers

Adversarial training suffers from the issue of robust overfitting, which seriously impairs its generalization performance. Data augmentation, which is effective at preventing overfitting in standard training, has been observed by many…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Lin Li , Michael Spratling

It is well-known that machine learning models are vulnerable to small but cleverly-designed adversarial perturbations that can cause misclassification. While there has been major progress in designing attacks and defenses for various…

Machine Learning · Computer Science 2021-04-07 Payam Delgosha , Hamed Hassani , Ramtin Pedarsani

We demonstrate that the choice of optimizer, neural network architecture, and regularizer significantly affect the adversarial robustness of linear neural networks, providing guarantees without the need for adversarial training. To this…

Machine Learning · Computer Science 2021-06-08 Fartash Faghri , Sven Gowal , Cristina Vasconcelos , David J. Fleet , Fabian Pedregosa , Nicolas Le Roux

Many adversarial defense methods have been proposed to enhance the adversarial robustness of natural language processing models. However, most of them introduce additional pre-set linguistic knowledge and assume that the synonym candidates…

Computation and Language · Computer Science 2024-02-28 Yichen Yang , Xin Liu , Kun He

The early phase of training a deep neural network has a dramatic effect on the local curvature of the loss function. For instance, using a small learning rate does not guarantee stable optimization because the optimization trajectory has a…

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

Machine Learning · Computer Science 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

Despite strong performance in numerous applications, the fragility of deep learning to input perturbations has raised serious questions about its use in safety-critical domains. While adversarial training can mitigate this issue in…

Machine Learning · Statistics 2021-11-01 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani , Alejandro Ribeiro

Despite its popularity, deep neural networks are easily fooled. To alleviate this deficiency, researchers are actively developing new training strategies, which encourage models that are robust to small input perturbations. Several…

Machine Learning · Computer Science 2021-10-28 Jingyue Lu , M. Pawan Kumar

Despite many proposed algorithms to provide robustness to deep learning (DL) models, DL models remain susceptible to adversarial attacks. We hypothesize that the adversarial vulnerability of DL models stems from two factors. The first…

Artificial Intelligence · Computer Science 2022-02-21 Mahsa Paknezhad , Cuong Phuc Ngo , Amadeus Aristo Winarto , Alistair Cheong , Chuen Yang Beh , Jiayang Wu , Hwee Kuan Lee

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

Machine Learning · Computer Science 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas

While recent state-of-the-art results for adversarial imitation-learning algorithms are encouraging, recent works exploring the imitation learning from observation (ILO) setting, where trajectories \textit{only} contain expert observations,…

Machine Learning · Computer Science 2020-06-22 Dilip Arumugam , Debadeepta Dey , Alekh Agarwal , Asli Celikyilmaz , Elnaz Nouri , Bill Dolan

Collaborative Filtering (CF) has been successfully used to help users discover the items of interest. Nevertheless, existing CF methods suffer from noisy data issue, which negatively impacts the quality of recommendation. To tackle this…

Information Retrieval · Computer Science 2023-08-29 Huiyuan Chen , Xiaoting Li , Vivian Lai , Chin-Chia Michael Yeh , Yujie Fan , Yan Zheng , Mahashweta Das , Hao Yang

Federated Learning (FL) has gained significant attraction due to its ability to enable privacy-preserving training over decentralized data. Current literature in FL mostly focuses on single-task learning. However, over time, new tasks may…

Machine Learning · Computer Science 2023-10-18 Yavuz Faruk Bakman , Duygu Nur Yaldiz , Yahya H. Ezzeldin , Salman Avestimehr

In unsupervised combinatorial optimization (UCO), during training, one aims to have continuous decisions that are promising in a probabilistic sense for each training instance, which enables end-to-end training on initially discrete and…

Machine Learning · Computer Science 2025-06-23 Fanchen Bu , Kijung Shin

Adversarial training is a widely used method to improve the robustness of deep neural networks (DNNs) over adversarial perturbations. However, it is empirically observed that adversarial training on over-parameterized networks often suffers…

Machine Learning · Statistics 2024-01-25 Zhongjie Shi , Fanghui Liu , Yuan Cao , Johan A. K. Suykens

Adversarial training has become the primary method to defend against adversarial samples. However, it is hard to practically apply due to many shortcomings. One of the shortcomings of adversarial training is that it will reduce the…

Machine Learning · Computer Science 2021-08-31 Zhishen Nie , Ying Lin , Sp Ren , Lan Zhang

Neural networks have changed the way machines interpret the world. At their core, they learn by following gradients, adjusting their parameters step by step until they identify the most discriminant patterns in the data. This process gives…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Samarup Bhattacharya , Anubhab Bhattacharya , Abir Chakraborty

Reinforcement learning (RL) training is inherently unstable due to factors such as moving targets and high gradient variance. Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning from AI Feedback (RLAIF) can…

Machine Learning · Computer Science 2025-06-24 Ju-Seung Byun , Andrew Perrault

We analyze the properties of adversarial training for learning adversarially robust halfspaces in the presence of agnostic label noise. Denoting $\mathsf{OPT}_{p,r}$ as the best robust classification error achieved by a halfspace that is…

Machine Learning · Computer Science 2021-04-20 Difan Zou , Spencer Frei , Quanquan Gu