English
Related papers

Related papers: Understanding Catastrophic Overfitting in Adversar…

200 papers

Machine learning algorithms minimizing average risk are susceptible to distributional shifts. Distributionally Robust Optimization (DRO) addresses this issue by optimizing the worst-case risk within an uncertainty set. However, DRO suffers…

Machine Learning · Computer Science 2023-11-10 Jiashuo Liu , Jiayun Wu , Tianyu Wang , Hao Zou , Bo Li , Peng Cui

Decision-focused learning (DFL) offers an end-to-end approach to the predict-then-optimize (PO) framework by training predictive models directly on decision loss (DL), enhancing decision-making performance within PO contexts. However, the…

Machine Learning · Computer Science 2025-04-15 Jiaqi Yang , Enming Liang , Zicheng Su , Zhichao Zou , Peng Zhen , Jiecheng Guo , Wanjing Ma , Kun An

Fast adversarial training (FAT) aims to enhance the robustness of models against adversarial attacks with reduced training time, however, FAT often suffers from compromised robustness due to insufficient exploration of adversarial space. In…

Machine Learning · Computer Science 2026-01-21 Euijin You , Hyang-Won Lee

While existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real-world settings. In many such cases although test data might not be…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Tejas Gokhale , Rushil Anirudh , Bhavya Kailkhura , Jayaraman J. Thiagarajan , Chitta Baral , Yezhou Yang

Federated and Continual Learning have emerged as potential paradigms for the robust and privacy-aware use of Deep Learning in dynamic environments. However, Client Drift and Catastrophic Forgetting are fundamental obstacles to guaranteeing…

Machine Learning · Computer Science 2023-09-06 Niklas Babendererde , Moritz Fuchs , Camila Gonzalez , Yuri Tolkach , Anirban Mukhopadhyay

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

Machine Learning · Computer Science 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

We consider Decision-Focused Federated Learning (DFFL), a predict-then-optimize setting in which multiple clients collaboratively train predictive models for downstream linear optimization problems without exchanging raw data. Besides the…

Optimization and Control · Mathematics 2026-05-19 Konstantinos Ziliaskopoulos , Alexander Vinel

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang

We investigate the performance of DNNs when trained on class-incremental visual problems consisting of initial training, followed by retraining with added visual classes. Catastrophic forgetting (CF) behavior is measured using a new…

Machine Learning · Computer Science 2019-05-21 B. Pfülb , A. Gepperth , S. Abdullah , A. Kilian

Recent advances in machine learning show that neural models are vulnerable to minimally perturbed inputs, or adversarial examples. Adversarial algorithms are optimization problems that minimize the accuracy of ML models by perturbing…

Machine Learning · Computer Science 2022-05-20 Thomas Cilloni , Charles Walter , Charles Fleming

We propose adaptive weight decay, which automatically tunes the hyper-parameter for weight decay during each training iteration. For classification problems, we propose changing the value of the weight decay hyper-parameter on the fly based…

Machine Learning · Computer Science 2023-12-05 Amin Ghiasi , Ali Shafahi , Reza Ardekani

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

Machine Learning · Computer Science 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Deep neural networks are vulnerable to adversarial examples--inputs with imperceptible perturbations causing misclassification. While adversarial transfer within neural networks is well-documented, whether classical ML pipelines using…

Machine Learning · Computer Science 2026-01-30 Achraf Hsain , Ahmed Abdelkader , Emmanuel Baldwin Mbaya , Hamoud Aljamaan

Despite progress in adversarial training (AT), there is a substantial gap between the top-performing and worst-performing classes in many datasets. For example, on CIFAR10, the accuracies for the best and worst classes are 74% and 23%,…

Machine Learning · Computer Science 2023-02-20 Thomas Pethick , Grigorios G. Chrysos , Volkan Cevher

Though deep reinforcement learning (DRL) has obtained substantial success, it may encounter catastrophic failures due to the intrinsic uncertainty of both transition and observation. Most of the existing methods for safe reinforcement…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Xinning Zhou , Hang Su , Dong Yan , Ning Chen , Jun Zhu

In a manner analogous to their classical counterparts, quantum classifiers are vulnerable to adversarial attacks that perturb their inputs. A promising countermeasure is to train the quantum classifier by adopting an attack-aware, or…

Quantum Physics · Physics 2024-02-16 Petros Georgiou , Sharu Theresa Jose , Osvaldo Simeone

Central Force Optimization (CFO) is a new nature-inspired deterministic multi-dimensional search and optimization metaheuristic based on the metaphor of gravitational kinematics. CFO is applied to the PBM antenna benchmark suite and the…

Other Computer Science · Computer Science 2010-03-02 Richard A. Formato

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

Machine Learning · Computer Science 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Adversarial noise introduces small perturbations in images, misleading deep learning models into misclassification and significantly impacting recognition accuracy. In this study, we analyzed the effects of Fast Gradient Sign Method (FGSM)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-30 Manish Kansana , Keyan Alexander Rahimi , Elias Hossain , Iman Dehzangi , Noorbakhsh Amiri Golilarz

Neural networks are susceptible to adversarial examples-small input perturbations that cause models to fail. Adversarial training is one of the solutions that stops adversarial examples; models are exposed to attacks during training and…

Machine Learning · Computer Science 2022-07-05 Maximilian Kaufmann , Yiren Zhao , Ilia Shumailov , Robert Mullins , Nicolas Papernot
‹ Prev 1 4 5 6 7 8 10 Next ›