中文
相关论文

相关论文: Understanding Catastrophic Overfitting in Adversar…

200 篇论文

Machine learning algorithms minimizing average risk are susceptible to distributional shifts. Distributionally Robust Optimization (DRO) addresses this issue by optimizing the worst-case risk within an uncertainty set. However, DRO suffers…

机器学习 · 计算机科学 2023-11-10 Jiashuo Liu , Jiayun Wu , Tianyu Wang , Hao Zou , Bo Li , Peng Cui

Decision-focused learning (DFL) offers an end-to-end approach to the predict-then-optimize (PO) framework by training predictive models directly on decision loss (DL), enhancing decision-making performance within PO contexts. However, the…

机器学习 · 计算机科学 2025-04-15 Jiaqi Yang , Enming Liang , Zicheng Su , Zhichao Zou , Peng Zhen , Jiecheng Guo , Wanjing Ma , Kun An

Fast adversarial training (FAT) aims to enhance the robustness of models against adversarial attacks with reduced training time, however, FAT often suffers from compromised robustness due to insufficient exploration of adversarial space. In…

机器学习 · 计算机科学 2026-01-21 Euijin You , Hyang-Won Lee

While existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real-world settings. In many such cases although test data might not be…

计算机视觉与模式识别 · 计算机科学 2021-04-09 Tejas Gokhale , Rushil Anirudh , Bhavya Kailkhura , Jayaraman J. Thiagarajan , Chitta Baral , Yezhou Yang

Federated and Continual Learning have emerged as potential paradigms for the robust and privacy-aware use of Deep Learning in dynamic environments. However, Client Drift and Catastrophic Forgetting are fundamental obstacles to guaranteeing…

机器学习 · 计算机科学 2023-09-06 Niklas Babendererde , Moritz Fuchs , Camila Gonzalez , Yuri Tolkach , Anirban Mukhopadhyay

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

机器学习 · 计算机科学 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

We consider Decision-Focused Federated Learning (DFFL), a predict-then-optimize setting in which multiple clients collaboratively train predictive models for downstream linear optimization problems without exchanging raw data. Besides the…

最优化与控制 · 数学 2026-05-19 Konstantinos Ziliaskopoulos , Alexander Vinel

Deep neural networks (DNNs) are vulnerable to adversarial examples, in which DNNs are misled to false outputs due to inputs containing imperceptible perturbations. Adversarial training, a reliable and effective method of defense, may…

计算机视觉与模式识别 · 计算机科学 2025-11-14 Zongyuan Zhang , Qingwen Bu , Tianyang Duan , Zheng Lin , Yuhao Qing , Zihan Fang , Heming Cui , Dong Huang

We investigate the performance of DNNs when trained on class-incremental visual problems consisting of initial training, followed by retraining with added visual classes. Catastrophic forgetting (CF) behavior is measured using a new…

机器学习 · 计算机科学 2019-05-21 B. Pfülb , A. Gepperth , S. Abdullah , A. Kilian

Recent advances in machine learning show that neural models are vulnerable to minimally perturbed inputs, or adversarial examples. Adversarial algorithms are optimization problems that minimize the accuracy of ML models by perturbing…

机器学习 · 计算机科学 2022-05-20 Thomas Cilloni , Charles Walter , Charles Fleming

We propose adaptive weight decay, which automatically tunes the hyper-parameter for weight decay during each training iteration. For classification problems, we propose changing the value of the weight decay hyper-parameter on the fly based…

机器学习 · 计算机科学 2023-12-05 Amin Ghiasi , Ali Shafahi , Reza Ardekani

Recent improvements in deep learning models and their practical applications have raised concerns about the robustness of these models against adversarial examples. Adversarial training (AT) has been shown effective to reach a robust model…

机器学习 · 计算机科学 2021-03-30 Mohammad Azizmalayeri , Mohammad Hossein Rohban

Deep neural networks are vulnerable to adversarial examples--inputs with imperceptible perturbations causing misclassification. While adversarial transfer within neural networks is well-documented, whether classical ML pipelines using…

机器学习 · 计算机科学 2026-01-30 Achraf Hsain , Ahmed Abdelkader , Emmanuel Baldwin Mbaya , Hamoud Aljamaan

Despite progress in adversarial training (AT), there is a substantial gap between the top-performing and worst-performing classes in many datasets. For example, on CIFAR10, the accuracies for the best and worst classes are 74% and 23%,…

机器学习 · 计算机科学 2023-02-20 Thomas Pethick , Grigorios G. Chrysos , Volkan Cevher

Though deep reinforcement learning (DRL) has obtained substantial success, it may encounter catastrophic failures due to the intrinsic uncertainty of both transition and observation. Most of the existing methods for safe reinforcement…

机器学习 · 计算机科学 2025-05-20 Chengyang Ying , Xinning Zhou , Hang Su , Dong Yan , Ning Chen , Jun Zhu

In a manner analogous to their classical counterparts, quantum classifiers are vulnerable to adversarial attacks that perturb their inputs. A promising countermeasure is to train the quantum classifier by adopting an attack-aware, or…

量子物理 · 物理学 2024-02-16 Petros Georgiou , Sharu Theresa Jose , Osvaldo Simeone

Central Force Optimization (CFO) is a new nature-inspired deterministic multi-dimensional search and optimization metaheuristic based on the metaphor of gravitational kinematics. CFO is applied to the PBM antenna benchmark suite and the…

其他计算机科学 · 计算机科学 2010-03-02 Richard A. Formato

Adversarial training is an approach of increasing the robustness of models to adversarial attacks by including adversarial examples in the training set. One major challenge of producing adversarial examples is to contain sufficient…

机器学习 · 计算机科学 2021-10-13 Tianjin Huang , Vlado Menkovski , Yulong Pei , Mykola Pechenizkiy

Adversarial noise introduces small perturbations in images, misleading deep learning models into misclassification and significantly impacting recognition accuracy. In this study, we analyzed the effects of Fast Gradient Sign Method (FGSM)…

计算机视觉与模式识别 · 计算机科学 2025-04-30 Manish Kansana , Keyan Alexander Rahimi , Elias Hossain , Iman Dehzangi , Noorbakhsh Amiri Golilarz

Neural networks are susceptible to adversarial examples-small input perturbations that cause models to fail. Adversarial training is one of the solutions that stops adversarial examples; models are exposed to attacks during training and…

机器学习 · 计算机科学 2022-07-05 Maximilian Kaufmann , Yiren Zhao , Ilia Shumailov , Robert Mullins , Nicolas Papernot