中文
相关论文

相关论文: Fast Adversarial Training with Noise Augmentation:…

200 篇论文

Deep learning models have achieved state-of-the-art performances in various domains, while they are vulnerable to the inputs with well-crafted but small perturbations, which are named after adversarial examples (AEs). Among many strategies…

计算机视觉与模式识别 · 计算机科学 2023-10-11 Huihui Gong

Adversarial Training (AT) is one of the most effective methods for developing robust deep neural networks (DNNs). However, AT faces a trade-off problem between clean accuracy and adversarial robustness. In this work, we reveal a surprising…

计算机视觉与模式识别 · 计算机科学 2026-04-30 Yanyun Wang , Qingqing Ye , Li Liu , Zi Liang , Haibo Hu

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

计算机视觉与模式识别 · 计算机科学 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

Segmentation is considered to be a very crucial task in medical image analysis. This task has been easier since deep learning models have taken over with its high performing behavior. However, deep learning models dependency on large data…

图像与视频处理 · 电气工程与系统科学 2021-05-26 Mst. Tasnim Pervin , Linmi Tao , Aminul Huq , Zuoxiang He , Li Huo

In realistic environments, speech is usually interfered by various noise and reverberation, which dramatically degrades the performance of automatic speech recognition (ASR) systems. To alleviate this issue, the commonest way is to use a…

声音 · 计算机科学 2018-05-04 Bin Liu , Shuai Nie , Yaping Zhang , Dengfeng Ke , Shan Liang , Wenju Liu1

We study the trade-offs between convergence rate and robustness to gradient errors in designing a first-order algorithm. We focus on gradient descent (GD) and accelerated gradient (AG) methods for minimizing strongly convex functions when…

最优化与控制 · 数学 2019-11-07 Necdet Serhat Aybat , Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar

This paper presents GReAT (Graph Regularized Adversarial Training), a novel regularization method designed to enhance the robust classification performance of deep learning models. Adversarial examples, characterized by subtle perturbations…

机器学习 · 计算机科学 2024-05-06 Samet Bayram , Kenneth Barner

Adversarial training (AT) formulated as the minimax optimization problem can effectively enhance the model's robustness against adversarial attacks. The existing AT methods mainly focused on manipulating the inner maximization for…

机器学习 · 计算机科学 2022-08-05 Jingfeng Zhang , Xilie Xu , Bo Han , Tongliang Liu , Gang Niu , Lizhen Cui , Masashi Sugiyama

Recent work on adversarial attack and defense suggests that PGD is a universal $l_\infty$ first-order attack, and PGD adversarial training can significantly improve network robustness against a wide range of first-order $l_\infty$-bounded…

机器学习 · 计算机科学 2018-10-22 Tianhang Zheng , Changyou Chen , Kui Ren

It is known that Deep Neural networks (DNNs) are vulnerable to adversarial attacks, and the adversarial robustness of DNNs could be improved by adding adversarial noises to training data (e.g., the standard adversarial training (SAT)).…

图像与视频处理 · 电气工程与系统科学 2022-06-23 Linhai Ma , Liang Liang

The objective optimization of medical imaging systems requires full characterization of all sources of randomness in the measured data, which includes the variability within the ensemble of objects to-be-imaged. This can be accomplished by…

图像与视频处理 · 电气工程与系统科学 2020-01-28 Weimin Zhou , Sayantan Bhadra , Frank J. Brooks , Hua Li , Mark A. Anastasio

Recent developments in the filed of Deep Learning have demonstrated that Deep Neural Networks(DNNs) are vulnerable to adversarial examples. Specifically, in image classification, an adversarial example can fool the well trained deep neural…

机器学习 · 计算机科学 2021-01-26 Xunguang Wang , Ship Peng Xu , Eric Ke Wang

Fast Adversarial Training (FastAT) seeks to achieve adversarial robustness at a fraction of the computational cost incurred by standard multi-step methods such as PGD-AT. Although numerous FastAT techniques have been proposed in recent…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Chao Pan , Xin Yao

While adversarial training and its variants have shown to be the most effective algorithms to defend against adversarial attacks, their extremely slow training process makes it hard to scale to large datasets like ImageNet. The key idea of…

机器学习 · 计算机科学 2022-06-07 Zhichao Huang , Yanbo Fan , Chen Liu , Weizhong Zhang , Yong Zhang , Mathieu Salzmann , Sabine Süsstrunk , Jue Wang

The reliance on deep learning algorithms has grown significantly in recent years. Yet, these models are highly vulnerable to adversarial attacks, which introduce visually imperceptible perturbations into testing data to induce…

机器学习 · 计算机科学 2019-06-14 Rajeev Sahay , Rehana Mahfuz , Aly El Gamal

Making deep neural networks robust to small adversarial noises has recently been sought in many applications. Adversarial training through iterative projected gradient descent (PGD) has been established as one of the mainstream ideas to…

机器学习 · 计算机科学 2021-03-30 Zeinab Golgooni , Mehrdad Saberi , Masih Eskandar , Mohammad Hossein Rohban

Up to now, the training processes of typical Generative Adversarial Networks (GANs) are still particularly sensitive to data properties and hyperparameters, which may lead to severe oscillations, difficulties in convergence, or even…

机器学习 · 计算机科学 2025-04-22 Lin Wang , Xiancheng Wang , Rui Wang , Zhibo Zhang , Minghang Zhao

In this paper, we present CT-AGD (Curvature-Tuned Accelerated Gradient Descent), an optimization method for non-convex optimization problems in deep learning training tasks. CT-AGD is a general boosting procedure that accelerates…

机器学习 · 计算机科学 2026-05-18 Manuel Graca , L. Miguel Silveira , Arlindo Oliveira , Frank Liu

Fast Adversarial Training (FAT) not only improves the model robustness but also reduces the training cost of standard adversarial training. However, fast adversarial training often suffers from Catastrophic Overfitting (CO), which results…

计算机视觉与模式识别 · 计算机科学 2023-08-23 Xiaojun Jia , Yuefeng Chen , Xiaofeng Mao , Ranjie Duan , Jindong Gu , Rong Zhang , Hui Xue , Xiaochun Cao

Single-step adversarial training (AT) has received wide attention as it proved to be both efficient and robust. However, a serious problem of catastrophic overfitting exists, i.e., the robust accuracy against projected gradient descent…

机器学习 · 计算机科学 2022-03-23 Tao Li , Yingwen Wu , Sizhe Chen , Kun Fang , Xiaolin Huang