中文
相关论文

相关论文: Towards an Adversarially Robust Normalization Appr…

200 篇论文

State-of-the-art deep neural networks (DNNs) are highly effective at tackling many real-world tasks. However, their wide adoption in mission-critical contexts is hampered by two major weaknesses - their susceptibility to adversarial attacks…

机器学习 · 计算机科学 2022-11-17 Ofir Moshe , Gil Fidel , Ron Bitton , Asaf Shabtai

Adversarial training is widely acknowledged as the most effective defense against adversarial attacks. However, it is also well established that achieving both robustness and generalization in adversarially trained models involves a…

计算与语言 · 计算机科学 2023-12-12 Enes Altinisik , Hassan Sajjad , Husrev Taha Sencar , Safa Messaoud , Sanjay Chawla

Adversarial training (AT) aims to improve the robustness of deep learning models by mixing clean data and adversarial examples (AEs). Most existing AT approaches can be grouped into restricted and unrestricted approaches. Restricted AT…

机器学习 · 计算机科学 2020-04-14 Haidong Xie , Xueshuang Xiang , Naijin Liu , Bin Dong

Randomly initialized neural networks are known to become harder to train with increasing depth, unless architectural enhancements like residual connections and batch normalization are used. We here investigate this phenomenon by revisiting…

机器学习 · 统计学 2020-06-15 Hadi Daneshmand , Jonas Kohler , Francis Bach , Thomas Hofmann , Aurelien Lucchi

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

机器学习 · 计算机科学 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh

The existence of adversarial data examples has drawn significant attention in the deep-learning community; such data are seemingly minimally perturbed relative to the original data, but lead to very different outputs from a deep-learning…

机器学习 · 计算机科学 2019-11-12 Bai Li , Changyou Chen , Wenlin Wang , Lawrence Carin

It has been consistently reported that many machine learning models are susceptible to adversarial attacks i.e., small additive adversarial perturbations applied to data points can cause misclassification. Adversarial training using…

机器学习 · 统计学 2021-07-15 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

The problem of adversarial examples has shown that modern Neural Network (NN) models could be rather fragile. Among the more established techniques to solve the problem, one is to require the model to be {\it $\epsilon$-adversarially…

机器学习 · 计算机科学 2020-11-17 Yuxin Wen , Shuai Li , Kui Jia

Deep neural networks (DNNs) are vulnerable to adversarial attacks. It is found empirically that adversarially robust generalization is crucial in establishing defense algorithms against adversarial attacks. Therefore, it is interesting to…

机器学习 · 计算机科学 2023-10-31 Jiancong Xiao , Ruoyu Sun , Zhi- Quan Luo

Batch normalization (BN) has become a standard technique for training the modern deep networks. However, its effectiveness diminishes when the batch size becomes smaller, since the batch statistics estimation becomes inaccurate. That…

计算机视觉与模式识别 · 计算机科学 2020-03-13 Chunjie Luo , Jianfeng Zhan , Lei Wang , Wanling Gao

Adversarial training can considerably robustify deep neural networks to resist adversarial attacks. However, some works suggested that adversarial training might comprise the privacy-preserving and generalization abilities. This paper…

机器学习 · 计算机科学 2020-12-29 Fengxiang He , Shaopeng Fu , Bohan Wang , Dacheng Tao

Adversarially robust learning aims to design algorithms that are robust to small adversarial perturbations on input variables. Beyond the existing studies on the predictive performance to adversarial samples, our goal is to understand…

机器学习 · 统计学 2020-12-21 Yue Xing , Ruizhi Zhang , Guang Cheng

Deep Neural Networks are vulnerable to adversarial attacks. Among many defense strategies, adversarial training with untargeted attacks is one of the most effective methods. Theoretically, adversarial perturbation in untargeted attacks can…

计算机视觉与模式识别 · 计算机科学 2022-12-01 Pengyue Hou , Jie Han , Xingyu Li

Most previous works usually explained adversarial examples from several specific perspectives, lacking relatively integral comprehension about this problem. In this paper, we present a systematic study on adversarial examples from three…

机器学习 · 计算机科学 2019-03-01 Ke Sun , Zhanxing Zhu , Zhouchen Lin

Deep-learning-based methods for different applications have been shown vulnerable to adversarial examples. These examples make deployment of such models in safety-critical tasks questionable. Use of deep neural networks as inverse problem…

机器学习 · 计算机科学 2020-02-28 Ankit Raj , Yoram Bresler , Bo Li

Adversarial examples are inevitable on the road of pervasive applications of deep neural networks (DNN). Imperceptible perturbations applied on natural samples can lead DNN-based classifiers to output wrong prediction with fair confidence…

机器学习 · 计算机科学 2020-11-04 Tao Bai , Jinqi Luo , Jun Zhao

Adversarial examples cause neural networks to produce incorrect outputs with high confidence. Although adversarial training is one of the most effective forms of defense against adversarial examples, unfortunately, a large gap exists…

计算机视觉与模式识别 · 计算机科学 2020-07-28 Saehyung Lee , Hyungyu Lee , Sungroh Yoon

Injecting adversarial examples during training, known as adversarial training, can improve robustness against one-step attacks, but not for unknown iterative attacks. To address this challenge, we first show iteratively generated…

机器学习 · 统计学 2018-03-20 Taesik Na , Jong Hwan Ko , Saibal Mukhopadhyay

This paper first answers the question "why do the two most powerful techniques Dropout and Batch Normalization (BN) often lead to a worse performance when they are combined together?" in both theoretical and statistical aspects.…

机器学习 · 计算机科学 2018-01-17 Xiang Li , Shuo Chen , Xiaolin Hu , Jian Yang

Adversarial robustness corresponds to the susceptibility of deep neural networks to imperceptible perturbations made at test time. In the context of image tasks, many algorithms have been proposed to make neural networks robust to…

计算机视觉与模式识别 · 计算机科学 2020-12-03 Pranjal Awasthi , George Yu , Chun-Sung Ferng , Andrew Tomkins , Da-Cheng Juan