中文
相关论文

相关论文: On Fragile Features and Batch Normalization in Adv…

200 篇论文

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

计算机视觉与模式识别 · 计算机科学 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

Recently, there has been an abundance of works on designing Deep Neural Networks (DNNs) that are robust to adversarial examples. In particular, a central question is which features of DNNs influence adversarial robustness and, therefore,…

机器学习 · 计算机科学 2021-10-07 Peter Langenberg , Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

Adversarial examples reveal critical vulnerabilities in deep neural networks by exploiting their sensitivity to imperceptible input perturbations. While adversarial training remains the predominant defense strategy, it often incurs…

机器学习 · 计算机科学 2025-11-04 Longwei Wang , Ifrat Ikhtear Uddin , KC Santosh , Chaowei Zhang , Xiao Qin , Yang Zhou

Deep neural networks (DNNs) are easily fooled by adversarial perturbations that are imperceptible to humans. Adversarial training, a process where adversarial examples are added to the training set, is the current state-of-the-art defense…

机器学习 · 计算机科学 2024-01-23 Siddharth Mansingh , Michal Kucer , Garrett Kenyon , Juston Moore , Michael Teti

A wide variety of deep learning techniques from style transfer to multitask learning rely on training affine transformations of features. Most prominent among these is the popular feature normalization technique BatchNorm, which normalizes…

机器学习 · 计算机科学 2021-03-23 Jonathan Frankle , David J. Schwab , Ari S. Morcos

In this work we investigate the reasons why Batch Normalization (BN) improves the generalization performance of deep networks. We argue that one major reason, distinguishing it from data-independent normalization methods, is randomness of…

机器学习 · 计算机科学 2018-11-05 Alexander Shekhovtsov , Boris Flach

Deep learning-based discriminative classifiers, despite their remarkable success, remain vulnerable to adversarial examples that can mislead model predictions. While adversarial training can enhance robustness, it fails to address the…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Chunheng Zhao , Pierluigi Pisu , Gurcan Comert , Negash Begashaw , Varghese Vaidyan , Nina Christine Hubig

Deep neural networks (DNNs) are known to have a fundamental sensitivity to adversarial attacks, perturbations of the input that are imperceptible to humans yet powerful enough to change the visual decision of a model. Adversarial attacks…

计算机视觉与模式识别 · 计算机科学 2023-06-07 Drew Linsley , Pinyuan Feng , Thibaut Boissin , Alekh Karkada Ashok , Thomas Fel , Stephanie Olaiya , Thomas Serre

Deep neural networks are easily fooled by small perturbations known as adversarial attacks. Adversarial Training (AT) is a technique aimed at learning features robust to such attacks and is widely regarded as a very effective defense.…

机器学习 · 计算机科学 2020-09-11 Theodoros Tsiligkaridis , Jay Roberts

Training state-of-the-art, deep neural networks is computationally expensive. One way to reduce the training time is to normalize the activities of the neurons. A recently introduced technique called batch normalization uses the…

机器学习 · 统计学 2016-07-22 Jimmy Lei Ba , Jamie Ryan Kiros , Geoffrey E. Hinton

Batch Normalization (BN) has been a standard component in designing deep neural networks (DNNs). Although the standard BN can significantly accelerate the training of DNNs and improve the generalization performance, it has several…

机器学习 · 计算机科学 2020-10-13 Yong Guo , Qingyao Wu , Chaorui Deng , Jian Chen , Mingkui Tan

There has been extensive evidence demonstrating that deep neural networks are vulnerable to adversarial examples, which motivates the development of defenses against adversarial attacks. Existing adversarial defenses typically improve model…

计算机视觉与模式识别 · 计算机科学 2023-08-14 Aishan Liu , Shiyu Tang , Xinyun Chen , Lei Huang , Haotong Qin , Xianglong Liu , Dacheng Tao

Adversarial attacks have been shown to be highly effective at degrading the performance of deep neural networks (DNNs). The most prominent defense is adversarial training, a method for learning a robust model. Nevertheless, adversarial…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Uriya Pesso , Koby Bibas , Meir Feder

Existing deep neural networks, say for image classification, have been shown to be vulnerable to adversarial images that can cause a DNN misclassification, without any perceptible change to an image. In this work, we propose shock absorbing…

机器学习 · 计算机科学 2019-09-19 Kevin Eykholt , Swati Gupta , Atul Prakash , Amir Rahmati , Pratik Vaishnavi , Haizhong Zheng

Deep Learning (DL) has shown potential in accelerating Magnetic Resonance Image acquisition and reconstruction. Nevertheless, there is a dearth of tailored methods to guarantee that the reconstruction of small features is achieved with high…

图像与视频处理 · 电气工程与系统科学 2021-04-28 Francesco Calivá , Kaiyang Cheng , Rutwik Shah , Valentina Pedoia

Batch Normalization (BN) has proven to be an effective algorithm for deep neural network training by normalizing the input to each neuron and reducing the internal covariate shift. The space of weight vectors in the BN layer can be…

机器学习 · 计算机科学 2017-11-01 Minhyung Cho , Jaehyung Lee

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

机器学习 · 计算机科学 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

Modern machine learning and deep learning models are shown to be vulnerable when testing data are slightly perturbed. Existing theoretical studies of adversarial training algorithms mostly focus on either adversarial training losses or…

机器学习 · 统计学 2021-04-07 Yue Xing , Qifan Song , Guang Cheng

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

计算机视觉与模式识别 · 计算机科学 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

Deep neural networks have been shown to be susceptible to adversarial examples -- small, imperceptible changes constructed to cause mis-classification in otherwise highly accurate image classifiers. As a practical alternative, recent work…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Sukrut Rao , David Stutz , Bernt Schiele