English
Related papers

Related papers: Batch Normalization Increases Adversarial Vulnerab…

200 papers

Deep neural network (DNN) is a popular model implemented in many systems to handle complex tasks such as image classification, object recognition, natural language processing etc. Consequently DNN structural vulnerabilities become part of…

Machine Learning · Computer Science 2021-07-02 Juan Shu , Bowei Xi , Charles Kamhoua

Stereo matching has recently witnessed remarkable progress using Deep Neural Networks (DNNs). But, how robust are they? Although it has been well-known that DNNs often suffer from adversarial vulnerability with a catastrophic drop in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-24 Kelvin Cheng , Christopher Healey , Tianfu Wu

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

Batch Normalization has become one of the essential components in CNN. It allows the network to use a higher learning rate and speed up training. And the network doesn't need to be initialized carefully. However, in our work, we find that a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Chuan Liu , Yi Gao , Jiancheng Lv

Neural networks (NNs) are known to exhibit simplicity bias where they tend to prefer learning 'simple' features over more 'complex' ones, even when the latter may be more informative. Simplicity bias can lead to the model making biased…

Machine Learning · Computer Science 2023-10-11 Bhavya Vasudeva , Kameron Shahabi , Vatsal Sharan

Continual learning entails learning a sequence of tasks and balancing their knowledge appropriately. With limited access to old training samples, much of the current work in deep neural networks has focused on overcoming catastrophic…

Machine Learning · Computer Science 2023-10-16 Yilin Lyu , Liyuan Wang , Xingxing Zhang , Zicheng Sun , Hang Su , Jun Zhu , Liping Jing

Batch Normalization (BN) has become a core design block of modern Convolutional Neural Networks (CNNs). A typical modern CNN has a large number of BN layers in its lean and deep architecture. BN requires mean and variance calculations over…

Computer Vision and Pattern Recognition · Computer Science 2019-03-04 Wonkyung Jung , Daejin Jung , and Byeongho Kim , Sunjung Lee , Wonjong Rhee , Jung Ho Ahn

Reinforcement learning systems require good representations to work well. For decades practical success in reinforcement learning was limited to small domains. Deep reinforcement learning systems, on the other hand, are scalable, not…

Machine Learning · Computer Science 2020-03-18 Sina Ghiassian , Banafsheh Rafiee , Yat Long Lo , Adam White

Black-box adversarial attacks designing adversarial examples for unseen neural networks (NNs) have received great attention over the past years. While several successful black-box attack schemes have been proposed in the literature, the…

Machine Learning · Computer Science 2022-06-22 Yilin Wang , Farzan Farnia

Magnetic Resonance Imaging (MRI) is considered the gold standard of medical imaging because of the excellent soft-tissue contrast exhibited in the images reconstructed by the MRI pipeline, which in-turn enables the human radiologist to…

Image and Video Processing · Electrical Eng. & Systems 2023-06-26 Divyam Madaan , Daniel Sodickson , Kyunghyun Cho , Sumit Chopra

We consider adversarial training of deep neural networks through the lens of Bayesian learning, and present a principled framework for adversarial training of Bayesian Neural Networks (BNNs) with certifiable guarantees. We rely on…

Machine Learning · Computer Science 2021-02-24 Matthew Wicker , Luca Laurenti , Andrea Patane , Zhoutong Chen , Zheng Zhang , Marta Kwiatkowska

In this paper, we aim to understand and explain the decisions of deep neural networks by studying the behavior of predicted attributes when adversarial examples are introduced. We study the changes in attributes for clean as well as…

Computer Vision and Pattern Recognition · Computer Science 2019-10-17 Sadaf Gulshad , Zeynep Akata , Jan Hendrik Metzen , Arnold Smeulders

Neural networks have been widely applied in security applications such as spam and phishing detection, intrusion prevention, and malware detection. This black-box method, however, often has uncertainty and poor explainability in…

Cryptography and Security · Computer Science 2022-10-12 Mark Huasong Meng , Guangdong Bai , Sin Gee Teo , Zhe Hou , Yan Xiao , Yun Lin , Jin Song Dong

Machine learning models have been successfully applied to a wide range of applications including computer vision, natural language processing, and speech recognition. A successful implementation of these models however, usually relies on…

Machine Learning · Computer Science 2020-09-29 Arash Rahnama , Andrew Tseng

Over the past decades, researchers have primarily focused on improving the generalization abilities of models, with limited attention given to regulating such generalization. However, the ability of models to generalize to unintended data…

Machine Learning · Computer Science 2025-03-10 Ziming Hong , Yongli Xiang , Tongliang Liu

Recent breakthroughs in the field of deep learning have led to advancements in a broad spectrum of tasks in computer vision, audio processing, natural language processing and other areas. In most instances where these tasks are deployed in…

Machine Learning · Computer Science 2019-05-28 Daanish Ali Khan , Linhong Li , Ninghao Sha , Zhuoran Liu , Abelino Jimenez , Bhiksha Raj , Rita Singh

Deep neural networks often suffer the data distribution shift between training and testing, and the batch statistics are observed to reflect the shift. In this paper, targeting of alleviating distribution shift in test time, we revisit the…

Machine Learning · Computer Science 2022-05-23 Tao Yang , Shenglong Zhou , Yuwang Wang , Yan Lu , Nanning Zheng

The prediction accuracy of the deep neural networks (DNNs) after deployment at the edge can suffer with time due to shifts in the distribution of the new data. To improve robustness of DNNs, they must be able to update themselves to enhance…

Machine Learning · Computer Science 2022-03-23 Kshitij Bhardwaj , James Diffenderfer , Bhavya Kailkhura , Maya Gokhale

While deep learning has resulted in major breakthroughs in many application domains, the frameworks commonly used in deep learning remain fragile to artificially-crafted and imperceptible changes in the data. In response to this fragility,…

Machine Learning · Computer Science 2020-11-03 Alexander Robey , Hamed Hassani , George J. Pappas

Batch normalization (BN) is an important technique commonly incorporated into deep learning models to perform standardization within mini-batches. The merits of BN in improving a model's learning efficiency can be further amplified by…

Machine Learning · Computer Science 2021-04-07 Lei Huang , Yi Zhou , Li Liu , Fan Zhu , Ling Shao