English
Related papers

Related papers: A Closer Look at Accuracy vs. Robustness

200 papers

This paper delves into the critical area of deep learning robustness, challenging the conventional belief that classification robustness and explanation robustness in image classification systems are inherently correlated. Through a novel…

Machine Learning · Computer Science 2024-03-12 Tiejin Chen , Wenwang Huang , Linsey Pang , Dongsheng Luo , Hua Wei

Deep neural networks are vulnerable against adversarial examples. In this paper, we propose to train and test the networks with randomly subsampled images with high drop rates. We show that this approach significantly improves robustness…

Machine Learning · Computer Science 2019-05-02 Hossein Hosseini , Sreeram Kannan , Radha Poovendran

This paper aims to evaluate the suitability of current deep learning methods for clinical workflow especially by focusing on dermatology. Although deep learning methods have been attempted to get dermatologist level accuracy in several…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Sourav Mishra , Subhajit Chaudhury , Hideaki Imaizumi , Toshihiko Yamasaki

This paper presents a study of robust policy networks in deep reinforcement learning. We investigate the benefits of policy parameterizations that naturally satisfy constraints on their Lipschitz bound, analyzing their empirical performance…

Machine Learning · Computer Science 2025-02-07 Nicholas H. Barbara , Ruigang Wang , Ian R. Manchester

Deep neural networks are vulnerable to adversarial examples, which becomes one of the most important research problems in the development of deep learning. While a lot of efforts have been made in recent years, it is of great significance…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Yinpeng Dong , Qi-An Fu , Xiao Yang , Tianyu Pang , Hang Su , Zihao Xiao , Jun Zhu

This paper analyzes regularization terms proposed recently for improving the adversarial robustness of deep neural networks (DNNs), from a theoretical point of view. Specifically, we study possible connections between several effective…

Machine Learning · Computer Science 2020-07-07 Yiwen Guo , Long Chen , Yurong Chen , Changshui Zhang

Contrary to most machine learning models, modern deep artificial neural networks typically include multiple components that contribute to regularization. Despite the fact that some (explicit) regularization techniques, such as weight decay…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Alex Hernández-García , Peter König

Machine unlearning poses the challenge of ``how to eliminate the influence of specific data from a pretrained model'' in regard to privacy concerns. While prior research on approximated unlearning has demonstrated accuracy and efficiency in…

Machine Learning · Computer Science 2025-04-21 Khoa Tran , Simon S. Woo

A fundamental question in adversarial machine learning is whether a robust classifier exists for a given task. A line of research has made some progress towards this goal by studying the concentration of measure, but we argue standard…

Machine Learning · Computer Science 2022-03-18 Xiao Zhang , David Evans

Deep learning is recognized to be capable of discovering deep features for representation learning and pattern recognition without requiring elegant feature engineering techniques by taking advantage of human ingenuity and prior knowledge.…

Machine Learning · Computer Science 2020-04-02 Zhi Han , Siquan Yu , Shao-Bo Lin , Ding-Xuan Zhou

Recent advances in adversarial attacks uncover the intrinsic vulnerability of modern deep neural networks. Since then, extensive efforts have been devoted to enhancing the robustness of deep networks via specialized learning algorithms and…

Machine Learning · Computer Science 2020-03-27 Minghao Guo , Yuzhe Yang , Rui Xu , Ziwei Liu , Dahua Lin

High sensitivity of neural networks against malicious perturbations on inputs causes security concerns. To take a steady step towards robust classifiers, we aim to create neural network models provably defended from perturbations. Prior…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Yusuke Tsuzuku , Issei Sato , Masashi Sugiyama

While generalizing well over natural inputs, neural networks are vulnerable to adversarial inputs. Existing defenses against adversarial inputs have largely been detached from the real world. These defenses also come at a cost to accuracy.…

Machine Learning · Computer Science 2019-12-05 Varun Chandrasekaran , Brian Tang , Nicolas Papernot , Kassem Fawaz , Somesh Jha , Xi Wu

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

As robustness verification methods are becoming more precise, training certifiably robust neural networks is becoming ever more relevant. To this end, certified training methods compute and then optimize an upper bound on the worst-case…

Machine Learning · Computer Science 2024-02-29 Yuhao Mao , Mark Niklas Müller , Marc Fischer , Martin Vechev

State-of-the-art classifiers have been shown to be largely vulnerable to adversarial perturbations. One of the most effective strategies to improve robustness is adversarial training. In this paper, we investigate the effect of adversarial…

Machine Learning · Computer Science 2018-11-27 Seyed-Mohsen Moosavi-Dezfooli , Alhussein Fawzi , Jonathan Uesato , Pascal Frossard

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

This paper examines the impact of static sparsity on the robustness of a trained network to weight perturbations, data corruption, and adversarial examples. We show that, up to a certain sparsity achieved by increasing network width and…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Lukas Timpl , Rahim Entezari , Hanie Sedghi , Behnam Neyshabur , Olga Saukh

It is becoming increasingly apparent that probabilistic approaches can overcome conservatism and computational complexity of the classical worst-case deterministic framework and may lead to designs that are actually safer. In this paper we…

Applications · Statistics 2008-11-01 Xinjia Chen , Kemin Zhou , Jorge L. Aravena

Robustness is a fundamental property of machine learning classifiers required to achieve safety and reliability. In the field of adversarial robustness of image classifiers, robustness is commonly defined as the stability of a model to all…

Machine Learning · Computer Science 2024-05-28 Georg Siedel , Weijia Shao , Silvia Vock , Andrey Morozov