English
Related papers

Related papers: Robustness May Be at Odds with Accuracy

200 papers

This paper proves that robustness implies generalization via data-dependent generalization bounds. As a result, robustness and generalization are shown to be connected closely in a data-dependent manner. Our bounds improve previous bounds…

Machine Learning · Computer Science 2022-08-04 Kenji Kawaguchi , Zhun Deng , Kyle Luh , Jiaoyang Huang

Machine learning (ML) robustness and domain generalization are fundamentally correlated: they essentially concern data distribution shifts under adversarial and natural settings, respectively. On one hand, recent studies show that more…

Machine Learning · Computer Science 2022-06-27 Xiaojun Xu , Jacky Yibo Zhang , Evelyn Ma , Danny Son , Oluwasanmi Koyejo , Bo Li

Adversarial examples for neural network image classifiers are known to be transferable: examples optimized to be misclassified by a source classifier are often misclassified as well by classifiers with different architectures. However,…

Machine Learning · Computer Science 2021-10-27 Jacob M. Springer , Melanie Mitchell , Garrett T. Kenyon

Robustness of neural networks has recently attracted a great amount of interest. The many investigations in this area lack a precise common foundation of robustness concepts. Therefore, in this paper, we propose a rigorous and flexible…

Machine Learning · Computer Science 2021-06-01 Alessandro Tibo , Manfred Jaeger , Kim G. Larsen

Metric learning aims to learn a distance metric such that semantically similar instances are pulled together while dissimilar instances are pushed away. Many existing methods consider maximizing or at least constraining a distance margin in…

Machine Learning · Statistics 2022-08-17 Xiaochen Yang , Yiwen Guo , Mingzhi Dong , Jing-Hao Xue

Individuals use models to guide decisions, but many models are wrong. This paper studies which misspecified models are likely to persist when individuals also entertain alternative models. Consider an agent who uses her model to learn the…

Theoretical Economics · Economics 2023-08-22 Cuimin Ba

Adversarial training is widely used to make classifiers robust to a specific threat or adversary, such as $\ell_p$-norm bounded perturbations of a given $p$-norm. However, existing methods for training classifiers robust to multiple threats…

Machine Learning · Computer Science 2023-02-21 Francesco Croce , Sylvestre-Alvise Rebuffi , Evan Shelhamer , Sven Gowal

Representation learning, i.e. the generation of representations useful for downstream applications, is a task of fundamental importance that underlies much of the success of deep neural networks (DNNs). Recently, robustness to adversarial…

Machine Learning · Computer Science 2022-09-16 Christian Cianfarani , Arjun Nitin Bhagoji , Vikash Sehwag , Ben Y. Zhao , Prateek Mittal , Haitao Zheng

Despite achieving impressive performance, state-of-the-art classifiers remain highly vulnerable to small, imperceptible, adversarial perturbations. This vulnerability has proven empirically to be very intricate to address. In this paper, we…

Machine Learning · Computer Science 2018-12-03 Alhussein Fawzi , Hamza Fawzi , Omar Fawzi

For machine learning models to be reliable and trustworthy, their decisions must be interpretable. As these models find increasing use in safety-critical applications, it is important that not just the model predictions but also their…

Machine Learning · Computer Science 2023-12-19 Sandesh Kamath , Sankalp Mittal , Amit Deshpande , Vineeth N Balasubramanian

Several recent works have developed methods for training classifiers that are certifiably robust against norm-bounded adversarial perturbations. These methods assume that all the adversarial transformations are equally important, which is…

Machine Learning · Computer Science 2019-03-06 Xiao Zhang , David Evans

Adversarial training is one of the most effective approaches defending against adversarial examples for deep learning models. Unlike other defense strategies, adversarial training aims to promote the robustness of models intrinsically.…

Machine Learning · Computer Science 2021-04-22 Tao Bai , Jinqi Luo , Jun Zhao , Bihan Wen , Qian Wang

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

Machine Learning · Computer Science 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Adversarial training algorithms have been proved to be reliable to improve machine learning models' robustness against adversarial examples. However, we find that adversarial training algorithms tend to introduce severe disparity of…

Machine Learning · Computer Science 2021-05-20 Han Xu , Xiaorui Liu , Yaxin Li , Anil K. Jain , Jiliang Tang

Vulnerability to adversarial attacks is a well-known weakness of Deep Neural networks. While most of the studies focus on single-task neural networks with computer vision datasets, very little research has considered complex multi-task…

Machine Learning · Computer Science 2021-10-29 Salah Ghamizi , Maxime Cordy , Mike Papadakis , Yves Le Traon

Adversarial training for neural networks has been in the limelight in recent years. The advancement in neural network architectures over the last decade has led to significant improvement in their performance. It sparked an interest in…

Machine Learning · Computer Science 2022-06-07 Abhijith Sharma , Apurva Narayan

Although deep networks achieve strong accuracy on a range of computer vision benchmarks, they remain vulnerable to adversarial attacks, where imperceptible input perturbations fool the network. We present both theoretical and empirical…

Computer Vision and Pattern Recognition · Computer Science 2020-09-14 Chengzhi Mao , Amogh Gupta , Vikram Nitin , Baishakhi Ray , Shuran Song , Junfeng Yang , Carl Vondrick

The problem of adversarial examples has highlighted the need for a theory of regularisation that is general enough to apply to exotic function classes, such as universal approximators. In response, we give a very general equality result…

Machine Learning · Computer Science 2020-02-12 Zac Cranko , Zhan Shi , Xinhua Zhang , Richard Nock , Simon Kornblith

While additional training data improves the robustness of deep neural networks against adversarial examples, it presents the challenge of curating a large number of specific real-world samples. We circumvent this challenge by using…

Machine Learning · Computer Science 2022-03-04 Vikash Sehwag , Saeed Mahloujifar , Tinashe Handina , Sihui Dai , Chong Xiang , Mung Chiang , Prateek Mittal

A recent technique of randomized smoothing has shown that the worst-case (adversarial) $\ell_2$-robustness can be transformed into the average-case Gaussian-robustness by "smoothing" a classifier, i.e., by considering the averaged…

Machine Learning · Computer Science 2021-01-11 Jongheon Jeong , Jinwoo Shin