English
Related papers

Related papers: Revisiting the Relation Between Robustness and Uni…

200 papers

This paper shows how universal learning can be achieved with expert advice. To this aim, we specify an experts algorithm with the following characteristics: (a) it uses only feedback from the actions actually chosen (bandit setup), (b) it…

Machine Learning · Computer Science 2007-05-23 Jan Poland , Marcus Hutter

The impact of predictive algorithms on people's lives and livelihoods has been noted in medicine, criminal justice, finance, hiring and admissions. Most of these algorithms are developed using data and human capital from highly developed…

Machine Learning · Computer Science 2021-03-30 Xingyu Li , Difan Song , Miaozhe Han , Yu Zhang , Rene F. Kizilcec

Adversarial Training is proved to be an efficient method to defend against adversarial examples, being one of the few defenses that withstand strong attacks. However, traditional defense mechanisms assume a uniform attack over the examples…

Machine Learning · Computer Science 2020-10-27 Huimin Zeng , Chen Zhu , Tom Goldstein , Furong Huang

We discuss recent work for causal inference and predictive robustness in a unifying way. The key idea relies on a notion of probabilistic invariance or stability: it opens up new insights for formulating causality as a certain risk…

Methodology · Statistics 2018-12-21 Peter Bühlmann

With the perpetual increase of complexity of the state-of-the-art deep neural networks, it becomes a more and more challenging task to maintain their interpretability. Our work aims to evaluate the effects of adversarial training utilized…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Delyan Boychev

In strategic classification, the standard supervised learning setting is extended to support the notion of strategic user behavior in the form of costly feature manipulations made in response to a classifier. While standard learning…

Machine Learning · Computer Science 2025-11-05 Benyamin Trachtenberg , Nir Rosenfeld

Machine learning models are vulnerable to adversarial examples formed by applying small carefully chosen perturbations to inputs that cause unexpected classification errors. In this paper, we perform experiments on various adversarial…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Andras Rozsa , Manuel Günther , Terrance E. Boult

The robustness of deep neural networks (DNNs) against adversarial attacks has been studied extensively in hopes of both better understanding how deep learning models converge and in order to ensure the security of these models in…

Machine Learning · Computer Science 2023-07-11 Jovon Craig , Josh Andle , Theodore S. Nowak , Salimeh Yasaei Sekeh

As large-scale training regimes have gained popularity, the use of pretrained models for downstream tasks has become common practice in machine learning. While pretraining has been shown to enhance the performance of models in practice, the…

Machine Learning · Computer Science 2023-10-10 Laura Fee Nern , Harsh Raj , Maurice Georgi , Yash Sharma

When neural networks are employed for high-stakes decision-making, it is desirable that they provide explanations for their prediction in order for us to understand the features that have contributed to the decision. At the same time, it is…

Machine Learning · Computer Science 2022-05-10 Penny Chong , Ngai-Man Cheung , Yuval Elovici , Alexander Binder

Neural networks are not learning optimal decision boundaries. We show that decision boundaries are situated in areas of low training data density. They are impacted by few training samples which can easily lead to overfitting. We provide a…

Machine Learning · Computer Science 2023-10-09 Johannes Schneider

Deep neural networks are powerful tools to detect hidden patterns in data and leverage them to make predictions, but they are not designed to understand uncertainty and estimate reliable probabilities. In particular, they tend to be…

Machine Learning · Statistics 2022-11-10 Bat-Sheva Einbinder , Yaniv Romano , Matteo Sesia , Yanfei Zhou

Deep artificial neural networks have made remarkable progress in different tasks in the field of computer vision. However, the empirical analysis of these models and investigation of their failure cases has received attention recently. In…

Computer Vision and Pattern Recognition · Computer Science 2016-02-10 Babak Saleh , Ahmed Elgammal , Jacob Feldman

Deep neural classifiers have recently found tremendous success in data-driven control systems. However, existing models suffer from a trade-off between accuracy and adversarial robustness. This limitation must be overcome in the control of…

Machine Learning · Computer Science 2024-06-05 Yatong Bai , Brendon G. Anderson , Somayeh Sojoudi

The traditional notion of generalization---i.e., learning a hypothesis whose empirical error is close to its true error---is surprisingly brittle. As has recently been noted in [DFH+15b], even if several algorithms have this guarantee in…

Data Structures and Algorithms · Computer Science 2016-06-03 Rachel Cummings , Katrina Ligett , Kobbi Nissim , Aaron Roth , Zhiwei Steven Wu

Deep neural networks have achieved success across a wide range of applications, including as models of human behavior and neural representations in vision tasks. However, neural network training and human learning differ in fundamental…

Computer Vision and Pattern Recognition · Computer Science 2025-09-04 Lukas Muttenthaler , Klaus Greff , Frieda Born , Bernhard Spitzer , Simon Kornblith , Michael C. Mozer , Klaus-Robert Müller , Thomas Unterthiner , Andrew K. Lampinen

It is not fully understood why adversarial examples can deceive neural networks and transfer between different networks. To elucidate this, several studies have hypothesized that adversarial perturbations, while appearing as noises, contain…

Machine Learning · Computer Science 2024-02-19 Soichiro Kumano , Hiroshi Kera , Toshihiko Yamasaki

Sometimes it is not enough for a DNN to produce an outcome. For example, in applications such as healthcare, users need to understand the rationale of the decisions. Therefore, it is imperative to develop algorithms to learn models with…

Machine Learning · Computer Science 2019-01-29 Yinpeng Dong , Fan Bao , Hang Su , Jun Zhu

A popular theory of perceptual processing holds that the brain learns both a generative model of the world and a paired recognition model using variational Bayesian inference. Most hypotheses of how the brain might learn these models assume…

Neurons and Cognition · Quantitative Biology 2021-06-01 Ari S. Benjamin , Konrad P. Kording

Performance of trained neural network (NN) models, in terms of testing accuracy, has improved remarkably over the past several years, especially with the advent of deep learning. However, even the most accurate NNs can be biased toward a…

Machine Learning · Computer Science 2023-03-14 Mahum Naseer , Bharath Srinivas Prabakaran , Osman Hasan , Muhammad Shafique