English
Related papers

Related papers: Rethinking Robustness in Machine Learning: A Poste…

200 papers

Adversarial examples pose a security threat to many critical systems built on neural networks (such as face recognition systems, and self-driving cars). While many methods have been proposed to build robust models, how to build certifiably…

Machine Learning · Computer Science 2023-09-06 Ruihan Zhang , Peixin Zhang , Jun Sun

Matching methods are widely used to reduce confounding effects in observational studies, but conventional approaches often treat all covariates as equally important, which can result in poor performance when covariates differ in their…

Machine Learning · Statistics 2025-09-01 Hongzhe Zhang , Jiasheng Shi , Jing Huang

The escalating threat of adversarial attacks on deep learning models, particularly in security-critical fields, has underscored the need for robust deep learning systems. Conventional robustness evaluations have relied on adversarial…

Cryptography and Security · Computer Science 2024-11-19 Ping Guo , Cheng Gong , Xi Lin , Zhiyuan Yang , Qingfu Zhang

We study the problem of robustly estimating the posterior distribution for the setting where observed data can be contaminated with potentially adversarial outliers. We propose Rob-ULA, a robust variant of the Unadjusted Langevin Algorithm…

Machine Learning · Statistics 2019-07-30 Kush Bhatia , Yi-An Ma , Anca D. Dragan , Peter L. Bartlett , Michael I. Jordan

We propose a method for variable selection in the intensity function of spatial point processes that combines sparsity-promoting estimation with noise-robust model selection. As high-resolution spatial data becomes increasingly available…

Methodology · Statistics 2025-10-30 Dominik Sturm , Ivo F. Sbalzarini

Learning representations that capture the underlying data generating process is a key problem for data efficient and robust use of neural networks. One key property for robustness which the learned representation should capture and which…

Machine Learning · Computer Science 2022-06-24 Mathieu Chevalley , Charlotte Bunne , Andreas Krause , Stefan Bauer

Robustness to distribution shift and fairness have independently emerged as two important desiderata required of modern machine learning models. While these two desiderata seem related, the connection between them is often unclear in…

Machine Learning · Computer Science 2023-09-13 Maggie Makar , Alexander D'Amour

The accuracies for many pattern recognition tasks have increased rapidly year by year, achieving or even outperforming human performance. From the perspective of accuracy, pattern recognition seems to be a nearly-solved problem. However,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-15 Xu-Yao Zhang , Cheng-Lin Liu , Ching Y. Suen

In this paper we prove the existence of a fundamental trade-off between accuracy and robustness in perception-based control, where control decisions rely solely on data-driven, and often incompletely trained, perception maps. In particular,…

Optimization and Control · Mathematics 2020-03-18 Abed AlRahman Al Makdah , Vaibhav Katewa , Fabio Pasqualetti

A recent trend in deep learning algorithms has been towards training large scale models, having high parameter count and trained on big dataset. However, robustness of such large scale models towards real-world settings is still a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nishant Jain , Harkirat Behl , Yogesh Singh Rawat , Vibhav Vineet

This paper provides an overview of current approaches for solving inverse problems in imaging using variational methods and machine learning. A special focus lies on point estimators and their robustness against adversarial perturbations.…

Image and Video Processing · Electrical Eng. & Systems 2024-07-10 Alexander Auras , Kanchana Vaishnavi Gandikota , Hannah Droege , Michael Moeller

Robustness to adversarial attacks is typically evaluated with adversarial accuracy. While essential, this metric does not capture all aspects of robustness and in particular leaves out the question of how many perturbations can be found for…

Machine Learning · Computer Science 2023-08-14 Raphael Olivier , Bhiksha Raj

Principal component regression uses principal components as regressors. It is particularly useful in prediction settings with high-dimensional covariates. The existing literature treating of Bayesian approaches is relatively sparse. We…

Methodology · Statistics 2020-01-28 Philippe Gagnon , Mylène Bédard , Alain Desgagné

Despite being widely adopted as a canonical framework for learning robust models, adversarial training suffers from robust overfitting. Existing empirical measures and theoretical explorations are insufficient to provide satisfying…

Machine Learning · Computer Science 2026-03-10 Yuelin Xu , Xiao Zhang

In this study, we leverage the deliberate and systematic fault-injection capabilities of an open-source benchmark suite to perform a series of experiments on state-of-the-art deep and robust reinforcement learning algorithms. We aim to…

Robotics · Computer Science 2022-10-28 Catherine R. Glossop , Jacopo Panerati , Amrit Krishnan , Zhaocong Yuan , Angela P. Schoellig

Studying the robustness of machine learning models is important to ensure consistent model behaviour across real-world settings. To this end, adversarial robustness is a standard framework, which views robustness of predictions through a…

Machine Learning · Computer Science 2024-07-09 Tessa Han , Suraj Srinivas , Himabindu Lakkaraju

We study the robustness of system estimation to parametric perturbations in system dynamics and initial conditions. We define the problem of sensitivity-based parametric uncertainty quantification in dynamical system estimation. The main…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Ayush Pandey

Deep learning (DL) has demonstrated significant potential across various safety-critical applications, yet ensuring its robustness remains a key challenge. While adversarial robustness has been extensively studied in worst-case scenarios,…

Machine Learning · Computer Science 2025-03-11 Xingyu Zhao

Prediction becomes more challenging with missing covariates. What method is chosen to handle missingness can greatly affect how models perform. In many real-world problems, the best prediction performance is achieved by models that can…

This paper proves that robustness implies generalization via data-dependent generalization bounds. As a result, robustness and generalization are shown to be connected closely in a data-dependent manner. Our bounds improve previous bounds…

Machine Learning · Computer Science 2022-08-04 Kenji Kawaguchi , Zhun Deng , Kyle Luh , Jiaoyang Huang