English
Related papers

Related papers: Robustness Quantification for Discriminative Model…

200 papers

Robust learning is an important issue in Scientific Machine Learning (SciML). There are several works in the literature addressing this topic. However, there is an increasing demand for methods that can simultaneously consider all the…

This note extends a recently proposed algorithm for model identification and robust MPC of asymptotically stable, linear time-invariant systems subject to process and measurement disturbances. Independent output predictors for different…

Systems and Control · Electrical Eng. & Systems 2021-03-02 Enrico Terzi , Lorenzo Fagiano , Marcello Farina , Riccardo Scattolini

Quantifying model uncertainty is critical for understanding prediction reliability, yet distinguishing between aleatoric and epistemic uncertainty remains challenging. We extend recent work from classification to regression to provide a…

Robust Bayesian analysis has been mainly devoted to detecting and measuring robustness w.r.t. the prior distribution. Many contributions in the literature aim to define suitable classes of priors which allow the computation of variations of…

Statistics Theory · Mathematics 2025-09-04 Antonio Di Noia , Fabrizio Ruggeri , Antonietta Mira

Measurement of uncertainty of predictions from machine learning methods is important across scientific domains and applications. We present, to our knowledge, the first such technique that quantifies the uncertainty of predictions from a…

Machine Learning · Statistics 2022-04-04 Alex Hagen , Karl Pazdernik , Nicole LaHaye , Marjolein Oostrom

As deep neural networks (DNNs) get adopted in an ever-increasing number of applications, explainability has emerged as a crucial desideratum for these models. In many real-world tasks, one of the principal reasons for requiring…

Artificial Intelligence · Computer Science 2020-07-03 Vedant Nanda , Till Speicher , John P. Dickerson , Krishna P. Gummadi , Muhammad Bilal Zafar

Predictive multiplicity occurs when classification models with statistically indistinguishable performances assign conflicting predictions to individual samples. When used for decision-making in applications of consequence (e.g., lending,…

Machine Learning · Computer Science 2022-10-21 Hsiang Hsu , Flavio du Pin Calmon

We study the robustness of classifiers to various kinds of random noise models. In particular, we consider noise drawn uniformly from the $\ell\_p$ ball for $p \in [1, \infty]$ and Gaussian noise with an arbitrary covariance matrix. We…

Machine Learning · Computer Science 2018-06-25 Jean-Yves Franceschi , Alhussein Fawzi , Omar Fawzi

Resiliency has garnered attention in the management of critical infrastructure as a metric of system performance, but there are significant roadblocks to its implementation in a realistic decision-making framework. Contrasted to risk and…

Systems and Control · Electrical Eng. & Systems 2026-01-08 Vincent P. Paglioni , Graeme Troxell , Aaron Brown , Steve Conrad , Mazdak Arabi

The success of neural networks across most machine learning tasks and the persistence of adversarial examples have made the verification of such models an important quest. Several techniques have been successfully developed to verify…

Machine Learning · Computer Science 2019-10-14 Nathanaël Fijalkow , Mohit Kumar Gupta

Despite having high accuracy, neural nets have been shown to be susceptible to adversarial examples, where a small perturbation to an input can cause it to become mislabeled. We propose metrics for measuring the robustness of a neural net…

Machine Learning · Computer Science 2017-06-19 Osbert Bastani , Yani Ioannou , Leonidas Lampropoulos , Dimitrios Vytiniotis , Aditya Nori , Antonio Criminisi

The goal of this paper is to analyze an intriguing phenomenon recently discovered in deep networks, namely their instability to adversarial perturbations (Szegedy et. al., 2014). We provide a theoretical framework for analyzing the…

Machine Learning · Computer Science 2016-03-30 Alhussein Fawzi , Omar Fawzi , Pascal Frossard

Development of robust dynamical systems and networks such as autonomous aircraft systems capable of accomplishing complex missions faces challenges due to the dynamically evolving uncertainties coming from model uncertainties, necessity to…

Regression methods are fundamental for scientific and technological applications. However, fitted models can be highly unreliable outside of their training domain, and hence the quantification of their uncertainty is crucial in many of…

Machine Learning · Statistics 2024-03-05 Filippo Bigi , Sanggyu Chong , Michele Ceriotti , Federico Grasselli

The uncertainty measurement of classifiers' predictions is especially important in applications such as medical diagnoses that need to ensure limited human resources can focus on the most uncertain predictions returned by machine learning…

Machine Learning · Computer Science 2019-07-18 Xuchao Zhang , Fanglan Chen , Chang-Tien Lu , Naren Ramakrishnan

"Effective robustness" measures the extra out-of-distribution (OOD) robustness beyond what can be predicted from the in-distribution (ID) performance. Existing effective robustness evaluations typically use a single test set such as…

Machine Learning · Computer Science 2023-10-31 Zhouxing Shi , Nicholas Carlini , Ananth Balashankar , Ludwig Schmidt , Cho-Jui Hsieh , Alex Beutel , Yao Qin

We study counterfactual classification as a new tool for decision-making under hypothetical (contrary to fact) scenarios. We propose a doubly-robust nonparametric estimator for a general counterfactual classifier, where we can incorporate…

Machine Learning · Computer Science 2023-01-31 Kwangho Kim , Edward H. Kennedy , José R. Zubizarreta

Adversarial robustness of machine learning models has attracted considerable attention over recent years. Adversarial attacks undermine the reliability of and trust in machine learning models, but the construction of more robust models…

Machine Learning · Computer Science 2020-10-19 Niklas Risse , Christina Göpfert , Jan Philip Göpfert

Deep continual learning requires models to adapt to new tasks without retraining from scratch. However, neural networks can lose their ability to adapt to new tasks after training on previous ones, a phenomenon known as loss of plasticity.…

Machine Learning · Computer Science 2026-05-12 Jiuqi Wang , Jayanth Srinivasa , Claire Chen , Shuze Daniel Liu , Ali Payani , Shangtong Zhang

Most of the regularization methods such as the LASSO have one (or more) regularization parameter(s), and to select the value of the regularization parameter is essentially equal to select a model. Thus, to obtain a model suitable for the…

Methodology · Statistics 2025-11-07 Sumito Kurata , Kei Hirose