English
Related papers

Related papers: Improving robustness and calibration in ensembles …

200 papers

This work considers the problem of binary classification: given training data $x_1, \dots, x_n$ from a certain population, together with associated labels $y_1,\dots, y_n \in \left\{0,1 \right\}$, determine the best label for an element $x$…

Statistics Theory · Mathematics 2016-07-04 Nicolas Garcia Trillos , Ryan Murray

Integrating the outputs of multiple classifiers via combiners or meta-learners has led to substantial improvements in several difficult pattern recognition problems. In the typical setting investigated till now, each classifier is trained…

Machine Learning · Computer Science 2007-05-23 Kagan Tumer , Joydeep Ghosh

Randomized Smoothing (RS) is a promising method for obtaining robustness certificates by evaluating a base model under noise. In this work, we: (i) theoretically motivate why ensembles are a particularly suitable choice as base models for…

Machine Learning · Computer Science 2022-03-31 Miklós Z. Horváth , Mark Niklas Müller , Marc Fischer , Martin Vechev

Although quantization has emerged as a promising approach to reducing computational complexity across various high-level vision tasks, it inevitably leads to accuracy loss in image super-resolution (SR) networks. This is due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Cheeun Hong , Kyoung Mu Lee

We propose a framework for learning calibrated uncertainties under domain shifts, where the source (training) distribution differs from the target (test) distribution. We detect such domain shifts via a differentiable density ratio…

Machine Learning · Computer Science 2024-02-07 Haoxuan Wang , Zhiding Yu , Yisong Yue , Anima Anandkumar , Anqi Liu , Junchi Yan

We study an ensemble of diverse (inhomogeneous) thermostatically controlled loads aggregated to provide the demand response (DR) services in a district-level energy system. Each load in the ensemble is assumed to be equipped with a random…

Systems and Control · Computer Science 2018-10-04 David Métivier , Ilia Luchnikov , Michael Chertkov

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

Machine Learning · Computer Science 2024-08-23 Jie Wang , Rui Gao , Yao Xie

In the field of machine learning there is a growing interest towards more robust and generalizable algorithms. This is for example important to bridge the gap between the environment in which the training data was collected and the…

Machine Learning · Computer Science 2020-10-08 Wim Casteels , Peter Hellinckx

Deep learning is increasingly being applied in safety-critical domains. For these scenarios it is important to know the level of uncertainty in a model's prediction to ensure appropriate decisions are made by the system. Deep ensembles are…

Machine Learning · Computer Science 2022-03-17 Yassir Fathullah , Mark J. F. Gales

Accurate segmentation of white matter hyperintensities (WMH) is crucial for clinical decision-making, particularly in the context of multiple sclerosis. However, domain shifts, such as variations in MRI machine types or acquisition…

Image and Video Processing · Electrical Eng. & Systems 2025-06-18 Franco Matzkin , Agostina Larrazabal , Diego H Milone , Jose Dolz , Enzo Ferrante

The vulnerability of neural network classifiers to adversarial attacks is a major obstacle to their deployment in safety-critical applications. Regularization of network parameters during training can be used to improve adversarial…

Machine Learning · Computer Science 2024-05-28 Sheng Yang , Jacob A. Zavatone-Veth , Cengiz Pehlevan

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Probabilistic predictions can be evaluated through comparisons with observed label frequencies, that is, through the lens of calibration. Recent scholarship on algorithmic fairness has started to look at a growing variety of…

Machine Learning · Computer Science 2023-05-16 Benedikt Höltgen , Robert C Williamson

Estimating individual and average treatment effects from observational data is an important problem in many domains such as healthcare and e-commerce. In this paper, we advocate balance regularization of multi-head neural network…

Machine Learning · Computer Science 2020-11-24 Mehrdad Farajtabar , Andrew Lee , Yuanjian Feng , Vishal Gupta , Peter Dolan , Harish Chandran , Martin Szummer

As in other estimation scenarios, likelihood based estimation in the normal mixture set-up is highly non-robust against model misspecification and presence of outliers (apart from being an ill-posed optimization problem). A robust…

Methodology · Statistics 2023-12-20 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

In Dataset Condensation, the goal is to synthesize a small dataset that replicates the training utility of a large original dataset. Existing condensation methods synthesize datasets with significant redundancy, so there is a dire need to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Saumyaranjan Mohanty , Aravind Reddy , Konda Reddy Mopuri

Recently, deep learning has emerged as a promising tool for statistical downscaling, the set of methods for generating high-resolution climate fields from coarse low-resolution variables. Nevertheless, their ability to generalize to climate…

Machine Learning · Computer Science 2023-05-03 Jose González-Abad , Jorge Baño-Medina

Ensuring that classifiers are well-calibrated, i.e., their predictions align with observed frequencies, is a minimal and fundamental requirement for classifiers to be viewed as trustworthy. Existing methods for assessing multiclass…

Machine Learning · Computer Science 2025-10-30 Mahmoud Hegazy , Michael I. Jordan , Aymeric Dieuleveut

In classification applications, we often want probabilistic predictions to reflect confidence or uncertainty. Dropout, a commonly used training technique, has recently been linked to Bayesian inference, yielding an efficient way to quantify…

Machine Learning · Computer Science 2019-06-25 Zhilu Zhang , Adrian V. Dalca , Mert R. Sabuncu

Diversity is essential for language-model applications ranging from creative generation to scientific discovery, yet modern LLMs often collapse into a narrow subset of plausible outputs. While prior work has developed benchmarks for…