English
Related papers

Related papers: Uncertainty Quantification Metrics for Deep Regres…

200 papers

In this study, a novel idea, Uncertainty Structure Estimation (USE), a lightweight, algorithm-agnostic procedure that emphasizes the often-overlooked role of unlabeled data quality is introduced for Semi-supervised learning (SSL). SSL has…

Machine Learning · Computer Science 2026-03-03 Tsao-Lun Chen , Chien-Liang Liu , Tzu-Ming Harry Hsu , Tai-Hsien Wu , Chi-Cheng Fu , Han-Yi E. Chou , Shun-Feng Su

Uncertainty Quantification aims to determine when the prediction from a Machine Learning model is likely to be wrong. Computer Vision research has explored methods for determining epistemic uncertainty (also known as model uncertainty),…

Machine Learning · Computer Science 2024-03-15 Prithviraj Manivannan , Ivo Pascal de Jong , Matias Valdenegro-Toro , Andreea Ioana Sburlea

As machine learning (ML) models are increasingly deployed in high-stakes domains, trustworthy uncertainty quantification (UQ) is critical for ensuring the safety and reliability of these models. Traditional UQ methods rely on specifying a…

Machine Learning · Statistics 2025-05-14 Abhineet Agarwal , Michael Xiao , Rebecca Barter , Omer Ronen , Boyu Fan , Bin Yu

Machine learning (ML) systems are increasingly deployed in high-stakes domains where reliability is paramount. This thesis investigates how uncertainty estimation can enhance the safety and trustworthiness of ML, focusing on selective…

Machine Learning · Computer Science 2025-09-09 Stephan Rabanser

Uncertainty estimation is critical for numerous applications of deep neural networks and draws growing attention from researchers. Here, we demonstrate an uncertainty quantification approach for deep neural networks used in inverse problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Luzhe Huang , Jianing Li , Xiaofu Ding , Yijie Zhang , Hanlong Chen , Aydogan Ozcan

Among the many ways of quantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles…

Machine Learning · Computer Science 2021-12-10 Youngseog Chung , Willie Neiswanger , Ian Char , Jeff Schneider

We investigate the problem of determining the predictive confidence (or, conversely, uncertainty) of a neural classifier through the lens of low-resource languages. By training models on sub-sampled datasets in three different languages, we…

Computation and Language · Computer Science 2022-10-28 Dennis Ulmer , Jes Frellsen , Christian Hardmeier

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of…

Materials Science · Physics 2025-03-04 Danny Perez , Aparna P. A. Subramanyam , Ivan Maliyov , Thomas D. Swinburne

Capturing aleatoric uncertainty is a critical part of many machine learning systems. In deep learning, a common approach to this end is to train a neural network to estimate the parameters of a heteroscedastic Gaussian distribution by…

Machine Learning · Computer Science 2022-04-04 Maximilian Seitzer , Arash Tavakoli , Dimitrije Antic , Georg Martius

Segmentation tasks in medical imaging are inherently ambiguous: the boundary of a target structure is oftentimes unclear due to image quality and biological factors. As such, predicted segmentations from deep learning algorithms are…

Image and Video Processing · Electrical Eng. & Systems 2019-11-18 Katharina Hoebel , Ken Chang , Jay Patel , Praveer Singh , Jayashree Kalpathy-Cramer

This paper proposes a paradigm of uncertainty injection for training deep learning model to solve robust optimization problems. The majority of existing studies on deep learning focus on the model learning capability, while assuming the…

Machine Learning · Computer Science 2023-02-28 Wei Cui , Wei Yu

Data-driven forecasts of air quality have recently achieved more accurate short-term predictions. Despite their success, most of the current data-driven solutions lack proper quantifications of model uncertainty that communicate how much to…

Machine Learning · Computer Science 2021-12-07 Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , Gavin Taylor

Reasoning language models have set state-of-the-art (SOTA) records on many challenging benchmarks, enabled by multi-step reasoning induced using reinforcement learning. However, like previous language models, reasoning models are prone to…

Artificial Intelligence · Computer Science 2025-07-21 Zhiting Mei , Christina Zhang , Tenny Yin , Justin Lidard , Ola Shorinwa , Anirudha Majumdar

Reliable estimation of predictive uncertainty is crucial for machine learning applications, particularly in high-stakes scenarios where hedging against risks is essential. Despite its significance, there is no universal agreement on how to…

Machine Learning · Computer Science 2025-06-17 Kajetan Schweighofer , Lukas Aichberger , Mykyta Ielanskyi , Sepp Hochreiter

A particularly challenging problem in AI safety is providing guarantees on the behavior of high-dimensional autonomous systems. Verification approaches centered around reachability analysis fail to scale, and purely statistical approaches…

Artificial Intelligence · Computer Science 2025-03-11 Souradeep Dutta , Michele Caprio , Vivian Lin , Matthew Cleaveland , Kuk Jin Jang , Ivan Ruchkin , Oleg Sokolsky , Insup Lee

From the statistical learning perspective, complexity control via explicit regularization is a necessity for improving the generalization of over-parameterized models. However, the impressive generalization performance of neural networks…

Machine Learning · Computer Science 2021-02-09 Taejong Joo , Uijung Chung

The recent convergence of pervasive computing and machine learning has given rise to numerous services, impacting almost all areas of economic and social activity. However, the use of AI techniques precludes certain standard software…

Software Engineering · Computer Science 2025-12-11 Vladimir Balditsyn , Philippe Lalanda , German Vega , Stéphanie Chollet

Uncertainty quantification (UQ) helps to make trustworthy predictions based on collected observations and uncertain domain knowledge. With increased usage of deep learning in various applications, the need for efficient UQ methods that can…

Machine Learning · Computer Science 2021-11-09 Olga Graf , Pablo Flores , Pavlos Protopapas , Karim Pichara

We provide single-model estimates of aleatoric and epistemic uncertainty for deep neural networks. To estimate aleatoric uncertainty, we propose Simultaneous Quantile Regression (SQR), a loss function to learn all the conditional quantiles…

Machine Learning · Statistics 2019-09-09 Natasa Tagasovska , David Lopez-Paz

If Uncertainty Quantification (UQ) is crucial to achieve trustworthy Machine Learning (ML), most UQ methods suffer from disparate and inconsistent evaluation protocols. We claim this inconsistency results from the unclear requirements the…

Machine Learning · Computer Science 2022-07-28 Victor Bouvier , Simona Maggio , Alexandre Abraham , Léo Dreyfus-Schmidt