English
Related papers

Related papers: Towards Reliable Uncertainty Quantification via De…

200 papers

Ensembles of neural networks (NNs) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble's…

Machine Learning · Computer Science 2018-11-30 Tim Pearce , Mohamed Zaki , Andy Neely

We address the problem of uncertainty calibration. While standard deep neural networks typically yield uncalibrated predictions, calibrated confidence scores that are representative of the true likelihood of a prediction can be achieved…

Machine Learning · Computer Science 2021-06-24 Christian Tomani , Sebastian Gruber , Muhammed Ebrar Erdem , Daniel Cremers , Florian Buettner

Neural networks (NNs) often assign high confidence to their predictions, even for points far out-of-distribution, making uncertainty quantification (UQ) a challenge. When they are employed to model interatomic potentials in materials…

Machine Learning · Computer Science 2023-12-27 Aik Rui Tan , Shingo Urata , Samuel Goldman , Johannes C. B. Dietschreit , Rafael Gómez-Bombarelli

Deep unrolling is an emerging deep learning-based image reconstruction methodology that bridges the gap between model-based and purely deep learning-based image reconstruction methods. Although deep unrolling methods achieve…

Image and Video Processing · Electrical Eng. & Systems 2022-12-21 Canberk Ekmekci , Mujdat Cetin

One major impediment to the wider use of deep learning for clinical decision making is the difficulty of assigning a level of confidence to model predictions. Currently, deep Bayesian neural networks and sparse Gaussian processes are the…

Ensembles improve prediction performance and allow uncertainty quantification by aggregating predictions from multiple models. In deep ensembling, the individual models are usually black box neural networks, or recently, partially…

Machine Learning · Statistics 2022-05-26 Lucas Kook , Andrea Götschi , Philipp FM Baumann , Torsten Hothorn , Beate Sick

In chemistry, deep neural network models have been increasingly utilized in a variety of applications such as molecular property predictions, novel molecule designs, and planning chemical reactions. Despite the rapid increase in the use of…

Chemical Physics · Physics 2019-05-17 Seongok Ryu , Yongchan Kwon , Woo Youn Kim

Quantifying uncertainty in weather forecasts is critical, especially for predicting extreme weather events. This is typically accomplished with ensemble prediction systems, which consist of many perturbed numerical weather simulations, or…

Machine Learning · Computer Science 2021-03-17 Peter Grönquist , Chengyuan Yao , Tal Ben-Nun , Nikoli Dryden , Peter Dueben , Shigang Li , Torsten Hoefler

In this paper, we introduce a new technique that combines two popular methods to estimate uncertainty in object detection. Quantifying uncertainty is critical in real-world robotic applications. Traditional detection models can be ambiguous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Zongyao Lyu , Nolan B. Gutierrez , William J. Beksi

Deep ensembles are a powerful tool in machine learning, improving both model performance and uncertainty calibration. While ensembles are typically formed by training and tuning models individually, evidence suggests that jointly tuning the…

Machine Learning · Computer Science 2025-11-10 Laurits Fredsgaard , Mikkel N. Schmidt

Ensemble learning combines several individual models to obtain a better generalization performance. In this work we present a practical method for estimating the joint power of several classifiers. It differs from existing approaches which…

Artificial Intelligence · Computer Science 2023-12-22 Simi Haber , Yonatan Wexler

Ensemble method is considered the gold standard for uncertainty quantification (UQ) in machine learning interatomic potentials (MLIPs). However, their high computational cost can limit its practicality. Alternative techniques, such as Monte…

Machine Learning · Computer Science 2025-11-13 Shih-Peng Huang , Nontawat Charoenphakdee , Yuta Tsuboi , Yong-Bin Zhuang , Wenwen Li

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

In system analysis and design optimization, multiple computational models are typically available to represent a given physical system. These models can be broadly classified as high-fidelity models, which provide highly accurate…

Machine Learning · Computer Science 2024-11-01 Ruda Zhang , Negin Alemazkoor

Survival models are used in various fields, such as the development of cancer treatment protocols. Although many statistical and machine learning models have been proposed to achieve accurate survival predictions, little attention has been…

Machine Learning · Computer Science 2020-03-26 Hrushikesh Loya , Pranav Poduval , Deepak Anand , Neeraj Kumar , Amit Sethi

As deep learning-based computer vision algorithms continue to advance the state of the art, their robustness to real-world data continues to be an issue, making it difficult to bring an algorithm from the lab to the real world.…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Michael Smith , Frank Ferrie

In this paper, we adopt conformal prediction, a distribution-free uncertainty quantification (UQ) framework, to obtain confidence prediction intervals with coverage guarantees for Deep Operator Network (DeepONet) regression. Initially, we…

Machine Learning · Computer Science 2024-02-26 Christian Moya , Amirhossein Mollaali , Zecheng Zhang , Lu Lu , Guang Lin

Estimates of predictive uncertainty are important for accurate model-based planning and reinforcement learning. However, predictive uncertainties---especially ones derived from modern deep learning systems---can be inaccurate and impose a…

Machine Learning · Computer Science 2019-06-21 Ali Malik , Volodymyr Kuleshov , Jiaming Song , Danny Nemer , Harlan Seymour , Stefano Ermon

Linear programming is widely used for decision-making in science, engineering, and operations research, yet in many modern applications the coefficients entering the constraints and objective are not known exactly and must be learned from…

Other Statistics · Statistics 2026-03-09 Debashis Chatterjee

Reliable uncertainty quantification (UQ) in machine learning (ML) regression tasks is becoming the focus of many studies in materials and chemical science. It is now well understood that average calibration is insufficient, and most studies…

Machine Learning · Statistics 2024-01-25 Pascal Pernot