English
Related papers

Related papers: Accurate Surrogate Amplitudes with Calibrated Unce…

200 papers

Neural network ensembles, such as Bayesian neural networks (BNNs), have shown success in the areas of uncertainty estimation and robustness. However, a crucial challenge prohibits their use in practice. BNNs require a large number of…

Machine Learning · Computer Science 2022-07-15 Namuk Park , Songkuk Kim

Methods for reasoning under uncertainty are a key building block of accurate and reliable machine learning systems. Bayesian methods provide a general framework to quantify uncertainty. However, because of model misspecification and the use…

Machine Learning · Computer Science 2018-07-03 Volodymyr Kuleshov , Nathan Fenner , Stefano Ermon

Selective classification allows models to abstain from making predictions (e.g., say "I don't know") when in doubt in order to obtain better effective accuracy. While typical selective models can be effective at producing more accurate…

Machine Learning · Computer Science 2024-06-24 Adam Fisch , Tommi Jaakkola , Regina Barzilay

Uncertainty sampling is a prevalent active learning algorithm that queries sequentially the annotations of data samples which the current prediction model is uncertain about. However, the usage of uncertainty sampling has been largely…

Machine Learning · Computer Science 2026-04-08 Shang Liu , Xiaocheng Li

Surrogate modeling of non-linear oscillator networks remains challenging due to discrepancies between simplified analytical models and real-world complexity. To bridge this gap, we investigate hybrid reservoir computing, combining reservoir…

Systems and Control · Electrical Eng. & Systems 2025-05-20 Andrew Shannon , Conor Houghton , David Barton , Martin Homer

Modeling uncertainty in deep neural networks, despite recent important advances, is still an open problem. Bayesian neural networks are a powerful solution, where the prior over network weights is a design choice, often a normal…

Machine Learning · Statistics 2019-10-29 Raanan Y. Rohekar , Yaniv Gurwicz , Shami Nisimov , Gal Novik

In this technical report we study the problem of propagation of uncertainty (in terms of variances of given uni-variate normal random variables) through typical building blocks of a Convolutional Neural Network (CNN). These include layers…

Machine Learning · Computer Science 2021-02-12 Christos Tzelepis , Ioannis Patras

Modern neural networks have proven to be powerful function approximators, providing state-of-the-art performance in a multitude of applications. They however fall short in their ability to quantify confidence in their predictions - this is…

Machine Learning · Statistics 2020-06-29 Alex J. Chan , Ahmed M. Alaa , Zhaozhi Qian , Mihaela van der Schaar

Recent efforts to improve the predictability of TALYS-2.0 calculated charged-particle residual product cross sections have focused on adjusting parameters related to the optical model potential and pre-equilibrium process. Although adjusted…

Stochastic Petri Nets (SPNs) are an increasingly popular tool of choice for modeling discrete-event dynamics in areas such as epidemiology and systems biology, yet their parameter estimation remains challenging in general and in particular…

Machine Learning · Computer Science 2025-12-09 Bright Kwaku Manu , Trevor Reckell , Beckett Sterner , Petar Jevtic

This paper proposes a machine-learning-based solution approach for solving multi-horizon stochastic programs. The approach embeds a deep learning neural network into a multi-horizon stochastic program to approximate the recourse operational…

Optimization and Control · Mathematics 2025-12-03 Hongyu Zhang , Gabriele Sormani , Enza Messina , Alan King , Francesca Maggioni

Fast machine learning-based surrogate models are trained to emulate slow, high-fidelity engineering simulation models to accelerate engineering design tasks. This introduces uncertainty as the surrogate is only an approximation of the…

Machine Learning · Statistics 2020-10-08 Paul Westermann , Ralph Evins

Artificial neural networks (ANNs) are powerful machine learning methods used in many modern applications such as facial recognition, machine translation, and cancer diagnostics. A common issue with ANNs is that they usually have millions or…

Machine Learning · Statistics 2023-05-08 Lars Skaaret-Lund , Geir Storvik , Aliaksandr Hubin

Training a deep neural network (DNN) often involves stochastic optimization, which means each run will produce a different model. Several works suggest this variability is negligible when models have the same performance, which in the case…

Machine Learning · Statistics 2023-10-03 Sinjini Banerjee , Reilly Cannon , Tim Marrinan , Tony Chiang , Anand D. Sarwate

Explainability of black-box machine learning models is crucial, in particular when deployed in critical applications such as medicine or autonomous cars. Existing approaches produce explanations for the predictions of models, however, how…

Machine Learning · Computer Science 2021-11-18 Jonas Schulz , Rafael Poyiadzi , Raul Santos-Rodriguez

The quantification of uncertainties of computer simulations due to input parameter uncertainties is paramount to assess a model's credibility. For computationally expensive simulations, this is often feasible only via surrogate models that…

Methodology · Statistics 2021-08-30 Sascha Ranftl , Wolfgang von der Linden

The high dimensionality of kinetic equations with stochastic parameters poses major computational challenges for uncertainty quantification (UQ). Traditional Monte Carlo (MC) sampling methods, while widely used, suffer from slow convergence…

Numerical Analysis · Mathematics 2025-06-13 Wei Chen , Giacomo Dimarco , Lorenzo Pareschi

Surrogate models are data-based approximations of computationally expensive simulations that enable efficient exploration of the model's design space and informed decision-making in many physical domains. The usage of surrogate models in…

Sound · Computer Science 2022-12-14 Barbara Cunha , Abdel-Malek Zine , Mohamed Ichchou , Christophe Droz , Stéphane Foulard

Uncertainty quantification is crucial for building reliable and trustable machine learning systems. We propose to estimate uncertainty in recurrent neural networks (RNNs) via stochastic discrete state transitions over recurrent timesteps.…

Machine Learning · Computer Science 2020-11-25 Cheng Wang , Carolin Lawrence , Mathias Niepert

Neural networks make accurate predictions but often fail to provide reliable uncertainty estimates, especially under covariate distribution shifts between training and testing. To address this problem, we propose a Bayesian framework for…

Machine Learning · Statistics 2025-12-22 Yuli Slavutsky , David M. Blei