English
Related papers

Related papers: Probability Measures for Numerical Solutions of Di…

200 papers

Proper quantification of predictive uncertainty is essential for the use of machine learning in safety-critical applications. Various uncertainty measures have been proposed for this purpose, typically claiming superiority over other…

Machine Learning · Computer Science 2025-12-16 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

Uncertainty quantification is crucial for building reliable and trustable machine learning systems. We propose to estimate uncertainty in recurrent neural networks (RNNs) via stochastic discrete state transitions over recurrent timesteps.…

Machine Learning · Computer Science 2020-11-25 Cheng Wang , Carolin Lawrence , Mathias Niepert

Numerical models based on partial differential equations (PDE), or integro-differential equations, are ubiquitous in engineering and science, making it possible to understand or design systems for which physical experiments would be…

Computational Physics · Physics 2021-04-02 Julien Bect , Souleymane Zio , Guillaume Perrin , Claire Cannamela , Emmanuel Vazquez

Deterministic mathematical models, such as those specified via differential equations, are a powerful tool to communicate scientific insight. However, such models are necessarily simplified descriptions of the real world. Generalised…

Methodology · Statistics 2025-03-24 Zheyang Shen , Jeremias Knoblauch , Sam Power , Chris. J. Oates

Reliable probability estimation is of crucial importance in many real-world applications where there is inherent (aleatoric) uncertainty. Probability-estimation models are trained on observed outcomes (e.g. whether it has rained or not, or…

The interpretation of numerical methods, such as finite difference methods for differential equations, as point estimators suggests that formal uncertainty quantification can also be performed in this context. Competing statistical…

Other Statistics · Statistics 2019-09-24 Junyang Wang , Jon Cockayne , Chris J. Oates

The notion of uncertainty is of major importance in machine learning and constitutes a key element of machine learning methodology. In line with the statistical tradition, uncertainty has long been perceived as almost synonymous with…

Machine Learning · Computer Science 2021-06-24 Eyke Hüllermeier , Willem Waegeman

Filtering-based probabilistic numerical solvers for ordinary differential equations (ODEs), also known as ODE filters, have been established as efficient methods for quantifying numerical uncertainty in the solution of ODEs. In practical…

Machine Learning · Statistics 2025-10-02 Dingling Yao , Filip Tronarp , Nathanael Bosch

The quantification of aleatoric and epistemic uncertainty in terms of conditional entropy and mutual information, respectively, has recently become quite common in machine learning. While the properties of these measures, which are rooted…

Machine Learning · Computer Science 2023-06-27 Lisa Wimmer , Yusuf Sale , Paul Hofman , Bern Bischl , Eyke Hüllermeier

Rigorous assessment of uncertainty is crucial to the utility of DNS results. Uncertainties in the computed statistics arise from two sources: finite statistical sampling and the discretization of the Navier-Stokes equations. Due to the…

Fluid Dynamics · Physics 2015-06-17 Todd A. Oliver , Nicholas Malaya , Rhys Ulerich , Robert D. Moser

Models are often given in terms of differential equations to represent physical systems. In the presence of uncertainty, accurate prediction of the behavior of these systems using the models requires understanding the effect of uncertainty…

Computational Physics · Physics 2020-08-12 Subhayan De

There are various measures of predictive uncertainty in the literature, but their relationships to each other remain unclear. This paper uses a decomposition of statistical pointwise risk into components, associated with different sources…

Machine Learning · Statistics 2025-02-18 Nikita Kotelevskii , Vladimir Kondratyev , Martin Takáč , Éric Moulines , Maxim Panov

This paper addresses the estimation of uncertain distributed diffusion coefficients in elliptic systems based on noisy measurements of the model output. We formulate the parameter identification problem as an infinite dimensional…

Optimization and Control · Mathematics 2015-06-11 Jeff Borggaard , Hans-Werner van Wyk

Uncertainty Quantification (UQ) is essential in probabilistic machine learning models, particularly for assessing the reliability of predictions. In this paper, we present a systematic framework for estimating both epistemic and aleatoric…

Machine Learning · Statistics 2025-09-11 Marzieh Ajirak , Anand Ravishankar , Petar M. Djuric

Decomposing predictive uncertainty into epistemic (model ignorance) and aleatoric (data ambiguity) components is central to reliable decision making, yet most methods estimate both from the same predictive distribution. Recent empirical and…

Machine Learning · Computer Science 2026-02-13 Tanmoy Mukherjee , Marius Kloft , Pierre Marquis , Zied Bouraoui

Probabilistic solvers for ordinary differential equations assign a posterior measure to the solution of an initial value problem. The joint covariance of this distribution provides an estimate of the (global) approximation error. The…

Numerical Analysis · Mathematics 2021-02-23 Nathanael Bosch , Philipp Hennig , Filip Tronarp

We apply random matrix theory to study the impact of measurement uncertainty on dynamic mode decomposition. Specifically, when the measurements follow a normal probability density function, we show how the moments of that density propagate…

Methodology · Statistics 2025-09-04 P. Algikar , P. Sharma , M. Netto , L. Mili

This paper presents a novel numerical method for the hybrid reliability analysis by using the uncertainty theory. Aleatory uncertainty and epistemic uncertainty are considered simultaneously in this method. Epistemic uncertainty is…

Computational Engineering, Finance, and Science · Computer Science 2020-09-18 Lei Zhang

Data-driven model identification strategies can be used to obtain phenomenological models that capture the temporal evolution of observable data. While it is usually straightforward to obtain such a model from time series data, for instance…

Dynamical Systems · Mathematics 2026-03-25 Mohamed Akrout , Dan Wilson

In this article we study the problem of quantifying the uncertainty in an experiment with a technical system. We propose new density estimates which combine observed data of the technical system and simulated data from an (imperfect)…

Statistics Theory · Mathematics 2020-12-21 Sebastian Kersting , Michael Kohler