English
Related papers

Related papers: Active Uncertainty Calibration in Bayesian ODE Sol…

200 papers

Probabilistic solvers for ordinary differential equations (ODEs) have emerged as an efficient framework for uncertainty quantification and inference on dynamical systems. In this work, we explain the mathematical assumptions and detailed…

Machine Learning · Statistics 2021-10-25 Nicholas Krämer , Nathanael Bosch , Jonathan Schmidt , Philipp Hennig

Recently there has been increasing interest in probabilistic solvers for ordinary differential equations (ODEs) that return full probability measures, instead of point estimates, over the solution and can incorporate uncertainty over the…

Numerical Analysis · Computer Science 2017-09-26 Emilia Magnani , Hans Kersting , Michael Schober , Philipp Hennig

Often the regression function is specified by a system of ordinary differential equations (ODEs) involving some unknown parameters. Typically analytical solution of the ODEs is not available, and hence likelihood evaluation at many…

Statistics Theory · Mathematics 2016-02-23 Prithwish Bhaumik , Subhashis Ghosal

Probabilistic numerical solvers for ordinary differential equations (ODEs) treat the numerical simulation of dynamical systems as problems of Bayesian state estimation. Aside from producing posterior distributions over ODE solutions and…

Numerical Analysis · Mathematics 2024-09-12 Nathanael Bosch , Adrien Corenflos , Fatemeh Yaghoobi , Filip Tronarp , Philipp Hennig , Simo Särkkä

Recently, combinations of generative and Bayesian machine learning have been introduced in particle physics for both fast detector simulation and inference tasks. These neural networks aim to quantify the uncertainty on the generated…

Machine Learning · Computer Science 2024-11-21 Sebastian Bieringer , Sascha Diefenbacher , Gregor Kasieczka , Mathias Trabs

Typical Bayesian approaches to OOD detection use epistemic uncertainty. Surprisingly from the Bayesian perspective, there are a number of methods that successfully use aleatoric uncertainty to detect OOD points (e.g. Hendryks et al. 2018).…

Machine Learning · Statistics 2021-10-29 Xi Wang , Laurence Aitchison

Calibration of large-scale differential equation models to observational or experimental data is a widespread challenge throughout applied sciences and engineering. A crucial bottleneck in state-of-the art calibration methods is the…

Optimization and Control · Mathematics 2021-02-23 Jon Cockayne , Andrew B. Duncan

We propose a novel approach for estimating conditional or parametric expectations in the setting where obtaining samples or evaluating integrands is costly. Through the framework of probabilistic numerical methods (such as Bayesian…

Machine Learning · Statistics 2024-06-25 Zonghao Chen , Masha Naslidnyk , Arthur Gretton , François-Xavier Briol

The interpretation of numerical methods, such as finite difference methods for differential equations, as point estimators allows for formal statistical quantification of the error due to discretisation in the numerical context. Competing…

Methodology · Statistics 2018-05-23 Junyang Wang , Jon Cockayne , Chris Oates

We address the problem of Bayesian inference for parameters in ordinary differential equation (ODE) models based on observational data. Conventional approaches in this setting typically rely on numerical solvers such as the Euler or…

Methodology · Statistics 2025-12-01 Shoji Toyota , Yuto Miyatake

Ordinary differential equations (ODEs) are a mathematical model used in many application areas such as climatology, bioinformatics, and chemical engineering with its intuitive appeal to modeling. Despite ODE's wide usage in modeling, the…

Applications · Statistics 2021-08-10 Hyunjoo Yang , Jaeyong Lee

Rigorous statistical methods, including parameter estimation with accompanying uncertainties, underpin the validity of scientific discovery, especially in the natural sciences. With increasingly complex data models such as deep learning…

Machine Learning · Computer Science 2026-02-18 Aurora Grefsrud , Nello Blaser , Trygve Buanes

With the increased prevalence of neural operators being used to provide rapid solutions to partial differential equations (PDEs), understanding the accuracy of model predictions and the associated error levels is necessary for deploying…

Machine Learning · Computer Science 2026-02-26 Nick Winovich , Mitchell Daneker , Lu Lu , Guang Lin

We describe a set of Gaussian Process based approaches that can be used to solve non-linear Ordinary Differential Equations. We suggest an explicit probabilistic solver and two implicit methods, one analogous to Picard iteration and the…

Methodology · Statistics 2014-08-19 David Barber

Predictions made by deep learning models are prone to data perturbations, adversarial attacks, and out-of-distribution inputs. To build a trusted AI system, it is therefore critical to accurately quantify the prediction uncertainties. While…

Machine Learning · Computer Science 2023-04-12 Hanjing Wang , Dhiraj Joshi , Shiqiang Wang , Qiang Ji

In this paper, we propose a progressive Bayesian procedure, where the measurement information is continuously included into the given prior estimate (although we perform observations at discrete time steps). The key idea is to derive a…

Systems and Control · Computer Science 2012-04-03 Uwe D. Hanebeck , Jannik Steinbring

Simulating complex physical systems is crucial for understanding and predicting phenomena across diverse fields, such as fluid dynamics and heat transfer, as well as plasma physics and structural mechanics. Traditional approaches rely on…

Bayesian optimization is a class of global optimization techniques. In Bayesian optimization, the underlying objective function is modeled as a realization of a Gaussian process. Although the Gaussian process assumption implies a random…

Statistics Theory · Mathematics 2023-05-08 Rui Tuo , Wenjia Wang

In many fields of application, dynamic processes that evolve through time are well described by systems of ordinary differential equations (ODEs). The analytical solution of the ODEs is often not available and different methods have been…

Methodology · Statistics 2017-07-19 Saverio Ranciati , Cinzia Viroli , Ernst Wit

Most problems in uncertainty quantification, despite its ubiquitousness in scientific computing, applied mathematics and data science, remain formidable on a classical computer. For uncertainties that arise in partial differential equations…

Quantum Physics · Physics 2022-09-29 Francois Golse , Shi Jin , Nana Liu