English
Related papers

Related papers: Affine Invariant Ensemble Transform Methods to Imp…

200 papers

This paper provides a unified perspective of iterative ensemble Kalman methods, a family of derivative-free algorithms for parameter reconstruction and other related tasks. We identify, compare and develop three subfamilies of ensemble…

Numerical Analysis · Mathematics 2020-10-27 Neil K. Chada , Yuming Chen , Daniel Sanz-Alonso

Neural network potentials (NNPs) combine the computational efficiency of classical interatomic potentials with the high accuracy and flexibility of the ab initio methods used to create the training set, but can also result in unphysical…

Materials Science · Physics 2022-01-24 Leonid Kahle , Federico Zipoli

Ensemble methods have become ubiquitous for the solution of Bayesian inference problems. State-of-the-art Langevin samplers such as the Ensemble Kalman Sampler (EKS), Affine Invariant Langevin Dynamics (ALDI) or its extension using weighted…

Numerical Analysis · Mathematics 2022-12-23 Martin Eigel , Robert Gruhlke , David Sommer

Neuronal ensemble inference is a significant problem in the study of biological neural networks. Various methods have been proposed for ensemble inference from experimental data of neuronal activity. Among them, Bayesian inference approach…

Disordered Systems and Neural Networks · Physics 2021-06-03 Shun Kimura , Keisuke Ota , Koujin Takeda

Deep ensembles can be considered as the current state-of-the-art for uncertainty quantification in deep learning. While the approach was originally proposed as a non-Bayesian technique, arguments supporting its Bayesian footing have been…

Machine Learning · Computer Science 2021-11-19 Lara Hoffmann , Clemens Elster

Understanding and interpreting how machine learning (ML) models make decisions have been a big challenge. While recent research has proposed various technical approaches to provide some clues as to how an ML model makes individual…

Machine Learning · Computer Science 2018-11-09 Wenbo Guo , Sui Huang , Yunzhe Tao , Xinyu Xing , Lin Lin

The ensemble Kalman filter (EnKF) is a widely used methodology for state estimation in partial, noisily observed dynamical systems, and for parameter estimation in inverse problems. Despite its widespread use in the geophysical sciences,…

Numerical Analysis · Mathematics 2016-09-21 Claudia Schillings , Andrew M. Stuart

Bayesian models quantify uncertainty and facilitate optimal decision-making in downstream applications. For most models, however, practitioners are forced to use approximate inference techniques that lead to sub-optimal decisions due to…

Machine Learning · Statistics 2019-09-12 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

This paper presents a new deterministic approximation technique in Bayesian networks. This method, "Expectation Propagation", unifies two previous techniques: assumed-density filtering, an extension of the Kalman filter, and loopy belief…

Artificial Intelligence · Computer Science 2013-01-14 Thomas P. Minka

We consider the problem of conditioning a geological process-based computer simulation, which produces basin models by simulating transport and deposition of sediments, to data. Emphasising uncertainty quantification, we frame this as a…

Applications · Statistics 2017-11-22 Jacob Skauvold , Jo Eidsvik

The Ensemble Kalman inversion (EKI) method is a method for the estimation of unknown parameters in the context of (Bayesian) inverse problems. The method approximates the underlying measure by an ensemble of particles and iteratively…

Numerical Analysis · Mathematics 2021-08-02 Dirk Blömker , Claudia Schillings , Philipp Wacker , Simon Weissmann

This article presents an up-to-date tutorial review of nonlinear Bayesian estimation. State estimation for nonlinear systems has been a challenge encountered in a wide range of engineering fields, attracting decades of research effort. To…

Systems and Control · Computer Science 2017-12-15 Huazhen Fang , Ning Tian , Yebin Wang , MengChu Zhou , Mulugeta A. Haile

While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function…

Machine Learning · Computer Science 2022-10-14 Tony Tohme , Kevin Vanslette , Kamal Youcef-Toumi

Inferring the state and unknown parameters of a network of coupled oscillators is of utmost importance. This task is made harder when only partial and noisy observations are available, which is a typical scenario in realistic…

Adaptation and Self-Organizing Systems · Physics 2025-04-07 Lauren D. Smith , Georg A. Gottwald

We present a scalable and robust Bayesian inference method for linear state space models. The method is applied to demand forecasting in the context of a large e-commerce platform, paying special attention to intermittent and bursty target…

In this manuscript, a general method for deriving filtering algorithms that involve a network of interconnected Bayesian filters is proposed. This method is based on the idea that the processing accomplished inside each of the Bayesian…

Statistics Theory · Mathematics 2020-04-22 Giorgio M. Vitetta , Pasquale Di Viesti , Emilio Sirignano , Francesco Montorsi

Bayesian sampling is an important task in statistics and machine learning. Over the past decade, many ensemble-type sampling methods have been proposed. In contrast to the classical Markov chain Monte Carlo methods, these new methods deploy…

Numerical Analysis · Mathematics 2024-05-14 Shi Chen , Zhiyan Ding , Qin Li

Model-based filtering is often carried out while subject to an imperfect model, as learning partially-observable stochastic systems remains a challenge. Recent work on Bayesian inference found that tempering the likelihood or full posterior…

Systems and Control · Electrical Eng. & Systems 2025-12-03 Menno van Zutphen , Domagoj Herceg , Giannis Delimpaltadakis , Duarte J. Antunes

Bayesian uncertainty quantification (UQ) is of interest to industry and academia as it provides a framework for quantifying and reducing the uncertainty in computational models by incorporating available data. For systems with very high…

Computational Physics · Physics 2020-04-14 Xinlei Zhang , Heng Xiao , Thomas Gomez , Olivier Coutier-Delgosha

The ensemble Kalman filter (EnKF) is a Monte Carlo approximation of the Kalman filter for high dimensional linear Gaussian state space models. EnKF methods have also been developed for parameter inference of static Bayesian models with a…