English
Related papers

Related papers: Multi-task unscented Kalman inversion (MUKI): a de…

200 papers

Accurate modeling is crucial in many engineering and scientific applications, yet obtaining a reliable process model for complex systems is often challenging. To address this challenge, we propose a novel framework, reservoir computing with…

Machine Learning · Computer Science 2025-08-08 Kumar Anurag , Kasra Azizi , Francesco Sorrentino , Wenbin Wan

Performing stochastic inversion on a computationally expensive forward simulation model with a high-dimensional uncertain parameter space (e.g. a spatial random field) is computationally prohibitive even with gradient information provided.…

Computation · Statistics 2018-03-19 Charanraj A. Thimmisetty , Wenju Zhao , Xiao Chen , Charles H. Tong , Joshua A. White

Using Kalman techniques, it is possible to perform optimal estimation in linear Gaussian state-space models. We address here the case where the noise probability density functions are of unknown functional form. A flexible Bayesian…

Statistics Theory · Mathematics 2009-11-13 François Caron , Manuel Davy , Arnaud Doucet , Emmanuel Duflos , Philippe Vanheeghe

In this article, we study Bayesian inverse problems with multi-layered Gaussian priors. We first describe the conditionally Gaussian layers in terms of a system of stochastic partial differential equations. We build the computational…

Statistics Theory · Mathematics 2020-06-30 Muhammad Emzir , Sari Lasanen , Zenith Purisha , Lassi Roininen , Simo Särkkä

The unscented transformation (UT) is an efficient method to solve the state estimation problem for a non-linear dynamic system, utilizing a derivative-free higher-order approximation by approximating a Gaussian distribution rather than…

Machine Learning · Statistics 2016-08-29 Xi Liu , Badong Chen , Bin Xu , Zongze Wu , Paul Honeine

Balancing computational efficiency with robust predictive performance is crucial in supervised learning, especially for critical applications. Standard deep learning models, while accurate and scalable, often lack probabilistic features…

Machine Learning · Computer Science 2025-02-11 Conor Heins , Hao Wu , Dimitrije Markovic , Alexander Tschantz , Jeff Beck , Christopher Buckley

Ensemble Kalman inversion (EKI) is a derivative-free, particle-based optimization method for solving inverse problems. It can be shown that EKI approximates a gradient flow, which allows the application of methods for accelerating gradient…

Optimization and Control · Mathematics 2025-07-04 Sydney Vernon , Eviatar Bach , Oliver R. A. Dunbar

In recent years, methods for Bayesian inference have been widely used in many different problems in physics where detection and characterization are necessary. Data analysis in gravitational-wave astronomy is a prime example of such a case.…

Instrumentation and Methods for Astrophysics · Physics 2023-10-11 Nikolaos Karnesis , Michael L. Katz , Natalia Korsakova , Jonathan R. Gair , Nikolaos Stergioulas

We consider the Ensemble Kalman Inversion which has been recently introduced as an efficient, gradient-free optimisation method to estimate unknown parameters in an inverse setting. In the case of large data sets, the Ensemble Kalman…

Numerical Analysis · Mathematics 2023-12-05 Matei Hanu , Jonas Latz , Claudia Schillings

In recent years, Full-Waveform Inversion (FWI) has been extensively used to derive high-resolution subsurface velocity models from seismic data. However, due to the nonlinearity and ill-posed nature of the problem, FWI requires a good…

Inference for spatial generalized linear mixed models (SGLMMs) for high-dimensional non-Gaussian spatial data is computationally intensive. The computational challenge is due to the high-dimensional random effects and because Markov chain…

Computation · Statistics 2018-10-09 Yawen Guan , Murali Haran

Bayesian inference in the physical sciences faces a fundamental challenge: the imperative for high-fidelity physical modeling often clashes with the intrinsic limitations of stochastic sampling algorithms. Complex, high-dimensional…

Instrumentation and Methods for Astrophysics · Physics 2026-04-09 Bo Liang , Chang Liu , Hanlin Song , Tianyu Zhao , Minghui Du , He Wang , Haohao Gu , Sensen He , Yuxiang Xu , Wei-Liang Qian , Li-e Qiang , Peng Xu , Ziren Luo , Mingming Sun

Solving inverse problems without the use of derivatives or adjoints of the forward model is highly desirable in many applications arising in science and engineering. In this paper, we propose a new version of such a methodology, a framework…

Dynamical Systems · Mathematics 2019-10-17 Alfredo Garbuno-Inigo , Franca Hoffmann , Wuchen Li , Andrew M. Stuart

The generalized linear mixed model (GLMM) is widely used for analyzing correlated data, particularly in large-scale biomedical and social science applications. Scalable Bayesian inference for GLMMs is challenging because the marginal…

Computation · Statistics 2026-01-07 Samuel I. Berchuck , Youngsoo Baek , Felipe A. Medeiros , Andrea Agazzi

Bayesian inverse problems highly rely on efficient and effective inference methods for uncertainty quantification (UQ). Infinite-dimensional MCMC algorithms, directly defined on function spaces, are robust under refinement of physical…

Computation · Statistics 2019-05-22 Shiwei Lan

This paper introduces a Bayesian framework that combines Markov chain Monte Carlo (MCMC) sampling, dimensionality reduction, and neural density estimation to efficiently handle inverse problems that (i) must be solved multiple times, and…

Computational Engineering, Finance, and Science · Computer Science 2026-02-24 Giacomo Bottacini , Matteo Torzoni , Andrea Manzoni

This paper is concerned with the approximation of probability distributions known up to normalization constants, with a focus on Bayesian inference for large-scale inverse problems in scientific computing. In this context, key challenges…

Machine Learning · Computer Science 2025-06-10 Baojun Che , Yifan Chen , Zhenghao Huan , Daniel Zhengyu Huang , Weijie Wang

The present paper introduces a novel methodology for Unscented Kalman Filtering (UKF) on manifolds that extends previous work by the authors on UKF on Lie groups. Beyond filtering performance, the main interests of the approach are its…

Robotics · Computer Science 2020-03-12 Martin Brossard , Axel Barrau , Silvere Bonnabel

Because of their multimodality, mixture posterior distributions are difficult to sample with standard Markov chain Monte Carlo (MCMC) methods. We propose a strategy to enhance the sampling of MCMC in this context, using a biasing procedure…

Computation · Statistics 2011-04-19 Nicolas Chopin , Tony Lelievre , Gabriel Stoltz

The resolution of many large-scale inverse problems using MCMC methods requires a step of drawing samples from a high dimensional Gaussian distribution. While direct Gaussian sampling techniques, such as those based on Cholesky…

Methodology · Statistics 2015-06-22 Clément Gilavert , Saïd Moussaoui , Jérôme Idier