English
Related papers

Related papers: Calibrate, Emulate, Sample

200 papers

Many data-science problems can be formulated as an inverse problem, where the parameters are estimated by minimizing a proper loss function. When complicated black-box models are involved, derivative-free optimization tools are often…

Numerical Analysis · Mathematics 2021-10-19 Neil K. Chada , Xin T. Tong

Bayesian inference offers a robust framework for updating prior beliefs based on new data using Bayes' theorem, but exact inference is often computationally infeasible, necessitating approximate methods. Though widely used, these methods…

Machine Learning · Statistics 2024-10-23 Xu-Hui Zhou , Zhuo-Ran Liu , Heng Xiao

Bayesian experimental design (BED) for complex physical systems is often limited by the nested inference required to estimate the expected information gain (EIG) or its gradients. Each outer sample induces a different posterior, creating a…

Information Theory · Computer Science 2026-04-21 Huchen Yang , Xinghao Dong , Jinlong Wu

This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a…

Numerical Analysis · Mathematics 2025-05-07 Philipp Wacker

Bayesian methods have been very successful in quantifying uncertainty in physics-based problems in parameter estimation and prediction. In these cases, physical measurements y are modeled as the best fit of a physics-based model…

Data Analysis, Statistics and Probability · Physics 2015-02-06 Dave Higdon , Jordan D. McDonnell , Nicolas Schunck , Jason Sarich , Stefan M. Wild

In the paper, we develop an ensemble-based implicit sampling method for Bayesian inverse problems. For Bayesian inference, the iterative ensemble smoother (IES) and implicit sampling are integrated to obtain importance ensemble samples,…

Numerical Analysis · Mathematics 2018-12-04 Yuming Ba , Lijian Jiang

Standard maximum likelihood or Bayesian approaches to parameter estimation for stochastic differential equations are not robust to perturbations in the continuous-in-time data. In this paper, we give a rather elementary explanation of this…

Numerical Analysis · Mathematics 2023-12-20 Sebastian Reich

We propose an affine-mapping based variational Ensemble Kalman filter for sequential Bayesian filtering problems with generic observation models. Specifically, the proposed method is formulated as to construct an affine mapping from the…

Numerical Analysis · Mathematics 2021-09-06 Linjie Wen , Jinglai Li

The Ensemble Kalman filter (EnKF) was introduced by Evensen in 1994 [10] as a novel method for data assimilation: state estimation for noisily observed time-dependent problems. Since that time it has had enormous impact in many application…

Optimization and Control · Mathematics 2013-04-08 Marco A. Iglesias , Kody J. H. Law , Andrew M. Stuart

Ensemble Kalman Inversion (EKI) methods are a family of iterative methods for solving weighted least-squares problems, especially those arising in scientific and engineering inverse problems in which unknown parameters or states are…

Numerical Analysis · Mathematics 2025-05-26 Elizabeth Qian , Christopher Beattie

Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that…

Statistics Theory · Mathematics 2021-10-04 Oliver R. A. Dunbar , Alfredo Garbuno-Inigo , Tapio Schneider , Andrew M. Stuart

Inverse problems are more challenging when only partial data are available in general. In this paper, we propose a two-step approach combining the extended sampling method and the ensemble Kalman filter to reconstruct an elastic rigid…

Numerical Analysis · Mathematics 2020-10-13 Zhaoxing Li , Jiguang Sun , Liwei Xu

Ensemble Kalman inversion (EKI) is an ensemble-based method to solve inverse problems. Its gradient-free formulation makes it an attractive tool for problems with involved formulation. However, EKI suffers from the ''subspace property'',…

Numerical Analysis · Mathematics 2025-04-11 Shuigen Liu , Sebastian Reich , Xin T. Tong

Computer models, aiming at simulating a complex real system, are often calibrated in the light of data to improve performance. Standard calibration methods assume that the optimal values of calibration parameters are invariant to the model…

Methodology · Statistics 2017-09-01 Georgios Karagiannis , Bledar A. Konomi , Guang Lin

Inverse problems are common and important in many applications in computational physics but are inherently ill-posed with many possible model parameters resulting in satisfactory results in the observation space. When solving the inverse…

Computational Physics · Physics 2020-06-24 Xin-Lei Zhang , Carlos Michelén-Ströfer , Heng Xiao

This study aims to investigate the utilization of Bayesian techniques for the calibration of micro-electro-mechanical systems (MEMS) accelerometers. These devices have garnered substantial interest in various practical applications and…

Signal Processing · Electrical Eng. & Systems 2023-06-13 Oliver Dürr , Po-Yu Fan , Zong-Xian Yin

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

The present paper proposes a Bayesian framework for inverse problems that seamlessly integrates optimization and inversion to enable rapid surrogate modeling, accurate parameter inference, and rigorous uncertainty quantification. Bayesian…

Computational Engineering, Finance, and Science · Computer Science 2026-02-05 Mihaela Chiappetta , Massimo Carraturo , Alexander Raßloff , Markus Kästner , Ferdinando Auricchio

Using Kalman techniques, it is possible to perform optimal estimation in linear Gaussian state-space models. We address here the case where the noise probability density functions are of unknown functional form. A flexible Bayesian…

Statistics Theory · Mathematics 2009-11-13 François Caron , Manuel Davy , Arnaud Doucet , Emmanuel Duflos , Philippe Vanheeghe

Numerical models of geothermal reservoirs typically depend on hundreds or thousands of unknown parameters, which must be estimated using sparse, noisy data. However, these models capture complex physical processes, which frequently results…