English
Related papers

Related papers: Dropout Ensemble Kalman inversion for high dimensi…

200 papers

We are interested in ensemble methods to solve multi-objective optimization problems. An ensemble Kalman method is proposed to solve a formulation of the nonlinear problem using a weighted function approach. An analysis of the mean field…

Numerical Analysis · Mathematics 2022-03-21 Michael Herty , Elisa Iacomini

In recent years, uncertainty-aware full waveform inversion (FWI) has received increasing attention, with a growing emphasis on producing informative uncertainty estimates alongside inversion results. Bayesian inference methods--particularly…

Geophysics · Physics 2025-05-14 Yunduo Li , Yijie Zhang , Xueyu Zhu , Jinghuai Gao

The ensemble Kalman filter (EnKF) is a widely used methodology for state estimation in partial, noisily observed dynamical systems, and for parameter estimation in inverse problems. Despite its widespread use in the geophysical sciences,…

Numerical Analysis · Mathematics 2016-09-21 Claudia Schillings , Andrew M. Stuart

Ensemble methods have become ubiquitous for the solution of Bayesian inference problems. State-of-the-art Langevin samplers such as the Ensemble Kalman Sampler (EKS), Affine Invariant Langevin Dynamics (ALDI) or its extension using weighted…

Numerical Analysis · Mathematics 2022-12-23 Martin Eigel , Robert Gruhlke , David Sommer

The dynamic ensemble selection of classifiers is an effective approach for processing label-imbalanced data classifications. However, such a technique is prone to overfitting, owing to the lack of regularization methods and the dependence…

Machine Learning · Computer Science 2020-11-09 Chen Wang , Chengyuan Deng , Zhoulu Yu , Dafeng Hui , Xiaofeng Gong , Ruisen Luo

Different approaches to using data-driven methods for subgrid-scale closure modeling have emerged recently. Most of these approaches are data-hungry, and lack interpretability and out-of-distribution generalizability. Here, we use {online}…

Bayesian experimental design (BED) for complex physical systems is often limited by the nested inference required to estimate the expected information gain (EIG) or its gradients. Each outer sample induces a different posterior, creating a…

Information Theory · Computer Science 2026-04-21 Huchen Yang , Xinghao Dong , Jinlong Wu

Subspace clustering is the unsupervised grouping of points lying near a union of low-dimensional linear subspaces. Algorithms based directly on geometric properties of such data tend to either provide poor empirical performance, lack…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 John Lipor , David Hong , Yan Shuo Tan , Laura Balzano

Inverse problems are more challenging when only partial data are available in general. In this paper, we propose a two-step approach combining the extended sampling method and the ensemble Kalman filter to reconstruct an elastic rigid…

Numerical Analysis · Mathematics 2020-10-13 Zhaoxing Li , Jiguang Sun , Liwei Xu

We propose the application of iterative regularization for the development of ensemble methods for solving Bayesian inverse problems. In concrete, we construct (i) a variational iterative regularizing ensemble Levenberg-Marquardt method…

Numerical Analysis · Mathematics 2014-06-25 Marco A. Iglesias

The iterative ensemble Kalman filter (IEnKF) is widely used in inverse problems to estimate system parameters from limited observations. However, the IEnKF, when applied to nonlinear systems, can be plagued by poor convergence. Here we…

Optimization and Control · Mathematics 2019-10-11 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

This manuscript derives locally weighted ensemble Kalman methods from the point of view of ensemble-based function approximation. This is done by using pointwise evaluations to build up a local linear or quadratic approximation of a…

Numerical Analysis · Mathematics 2025-05-07 Philipp Wacker

Inverse problems are ubiquitous because they formalize the integration of data with mathematical models. In many scientific applications the forward model is expensive to evaluate, and adjoint computations are difficult to employ; in this…

Dynamical Systems · Mathematics 2021-11-05 G. A. Pavliotis , A. M. Stuart , U. Vaes

Sampling of sharp posteriors in high dimensions is a challenging problem, especially when gradients of the likelihood are unavailable. In low to moderate dimensions, affine-invariant methods, a class of ensemble-based gradient-free methods,…

Methodology · Statistics 2022-02-23 Matthew M. Dunlop , Georg Stadler

We develop an interpolation-based modeling framework for parameter-dependent partial differential equations arising in control, inverse problems, and uncertainty quantification. The solution is discretized in the physical domain using…

Numerical Analysis · Mathematics 2026-04-20 Erik Burman , Mats G. Larson , Karl Larsson , Jonatan Vallin

Compressed Estimation approaches, such as the Generalised Compressed Kalman Filter (GCKF), reduce the computational cost and complexity of high dimensional and high frequency data assimilation problems; usually without sacrificing…

Systems and Control · Computer Science 2018-11-21 Karan Narula , Jose Guivant

In the process of reproducing the state dynamics of parameter dependent distributed systems, data from physical measurements can be incorporated into the mathematical model to reduce the parameter uncertainty and, consequently, improve the…

Numerical Analysis · Mathematics 2022-10-06 Francesco A. B. Silva , Cecilia Pagliantini , Martin Grepl , Karen Veroy

Ensemble smoother (ES) has been widely used in various research fields to reduce the uncertainty of the system-of-interest. However, the commonly-adopted ES method that employs the Kalman formula, that is, ES$_\text{(K)}$, does not perform…

Optimization and Control · Mathematics 2021-02-03 Jiangjiang Zhang , Qiang Zheng , Laosheng Wu , Lingzao Zeng

We propose an approach based on function evaluations and Bayesian inference to extract higher-order differential information of objective functions {from a given ensemble of particles}. Pointwise evaluation $\{V(x^i)\}_i$ of some potential…

Machine Learning · Statistics 2023-03-02 Claudia Schillings , Claudia Totzeck , Philipp Wacker

Ensemble Kalman methods constitute an increasingly important tool in both state and parameter estimation problems. Their popularity stems from the derivative-free nature of the methodology which may be readily applied when computer code is…

Optimization and Control · Mathematics 2019-09-10 David J. Albers , Paul-Adrien Blancquart , Matthew E. Levine , Elnaz Esmaeilzadeh Seylabi , Andrew Stuart