English
Related papers

Related papers: Sequential Kalman Tuning of the $t$-preconditioned…

200 papers

We present a novel algorithm based on the ensemble Kalman filter to solve inverse problems involving multiscale elliptic partial differential equations. Our method is based on numerical homogenization and finite element discretization and…

Numerical Analysis · Mathematics 2020-12-16 Assyr Abdulle , Giacomo Garegnani , Andrea Zanoni

The nonlinear and stochastic relationship between noise covariance parameter values and state estimator performance makes optimal filter tuning a very challenging problem. Popular optimization-based tuning approaches can easily get trapped…

Robotics · Computer Science 2023-06-13 Zhaozhong Chen , Harel Biggie , Nisar Ahmed , Simon Julier , Christoffer Heckman

Bayesian calibration is widely used for inverse analysis and uncertainty analysis for complex systems in the presence of both computer models and observation data. In the present work, we focus on large-scale fluid-structure interaction…

Numerical Analysis · Mathematics 2022-01-03 Shunxiang Cao , Daniel Zhengyu Huang

The extended Kalman filter (EKF) has been the industry standard for state estimation problems over the past sixty years. The classical formulation of the EKF is posed for nonlinear systems defined on global Euclidean spaces. The design…

Systems and Control · Electrical Eng. & Systems 2025-06-09 Yixiao Ge , Pieter van Goor , Robert Mahony

Nonlinear Bayesian update for a prior ensemble is proposed to extend traditional ensemble Kalman filtering to settings characterized by non-Gaussian priors and nonlinear measurement operators. In this framework, the observed component is…

Machine Learning · Statistics 2025-03-20 Yoonsang Lee

This paper presents a computationally fast algorithm for estimating, both, the system and observation noise covariances of nonlinear dynamics, that can be used in an ensemble Kalman filtering framework. The new method is a modification of…

Optimization and Control · Mathematics 2015-04-21 Yicun Zhen , John Harlim

In this paper, we introduce the Ensemble Kalman-Stein Gradient Descent (EnKSGD) class of algorithms. The EnKSGD class of algorithms builds on the ensemble Kalman filter (EnKF) line of work, applying techniques from sequential data…

Optimization and Control · Mathematics 2024-06-24 Brian Irwin , Sebastian Reich

Artificial neural networks (ANNs) are widely used in modeling sentence processing but often exhibit deterministic behavior, contrasting with human sentence comprehension, which manages uncertainty during ambiguous or unexpected inputs. This…

Computation and Language · Computer Science 2025-05-06 Diksha Bhandari , Alessandro Lopopolo , Milena Rabovsky , Sebastian Reich

Despite their theoretical appealingness, Bayesian neural networks (BNNs) are left behind in real-world adoption, mainly due to persistent concerns on their scalability, accessibility, and reliability. In this work, we develop the…

Machine Learning · Computer Science 2022-10-14 Zhijie Deng , Jun Zhu

Computing the regularized solution of Bayesian linear inverse problems as well as the corresponding regularization parameter is highly desirable in many applications. This paper proposes a novel iterative method, termed the Projected Newton…

Numerical Analysis · Mathematics 2025-04-08 Haibo Li

The unscented Kalman filter is an algorithm capable of handling nonlinear scenarios. Uncertainty in process noise covariance may decrease the filter estimation performance or even lead to its divergence. Therefore, it is important to adjust…

Robotics · Computer Science 2026-03-03 Amit Levy , Itzik Klein

Effective uncertainty quantification is important for training modern predictive models with limited data, enhancing both accuracy and robustness. While Bayesian methods are effective for this purpose, they can be challenging to scale. When…

Machine Learning · Computer Science 2025-05-30 Jasmeet Kaur

Bayesian Optimization is a very effective tool for optimizing expensive black-box functions. Inspired by applications developing and characterizing reaction chemistry using droplet microfluidic reactors, we consider a novel setting where…

Machine Learning · Computer Science 2023-01-12 Jose Pablo Folch , Shiqiang Zhang , Robert M Lee , Behrang Shafei , David Walz , Calvin Tsay , Mark van der Wilk , Ruth Misener

In this paper, we propose a novel adaptive-rank method for simulating multi-scale BGK equations, based on a greedy sampling strategy. The method adaptively selects important rows and columns of the solution matrix and updates them using a…

Numerical Analysis · Mathematics 2025-09-09 William A. Sands , Jing-Mei Qiu , Daniel Hayes , Nanyi Zheng

Approximate Bayesian computation (ABC) is the most popular approach to inferring parameters in the case where the data model is specified in the form of a simulator. It is not possible to directly implement standard Monte Carlo methods for…

Methodology · Statistics 2024-07-29 Richard G Everitt

Bayesian inference can be embedded into an appropriately defined dynamics in the space of probability measures. In this paper, we take Brownian motion and its associated Fokker--Planck equation as a starting point for such embeddings and…

Numerical Analysis · Mathematics 2021-02-09 Sebastian Reich , Simon Weissmann

Least squares support vector machines are a commonly used supervised learning method for nonlinear regression and classification. They can be implemented in either their primal or dual form. The latter requires solving a linear system,…

Machine Learning · Computer Science 2021-10-27 Maximilian Lucassen , Johan A. K. Suykens , Kim Batselier

Bayesian curve fitting plays an important role in inverse problems, and is often addressed using the Reversible Jump Markov Chain Monte Carlo (RJMCMC) algorithm. However, this algorithm can be computationally inefficient without…

Computation · Statistics 2024-02-28 Zhiyao Tian , Anthony Lee , Shunhua Zhou

Bayesian inference is a powerful paradigm for quantum state tomography, treating uncertainty in meaningful and informative ways. Yet the numerical challenges associated with sampling from complex probability distributions hampers Bayesian…

Quantum Physics · Physics 2020-05-04 Joseph M. Lukens , Kody J. H. Law , Ajay Jasra , Pavel Lougovski

This work presents a model reduction approach to the inverse problem in the application of subsurface flows. For the Bayesian inverse problem, the forward model needs to be repeatedly computed for a large number of samples to get a…

Numerical Analysis · Mathematics 2016-04-04 Lijian Jiang , Na Ou