English
Related papers

Related papers: Sequential Kalman Tuning of the $t$-preconditioned…

200 papers

We study the Electrical Impedance Tomography Bayesian inverse problem for recovering the conductivity given noisy measurements of the voltage on some boundary surface electrodes. The uncertain conductivity depends linearly on a countable…

Numerical Analysis · Mathematics 2023-06-16 Quang Huy Pham , Viet Ha Hoang

Ensemble Kalman filter (EnKF) has been widely used in state estimation and parameter estimation for the dynamic system where observational data is obtained sequentially in time. To reduce uncertainty and accelerate posterior inference, a…

Numerical Analysis · Mathematics 2018-11-14 Yuming Ba , Lijian Jiang , Na Ou

Bayesian inference, while foundational to probabilistic reasoning, is often hampered by the computational intractability of posterior distributions, particularly through the challenging evidence integral. Conventional approaches like Markov…

Machine Learning · Computer Science 2025-11-11 Di Zhang

The efficient resolution of Bayesian inverse problems remains challenging due to the high computational cost of traditional sampling methods. In this paper, we propose a novel framework that integrates Conditional Flow Matching (CFM) with a…

Machine Learning · Computer Science 2025-05-20 Daniil Sherki , Ivan Oseledets , Ekaterina Muravleva

When solving inverse problems, one increasingly popular approach is to use pre-trained diffusion models as plug-and-play priors. This framework can accommodate different forward models without re-training while preserving the generative…

Machine Learning · Computer Science 2025-06-04 Hongkai Zheng , Wenda Chu , Austin Wang , Nikola Kovachki , Ricardo Baptista , Yisong Yue

Compared to point estimates calculated by standard neural networks, Bayesian neural networks (BNN) provide probability distributions over the output predictions and model parameters, i.e., the weights. Training the weight distribution of a…

Machine Learning · Computer Science 2022-12-01 Philipp Wagner , Xinyang Wu , Marco F. Huber

This paper introduces a Gaussian Bayesian Network-based Extended Kalman Filter (GBN-EKF) for non-linear state estimators on stiff and ill-conditioned continuous-discrete stochastic systems, with a further analysis on systems with…

Optimization and Control · Mathematics 2025-11-05 Priyank Behera , C. Robert Kenley

Bayesian approaches have been successfully integrated into training deep neural networks. One popular family is stochastic gradient Markov chain Monte Carlo methods (SG-MCMC), which have gained increasing interest due to their scalability…

Numerical Analysis · Mathematics 2021-03-17 Yating Wang , Wei Deng , Guang Lin

Black-box variational inference (BBVI) with Gaussian mixture families offers a flexible approach for approximating complex posterior distributions without requiring gradients of the target density. However, standard numerical optimization…

Machine Learning · Computer Science 2026-05-29 Baojun Che , Yifan Chen , Daniel Zhengyu Huang , Xinying Mao , Weijie Wang

Understanding human motion is of critical importance for health monitoring and control of assistive robots, yet many human kinematic variables cannot be directly or accurately measured by wearable sensors. In recent years, invariant…

Robotics · Computer Science 2025-08-05 Zenan Zhu , Seyed Mostafa Rezayat Sorkhabadi , Yan Gu , Wenlong Zhang

Bayesian inference for exponential family random graph models (ERGMs) is a doubly-intractable problem because of the intractability of both the likelihood and posterior normalizing factor. Auxiliary variable based Markov Chain Monte Carlo…

Computation · Statistics 2020-07-15 Fan Yin , Carter T. Butts

The Kalman filter (KF) provides optimal recursive state estimates for linear-Gaussian systems and underpins applications in control, signal processing, and others. However, it is vulnerable to outliers in the measurements and process noise.…

Systems and Control · Electrical Eng. & Systems 2025-07-02 Alan Yang , Stephen Boyd

We study the mathematical properties of the Invariant Extended Kalman Filter (IEKF) when iterating on the measurement update step, following the principles of the well-known Iterated Extended Kalman Filter. This iterative variant of the…

Systems and Control · Electrical Eng. & Systems 2025-11-26 Sven Goffin , Axel Barrau , Silvère Bonnabel , Olivier Brüls , Pierre Sacré

In multi-objective optimization, multiple loss terms are weighted and added together to form a single objective. These weights are chosen to properly balance the competing losses according to some meta-goal. For example, in physics-informed…

Numerical Analysis · Mathematics 2025-11-20 Max Hirsch , Federico Pichi

The ensemble Kalman filter (EnKF) is a popular technique for performing inference in state-space models (SSMs), particularly when the dynamic process is high-dimensional. Unlike reweighting methods such as sequential Monte Carlo (SMC, i.e.…

This paper develops an efficient implementation of the ensemble Kalman filter based on a modified Cholesky decomposition for inverse covariance matrix estimation. This implementation is named EnKF-MC. Background errors corresponding to…

Statistics Theory · Mathematics 2016-05-31 Elias D. Nino , Adrian Sandu , Xinwei Deng

Data-driven modelling techniques provide a method for deriving models of dynamical systems directly from complicated data streams. However, tracking and forecasting such data streams poses a significant challenge to most methods, as they…

Dynamical Systems · Mathematics 2025-03-25 Stephen A Falconer , David J. B. Lloyd , Naratip Santitissadeekorn

This paper concerns the Bayesian approach to inverse acoustic scattering problems of inferring the position and shape of a sound-soft obstacle from phaseless far-field data generated by point source waves. To improve the convergence rate,…

Numerical Analysis · Mathematics 2021-08-23 Zhipeng Yang , Xinping Gui , Ju Ming , Guanghui Hu

We study the Extended Kalman Filter in constant dynamics, offering a bayesian perspective of stochastic optimization. We obtain high probability bounds on the cumulative excess risk in an unconstrained setting. In order to avoid any…

Machine Learning · Computer Science 2020-06-29 Joseph de Vilmarest , Olivier Wintenberger

We present a theory-first framework that interprets inference-time adaptation in large language models (LLMs) as online Bayesian state estimation. Rather than modeling rapid adaptation as implicit optimization or meta-learning, we formulate…

Machine Learning · Computer Science 2026-01-13 Andrew Kiruluta