English
Related papers

Related papers: High-dimensional Bayesian filtering through deep d…

200 papers

Recently developed particle flow algorithms provide an alternative to importance sampling for drawing particles from a posterior distribution, and a number of particle filters based on this principle have been proposed. Samples are drawn…

Computation · Statistics 2014-12-01 Pete Bunch , Simon Godsill

We perform scalable approximate inference in continuous-depth Bayesian neural networks. In this model class, uncertainty about separate weights in each layer gives hidden units that follow a stochastic differential equation. We demonstrate…

Machine Learning · Statistics 2022-02-01 Winnie Xu , Ricky T. Q. Chen , Xuechen Li , David Duvenaud

To minimize the average of a set of log-convex functions, the stochastic Newton method iteratively updates its estimate using subsampled versions of the full objective's gradient and Hessian. We contextualize this optimization problem as…

Machine Learning · Statistics 2023-08-22 Michael C. Burkhart

In this article, we investigate the existence of a deep neural network (DNN) capable of approximating solutions to partial integro-differential equations while circumventing the curse of dimensionality. Using the Feynman-Kac theorem, we…

Numerical Analysis · Mathematics 2025-01-22 Marcin Baranek

Solving high-dimensional parabolic partial differential equations (PDEs) with deep learning methods is often computationally and memory intensive, primarily due to the need for automatic differentiation (AD) to compute large Hessian…

Numerical Analysis · Mathematics 2026-01-13 Wei Cai , Shuixin Fang , Tao Zhou

We present a novel algorithm based on the ensemble Kalman filter to solve inverse problems involving multiscale elliptic partial differential equations. Our method is based on numerical homogenization and finite element discretization and…

Numerical Analysis · Mathematics 2020-12-16 Assyr Abdulle , Giacomo Garegnani , Andrea Zanoni

A new type of ensemble Kalman filter is developed, which is based on replacing the sample covariance in the analysis step by its diagonal in a spectral basis. It is proved that this technique improves the aproximation of the covariance when…

Methodology · Statistics 2015-08-19 Ivan Kasanický , Jan Mandel , Martin Vejmelka

In this paper, a fractional step lattice Boltzmann method is proposed to model two-phase flows with large density differences by solving Cahn-Hilliard phase-field equation and the incompressible Navier-Stokes equations.In order to maintain…

Fluid Dynamics · Physics 2018-12-07 Chunhua Zhang , Zhaoli Guo , Yibao Li

Given a stationary state-space model that relates a sequence of hidden states and corresponding measurements or observations, Bayesian filtering provides a principled statistical framework for inferring the posterior distribution of the…

Machine Learning · Statistics 2022-12-01 Michael C. Burkhart

The objective in stochastic filtering is to reconstruct information about an unobserved (random) process, called the signal process, given the current available observations of a certain noisy transformation of that process. Usually X and Y…

Probability · Mathematics 2017-01-31 B. P. W. Fernando , E. Hausenblas

The Kalman filter is a fundamental filtering algorithm that fuses noisy sensory data, a previous state estimate, and a dynamics model to produce a principled estimate of the current state. It assumes, and is optimal for, linear models and…

Neural and Evolutionary Computing · Computer Science 2021-04-30 Beren Millidge , Alexander Tschantz , Anil Seth , Christopher Buckley

The paper establishes the strong convergence rates of a spatio-temporal full discretization of the stochastic wave equation with nonlinear damping in dimension one and two. We discretize the SPDE by applying a spectral Galerkin method in…

Numerical Analysis · Mathematics 2024-12-30 Meng Cai , David Cohen , Xiaojie Wang

Kalman filters provide a straightforward and interpretable means to estimate hidden or latent variables, and have found numerous applications in control, robotics, signal processing, and machine learning. One such application is neural…

Machine Learning · Computer Science 2024-01-29 Josue Casco-Rodriguez , Caleb Kemere , Richard G. Baraniuk

We present a new class of numerical methods for solving stochastic differential equations with additive noise on general Riemannian manifolds with high weak order of accuracy. In opposition to the popular approach with projection methods,…

Numerical Analysis · Mathematics 2025-06-19 Eugen Bronasco , Adrien Busnot Laurent , Baptiste Huguet

We consider the problem of high-dimensional filtering of state-space models (SSMs) at discrete times. This problem is particularly challenging as analytical solutions are typically not available and many numerical approximation methods can…

Computation · Statistics 2022-01-13 Hamza Ruzayqat , Aimad Er-Raiy , Alexandros Beskos , Dan Crisan , Ajay Jasra , Nikolas Kantas

Many systems for which compressive sensing is used today are dynamical. The common approach is to neglect the dynamics and see the problem as a sequence of independent problems. This approach has two disadvantages. Firstly, the temporal…

Systems and Control · Computer Science 2013-09-30 Henrik Ohlsson , Michel Verhaegen , S. Shankar Sastry

Discretizations of Langevin diffusions provide a powerful method for sampling and Bayesian inference. However, such discretizations require evaluation of the gradient of the potential function. In several real-world scenarios, obtaining…

Statistics Theory · Mathematics 2021-01-19 Abhishek Roy , Lingqing Shen , Krishnakumar Balasubramanian , Saeed Ghadimi

We consider the task of filtering a dynamic parameter evolving as a diffusion process, given data collected at discrete times from a likelihood which is conjugate to the marginal law of the diffusion, when a generic dual process on a…

Probability · Mathematics 2023-11-29 Guillaume Kon Kam King , Andrea Pandolfi , Marco Piretto , Matteo Ruggiero

Bayesian computation for filtering and forecasting analysis is developed for a broad class of dynamic models. The ability to scale-up such analyses in non-Gaussian, nonlinear multivariate time series models is advanced through the…

Methodology · Statistics 2022-06-07 Isaac Lavine , Andrew Cron , Mike West

Likelihood functions evaluated using particle filters are typically noisy, computationally expensive, and non-differentiable due to Monte Carlo variability. These characteristics make conventional optimization methods difficult to apply…

Methodology · Statistics 2026-01-13 Genshiro Kitagawa