English
Related papers

Related papers: Nonlinear Bayesian Filtering with Natural Gradient…

200 papers

In this paper we revisit a non-linear filter for {\em non-Gaussian} noises that was introduced in [1]. Goggin proved that transforming the observations by the score function and then applying the Kalman Filter (KF) to the transformed…

Information Theory · Computer Science 2026-01-22 Imon Banerjee , Itai Gurvich

We consider filtering in high-dimensional non-Gaussian state-space models with intractable transition kernels, nonlinear and possibly chaotic dynamics, and sparse observations in space and time. We propose a novel filtering methodology that…

Methodology · Statistics 2022-04-07 Alessio Spantini , Ricardo Baptista , Youssef Marzouk

A stochastic filter uses a series of measurements over time to produce estimates of unknown variables based on a dynamic model. For a quantum system, such an algorithm is provided by a quantum filter, which is also known as a stochastic…

Quantum Physics · Physics 2017-07-25 Muhammad F. Emzir , Matthew J. Woolley , Ian R. Petersen

Natural Gradient Descent, a second-degree optimization method motivated by the information geometry, makes use of the Fisher Information Matrix instead of the Hessian which is typically used. However, in many cases, the Fisher Information…

Machine Learning · Computer Science 2023-03-10 Rajesh Shrestha

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

Approximate Bayesian inference methods that scale to very large datasets are crucial in leveraging probabilistic models for real-world time series. Sparse Markovian Gaussian processes combine the use of inducing variables with efficient…

Machine Learning · Statistics 2021-06-10 William J. Wilkinson , Arno Solin , Vincent Adam

We present a new strategy for filtering high-dimensional multiscale systems characterized by high-order non-Gaussian statistics using observations from leading-order moments. A closed stochastic-statistical modeling framework suitable for…

Mathematical Physics · Physics 2024-07-09 Di Qi , Jian-Guo Liu

This paper presents a novel Bayesian strategy for the estimation of smooth signals corrupted by Gaussian noise. The method assumes a smooth evolution of a succession of continuous signals that can have a numerical or an analytical…

Applications · Statistics 2016-02-12 Abderrahim Halimi , Gerald S. Buller , Steve McLaughlin , Paul Honeine

To minimize the average of a set of log-convex functions, the stochastic Newton method iteratively updates its estimate using subsampled versions of the full objective's gradient and Hessian. We contextualize this optimization problem as…

Machine Learning · Statistics 2023-08-22 Michael C. Burkhart

This article discusses a partially adapted particle filter for estimating the likelihood of a nonlinear structural econometric state space models whose state transition density cannot be expressed in closed form. The filter generates the…

Methodology · Statistics 2012-09-05 Jamie Hall , Michael K. Pitt , Robert Kohn

Data-informed predictive maintenance planning largely relies on stochastic deterioration models. Monitoring information can be utilized to update sequentially the knowledge on time-invariant deterioration model parameters either within an…

Computation · Statistics 2023-08-02 Antonios Kamariotis , Luca Sardi , Iason Papaioannou , Eleni Chatzi , Daniel Straub

Bayesian learning using Gaussian processes provides a foundational framework for making decisions in a manner that balances what is known with what could be learned by gathering data. In this dissertation, we develop techniques for…

Machine Learning · Statistics 2022-04-29 Alexander Terenin

In this work, we consider the problem of steering the first two moments of the uncertain state of an unknown discrete-time stochastic nonlinear system to a given terminal distribution in finite time. Toward that goal, first, a…

Optimization and Control · Mathematics 2021-04-05 Alexandros Tsolovikos , Efstathios Bakolas

We consider the Bayesian optimal filtering problem: i.e. estimating some conditional statistics of a latent time-series signal from an observation sequence. Classical approaches often rely on the use of assumed or estimated transition and…

Machine Learning · Statistics 2023-03-16 Adrian N. Bishop , Edwin V. Bonilla

Bayesian filtering serves as the mainstream framework of state estimation in dynamic systems. Its standard version utilizes total probability rule and Bayes' law alternatively, where how to define and compute conditional probability is…

Machine Learning · Statistics 2024-04-02 Wenhan Cao , Shiqi Liu , Chang Liu , Zeyu He , Stephen S. -T. Yau , Shengbo Eben Li

In this paper, we study the problem of estimating the state of a dynamic state-space system where the output is subject to quantization. We compare some classical approaches and a new development in the literature to obtain the filtering…

Systems and Control · Electrical Eng. & Systems 2021-12-16 Angel L. Cedeño , Ricardo Albornoz , Boris I. Godoy , Rodrigo Carvajal , Juan C. Agüero

Using quasi-Newton methods in stochastic optimization is not a trivial task given the difficulty of extracting curvature information from the noisy gradients. Moreover, pre-conditioning noisy gradient observations tend to amplify the noise.…

Optimization and Control · Mathematics 2024-04-02 Andre Carlon , Luis Espath , Raul Tempone

Filter methods realize a projection from a superposed quantum state onto a target state, which can be efficient if two states have sufficient overlap. Here we propose a quantum Gaussian filter (QGF) with the filter operator being a Gaussian…

Quantum Physics · Physics 2022-09-19 Min-Quan He , Dan-Bo Zhang , Z. D. Wang

A hybrid particle ensemble Kalman filter is developed for problems with medium non-Gaussianity, i.e. problems where the prior is very non-Gaussian but the posterior is approximately Gaussian. Such situations arise, e.g., when nonlinear…

Methodology · Statistics 2021-03-15 Gregor Robinson , Ian Grooms

We study non-linear Bayesian inverse problems arising from semilinear partial differential equations (PDEs) that can be transformed into linear Bayesian inverse problems. We are then able to extend the early stopping for Ensemble…

Statistics Theory · Mathematics 2025-10-22 Maia Tienstra , Gottfried Hastermann