English
Related papers

Related papers: Adaptive online variance estimation in particle fi…

200 papers

Accurate estimation of the states of a nonlinear dynamical system is crucial for their design, synthesis, and analysis. Particle filters are estimators constructed by simulating trajectories from a sampling distribution and averaging them…

Signal Processing · Electrical Eng. & Systems 2023-02-03 Fernando Gama , Nicolas Zilberstein , Martin Sevilla , Richard Baraniuk , Santiago Segarra

Data assimilation methodologies are designed to incorporate noisy observations of a physical system into an underlying model in order to infer the properties of the state of the system. Filters refer to a class of data assimilation…

Optimization and Control · Mathematics 2013-08-06 C. E. A. Brett , K. F. Lam , K. J. H. Law , D. S. McCormick , M. R. Scott , A. M. Stuart

We consider applying stochastic approximation (SA) methods to solve nonsmooth variational inclusion problems. Existing studies have shown that the averaged iterates of SA methods exhibit asymptotic normality, with an optimal limiting…

Machine Learning · Statistics 2025-08-13 Liwei Jiang , Abhishek Roy , Krishna Balasubramanian , Damek Davis , Dmitriy Drusvyatskiy , Sen Na

Particle Flow Filters estimate the ``a posteriori" probability density function (PDF) by moving an ensemble of particles according to the likelihood. Particles are propagated under the system dynamics until a measurement becomes available…

Computational Engineering, Finance, and Science · Computer Science 2025-05-06 Simone Servadio

Motivated by reduction of computational complexity, this work develops sign-error adaptive filtering algorithms for estimating time-varying system parameters. Different from the previous work on sign-error algorithms, the parameters are…

Optimization and Control · Mathematics 2016-11-17 Araz Hashemi , G. Yin , Le Yi Wang

Estimation of stochastic processes evolving in a random environment is of crucial importance for example to predict aircraft trajectories evolving in an unknown atmosphere. For fixed parameter, interacting particle systems are a convenient…

Probability · Mathematics 2015-03-26 Cécile Ichard , Christelle Vergé

We propose a method for adaptive nonlinear sequential modeling of vector-time series data. Data is modeled as a nonlinear function of past values corrupted by noise, and the underlying non-linear function is assumed to be approximately…

Methodology · Statistics 2017-10-11 Qiuyi Han , Jie Ding , Edoardo Airoldi , Vahid Tarokh

State-space models can be used to incorporate subject knowledge on the underlying dynamics of a time series by the introduction of a latent Markov state-process. A user can specify the dynamics of this process together with how the state…

Computation · Statistics 2017-09-14 Paul Fearnhead , Hans Künsch

Inference for partially observed Markov process models has been a longstanding methodological challenge with many scientific and engineering applications. Iterated filtering algorithms maximize the likelihood function for partially observed…

Statistics Theory · Mathematics 2012-11-26 Edward L. Ionides , Anindya Bhadra , Yves Atchadé , Aaron King

Reducing the variance of the gradient estimator is known to improve the convergence rate of stochastic gradient-based optimization and sampling algorithms. One way of achieving variance reduction is to design importance sampling strategies.…

Machine Learning · Computer Science 2021-03-24 Ayoub El Hanchi , David A. Stephens

Data assimilation algorithms integrate prior information from numerical model simulations with observed data. Ensemble-based filters, regarded as state-of-the-art, are widely employed for large-scale estimation tasks in disciplines such as…

Numerical Analysis · Mathematics 2024-05-24 Iris Rammelmüller , Gottfried Hastermann , Jana de Wiljes

It is crucially important to estimate unknown parameters in earth system models by integrating observation and numerical simulation. For many applications in earth system sciences, an optimization method which allows parameters to…

Geophysics · Physics 2022-07-13 Yohei Sawada

Although the Bayesian paradigm offers a formal framework for estimating the entire probability distribution over uncertain parameters, its online implementation can be challenging due to high computational costs. We suggest the Adaptive…

Machine Learning · Computer Science 2023-10-23 Pedram Agand , Mo Chen , Hamid D. Taghirad

Nonlinear adaptive filtering allows for modeling of some additional aspects of a general system and usually relies on highly complex algorithms, such as those based on the Volterra series. Through the use of the Kronecker product and some…

Systems and Control · Computer Science 2016-03-02 Felipe C. Pinheiro , Cássio G. Lopes

When large amounts of data continuously arrive in streams, online updating is an effective way to reduce storage and computational burden. The key idea of online updating is that the previous estimators are sequentially updated only using…

Methodology · Statistics 2022-10-12 Tianzhen Wang , Haixiang Zhang , Liuquan Sun

Popular network pruning algorithms reduce redundant information by optimizing hand-crafted models, and may cause suboptimal performance and long time in selecting filters. We innovatively introduce adaptive exemplar filters to simplify the…

Computer Vision and Pattern Recognition · Computer Science 2021-05-27 Mingbao Lin , Rongrong Ji , Shaojie Li , Yan Wang , Yongjian Wu , Feiyue Huang , Qixiang Ye

In this paper we introduce a novel particle filter scheme for a class of partially-observed multivariate diffusions. %continuous-time dynamic models where the %signal is given by a multivariate diffusion process. We consider a variety of…

Methodology · Statistics 2007-10-24 Paul Fearnhead , Omiros Papaspiliopoulos , Gareth Roberts

In this paper, we consider the filtering problem for partially observed diffusions, which are regularly observed at discrete times. We are concerned with the case when one must resort to time-discretization of the diffusion process if the…

Numerical Analysis · Mathematics 2020-04-09 Marco Ballesio , Ajay Jasra , Erik von Schwerin , Raul Tempone

Conformal prediction is a valuable tool for quantifying predictive uncertainty of machine learning models. However, its applicability relies on the assumption of data exchangeability, a condition which is often not met in real-world…

Machine Learning · Statistics 2024-12-30 Aleksandr Podkopaev , Darren Xu , Kuang-Chih Lee

We are interested in the online prediction of the electricity load, within the Bayesian framework of dynamic models. We offer a review of sequential Monte Carlo methods, and provide the calculations needed for the derivation of so-called…

Applications · Statistics 2013-04-16 Tristan Launay , Anne Philippe , Sophie Lamarche