English
Related papers

Related papers: A Framework for Large Scale Particle Filters Valid…

200 papers

Due to rapid data growth, statistical analysis of massive datasets often has to be carried out in a distributed fashion, either because several datasets stored in separate physical locations are all relevant to a given problem, or simply to…

Computation · Statistics 2016-02-08 Matthias Katzfuss , Dorit Hammerling

When the weights in a particle filter are not available analytically, standard resampling methods cannot be employed. To circumvent this problem state-of-the-art algorithms replace the true weights with non-negative unbiased estimates. This…

Computation · Statistics 2019-03-05 Sebastian M Schmon , Arnaud Doucet , George Deligiannidis

The ever increasing demands placed upon machine performance have resulted in the need for more comprehensive particle accelerator modeling. Computer simulations are key to the success of particle accelerators. Many aspects of particle…

In this paper, a dual estimation methodology is developed for both time-varying parameters and states of a nonlinear stochastic system based on the Particle Filtering (PF) scheme. Our developed methodology is based on a concurrent…

Systems and Control · Computer Science 2016-06-29 Najmeh Daroogheh , Nader Meskin , Khashayar Khorasani

Particle filtering methods can be applied to estimation problems in discrete spaces on bounded domains, to sample from and marginalise over unknown hidden states. As in continuous settings, problems such as particle degradation can arise:…

Sequential learning in deep models often suffers from challenges such as catastrophic forgetting and loss of plasticity, largely due to the permutation dependence of gradient-based algorithms, where the order of training data impacts the…

Machine Learning · Computer Science 2024-10-31 Akhilan Boopathy , Aneesh Muppidi , Peggy Yang , Abhiram Iyer , William Yue , Ila Fiete

Problems in astrophysics, space weather research and geophysics usually need to analyze noisy big data on the sphere. This paper develops distributed filtered hyperinterpolation for noisy data on the sphere, which assigns the data fitting…

Classical Analysis and ODEs · Mathematics 2019-10-08 Shao-Bo Lin , Yu Guang Wang , Ding-Xuan Zhou

The particle filter (PF) and the ensemble Kalman filter (EnKF) are widely used for approximate inference in state-space models. From a Bayesian perspective, these algorithms represent the prior by an ensemble of particles and update it to…

Methodology · Statistics 2025-02-11 Chengxin Gong , Wei Lin , Cheng Zhang

Filtering is concerned with online estimation of the state of a dynamical system from partial and noisy observations. In applications where the state of the system is high dimensional, ensemble Kalman filters are often the method of choice.…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Omar Al Ghattas , Jiajun Bao , Daniel Sanz-Alonso

We present a particle filter construction for a system that exhibits time-scale separation. The separation of time-scales allows two simplifications that we exploit: i) The use of the averaging principle for the dimensional reduction of the…

Numerical Analysis · Mathematics 2008-06-05 Dror Givon , Panagiotis Stinis , Jonathan Weare

Recursive Bayesian inference, in which posterior beliefs are updated in light of accumulating data, is a tool for implementing Bayesian models in applications with streaming and/or very large data sets. As the posterior of one iteration…

Methodology · Statistics 2025-08-05 Henry R. Scharf

This paper is concerned with a recently developed paradigm for population-based optimization, termed particle filter optimization (PFO). This paradigm is attractive in terms of coherence in theory and easiness in mathematical analysis and…

Machine Learning · Statistics 2018-11-26 Bin Liu , Yaochu Jin

Data assimilation addresses the general problem of how to combine model-based predictions with partial and noisy observations of the process in an optimal manner. This survey focuses on sequential data assimilation techniques using…

Numerical Analysis · Mathematics 2019-08-15 Sebastian Reich

Data assimilation algorithms estimate the state of a dynamical system from partial observations, where the successful performance of these algorithms hinges on costly parameter tuning and on employing an accurate model for the dynamics.…

Machine Learning · Statistics 2026-03-24 Melissa Adrian , Daniel Sanz-Alonso , Rebecca Willett

In this thesis, we introduce Bayesian filtering as a principled framework for tackling diverse sequential machine learning problems, including online (continual) learning, prequential (one-step-ahead) forecasting, and contextual bandits. To…

Machine Learning · Statistics 2025-05-13 Gerardo Duran-Martin

Particle filters (PFs) are powerful sampling-based inference/learning algorithms for dynamic Bayesian networks (DBNs). They allow us to treat, in a principled way, any type of probability distribution, nonlinearity and non-stationarity.…

Machine Learning · Computer Science 2013-01-18 Arnaud Doucet , Nando de Freitas , Kevin Murphy , Stuart Russell

The simulation of large ensembles of particles is usually parallelized by partitioning the domain spatially and using message passing to communicate between the processes handling neighboring subdomains. The particles are represented as…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-03 Sebastian Eibl , Ulrich Rüde

Cumulative probability models (CPMs) are a robust alternative to linear models for continuous outcomes. However, they are not feasible for very large datasets due to elevated running time and memory usage, which depend on the sample size,…

Computation · Statistics 2022-07-15 Chun Li , Guo Chen , Bryan E. Shepherd

This paper is concerned with particle filtering for $\alpha$-stable stochastic volatility models. The $\alpha$-stable distribution provides a flexible framework for modeling asymmetry and heavy tails, which is useful when modeling financial…

Computation · Statistics 2014-05-20 Emilian Vankov , Katherine B. Ensor

Differentiable particle filters provide a flexible mechanism to adaptively train dynamic and measurement models by learning from observed data. However, most existing differentiable particle filters are within the bootstrap particle…

Artificial Intelligence · Computer Science 2021-11-11 Xiongjie Chen , Hao Wen , Yunpeng Li