English
Related papers

Related papers: Particle-MALA and Particle-mGRAD: Gradient-based M…

200 papers

We consider state and parameter estimation for a dynamical system having both time-varying and time-invariant parameters. It has been shown that the robustness of the Markov Chain Monte Carlo (MCMC) algorithm for estimating time-invariant…

Computational Engineering, Finance, and Science · Computer Science 2022-10-18 Philippe Bisaillon , Brandon Robinson , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

We present a variational method for online state estimation and parameter learning in state-space models (SSMs), a ubiquitous class of latent variable models for sequential data. As per standard batch variational techniques, we use…

Machine Learning · Statistics 2022-06-16 Andrew Campbell , Yuyang Shi , Tom Rainforth , Arnaud Doucet

Bayesian analysis is widely used in science and engineering for real-time forecasting, decision making, and to help unravel the processes that explain the observed data. These data are some deterministic and/or stochastic transformations of…

Optimization and Control · Mathematics 2020-02-24 Jiangjiang Zhang , Jasper A. Vrugt , Xiaoqing Shi , Guang Lin , Lingzao Zeng , Laosheng Wu

Sequential Monte Carlo (SMC) methods offer a principled approach to Bayesian uncertainty quantification but are traditionally limited by the need for full-batch gradient evaluations. We introduce a scalable variant by incorporating…

Machine Learning · Statistics 2025-05-20 Andrew Millard , Zheng Zhao , Joshua Murphy , Simon Maskell

We propose a hierarchy of multi-level kinetic Monte Carlo methods for sampling high-dimensional, stochastic lattice particle dynamics with complex interactions. The method is based on the efficient coupling of different spatial resolution…

Numerical Analysis · Mathematics 2012-08-06 Evangelia Kalligiannaki , Markos A. Katsoulakis , Petr Plechac

For challenging state estimation problems arising in domains like vision and robotics, particle-based representations attractively enable temporal reasoning about multiple posterior modes. Particle smoothers offer the potential for more…

Machine Learning · Computer Science 2025-02-18 Ali Younis , Erik B. Sudderth

Gaussian process state-space models (GPSSMs) provide a principled and flexible approach to modeling the dynamics of a latent state, which is observed at discrete-time points via a likelihood model. However, inference in GPSSMs is…

Machine Learning · Computer Science 2023-07-18 Xuhui Fan , Edwin V. Bonilla , Terence J. O'Kane , Scott A. Sisson

This work introduces a new method designed for Bayesian deep learning called scalable Bayesian Monte Carlo (SBMC). The method is comprised of a model and an algorithm. The model interpolates between a point estimator and the posterior. The…

We present a localized data assimilation (DA) scheme based on the sequential Markov Chain Monte Carlo (SMCMC) technique [Ruzayqat et al., 2024], a provably convergent method for filtering high-dimensional, nonlinear, and potentially…

Computation · Statistics 2026-03-09 Hamza Ruzayqat , Hristo G. Chipilski , Omar Knio

We consider Bayesian online static parameter estimation for state-space models. This is a very important problem, but is very computationally challenging as the state- of-the art methods that are exact, often have a computational cost that…

Computation · Statistics 2015-03-03 Yan Zhou , Ajay Jasra

Classical discriminant analysis assumes identically distributed training data, yet in many applications observations are collected over time and the class-conditional distributions drift. This population drift renders stationary classifiers…

Machine Learning · Computer Science 2025-08-25 Shuilian Xie , Mahdi Imani , Edward R. Dougherty , Ulisses M. Braga-Neto

High-dimensional multimodal sampling problems from lattice field theory (LFT) have become important benchmarks for machine learning assisted sampling methods. We show that GPU-accelerated particle methods, Sequential Monte Carlo (SMC) and…

Machine Learning · Statistics 2025-11-20 David Yallup

We propose two new Bayesian smoothing methods for general state-space models with unknown parameters. The first approach is based on the particle learning and smoothing algorithm, but with an adjustment in the backward resampling weights.…

Computation · Statistics 2016-04-20 Biao Yang , Jonathan R. Stroud , Gabriel Huerta

One of the key challenges in identifying nonlinear and possibly non-Gaussian state space models (SSMs) is the intractability of estimating the system state. Sequential Monte Carlo (SMC) methods, such as the particle filter (introduced more…

Accurate estimates of long-term risk probabilities and their gradients are critical for many stochastic safe control methods. However, computing such risk probabilities in real-time and in unseen or changing environments is challenging.…

Systems and Control · Electrical Eng. & Systems 2024-08-20 Zhuoyuan Wang , Yorie Nakahira

This paper develops a novel sequential Monte Carlo (SMC) approach for joint state and parameter estimation that can deal efficiently with abruptly changing parameters which is a common case when tracking maneuvering targets. The approach…

Computation · Statistics 2015-10-12 Christopher Nemeth , Paul Fearnhead , Lyudmila Mihaylova

A common way to simulate the transport and spread of pollutants in the atmosphere is via stochastic Lagrangian dispersion models. Mathematically, these models describe turbulent transport processes with stochastic differential equations…

We consider sequential state and parameter learning in state-space models with intractable state transition and observation processes. By exploiting low-rank tensor train (TT) decompositions, we propose new sequential learning methods for…

Numerical Analysis · Mathematics 2024-07-04 Yiran Zhao , Tiangang Cui

Long Short-Term Memory (LSTM) is one of the most powerful sequence models. Despite the strong performance, however, it lacks the nice interpretability as in state space models. In this paper, we present a way to combine the best of both…

Machine Learning · Computer Science 2017-12-04 Xun Zheng , Manzil Zaheer , Amr Ahmed , Yuan Wang , Eric P Xing , Alexander J Smola

Gaussian and discrete non-Gaussian spatial datasets are common across fields like public health, ecology, geosciences, and social sciences. Bayesian spatial generalized linear mixed models (SGLMMs) are a flexible class of models for…

Methodology · Statistics 2025-01-27 Jin Hyung Lee , Ben Seiyon Lee