English
Related papers

Related papers: Sequential Monte Carlo smoothing with application …

200 papers

Dynamical systems in engineering and physics are often subject to irregular excitations that are best modeled as random. Monte Carlo simulations are routinely performed on such random models to obtain statistics on their long-term response.…

Dynamical Systems · Mathematics 2024-07-08 Zhenwei Xu , Roshan S. Kaundinya , Shobhit Jain , George Haller

Sampling from high-dimensional distributions has wide applications in data science and machine learning but poses significant computational challenges. We introduce Subspace Langevin Monte Carlo (SLMC), a novel and efficient sampling method…

Machine Learning · Statistics 2025-05-21 Tyler Maunu , Jiayi Yao

Consider a central problem in randomized approximation schemes that use a Monte Carlo approach. Given a sequence of independent, identically distributed random variables $X_1,X_2,\ldots$ with mean $\mu$ and standard deviation at most $c…

Statistics Theory · Mathematics 2014-11-18 Mark Huber

Density tempering (also called density annealing) is a sequential Monte Carlo approach to Bayesian inference for general state models; it is an alternative to Markov chain Monte Carlo. When applied to state space models, it moves a…

Methodology · Statistics 2022-04-05 David Gunawan , Robert Kohn , Minh Ngoc Tran

Constraints can be interpreted in a broad sense as any kind of explicit restriction over the parameters. While some constraints are defined directly on the parameter space, when they are instead defined by known behaviour on the model,…

Methodology · Statistics 2015-02-27 Shirin Golchi , David A. Campbell

The expectation-maximization (EM) algorithm is a powerful computational technique for finding the maximum likelihood estimates for parametric models when the data are not fully observed. The EM is best suited for situations where the…

Computation · Statistics 2018-05-14 Chanseok Park

Spatial Monte Carlo integration (SMCI) is an extension of standard Monte Carlo integration and can approximate expectations on Markov random fields with high accuracy. SMCI was applied to pairwise Boltzmann machine (PBM) learning, with…

Machine Learning · Statistics 2021-04-28 Muneki Yasuda , Kei Uchizawa

Symbolic regression is a powerful tool for discovering governing equations directly from data, but its sensitivity to noise hinders its broader application. This paper introduces a Sequential Monte Carlo (SMC) framework for Bayesian…

Machine Learning · Computer Science 2025-12-12 Geoffrey F. Bomarito , Patrick E. Leser

Random samples of quantum states with specific properties are useful for various applications, such as Monte Carlo integration over the state space. In the high-dimensional situations that one encounters already for a few qubits, the…

Quantum Physics · Physics 2026-02-02 Weijun Li , Rui Han , Jiangwei Shang , Hui Khoon Ng , Berthold-Georg Englert

We introduce a powerful and flexible MCMC algorithm for stochastic simulation. The method builds on a pseudo-marginal method originally introduced in [Genetics 164 (2003) 1139--1160], showing how algorithms which are approximations to an…

Statistics Theory · Mathematics 2009-04-01 Christophe Andrieu , Gareth O. Roberts

This paper presents a simulation-based framework for sequential inference from partially and discretely observed point process (PP's) models with static parameters. Taking on a Bayesian perspective for the static parameters, we build upon…

Methodology · Statistics 2012-01-24 James S. Martin , Ajay Jasra , Emma McCoy

Bayesian filtering aims at tracking sequentially a hidden process from an observed one. In particular, sequential Monte Carlo (SMC) techniques propagate in time weighted trajectories which represent the posterior probability density…

Computation · Statistics 2012-10-22 Yohan Petetin , François Desbouvries

Many random processes can be simulated as the output of a deterministic model accepting random inputs. Such a model usually describes a complex mathematical or physical stochastic system and the randomness is introduced in the input…

Machine Learning · Statistics 2012-11-21 A. Gokcen Mahmutoglu , Alper T. Erdogan , Alper Demir

We propose quantum algorithms that provide provable speedups for Markov Chain Monte Carlo (MCMC) methods commonly used for sampling from probability distributions of the form $\pi \propto e^{-f}$, where $f$ is a potential function. Our…

Quantum Physics · Physics 2025-04-07 Guneykan Ozgul , Xiantao Li , Mehrdad Mahdavi , Chunhao Wang

This paper considers the problem of optimizing the average tracking error for an elliptic partial differential equation with an uncertain lognormal diffusion coefficient. In particular, the application of the multilevel quasi-Monte Carlo…

Numerical Analysis · Mathematics 2021-09-30 Philipp A. Guth , Andreas Van Barel

Statistical signal processing applications usually require the estimation of some parameters of interest given a set of observed data. These estimates are typically obtained either by solving a multi-variate optimization problem, as in the…

Computation · Statistics 2021-07-27 D. Luengo , L. Martino , M. Bugallo , V. Elvira , S. Särkkä

In the context of state-space models, skeleton-based smoothing algorithms rely on a backward sampling step which by default has a $\mathcal O(N^2)$ complexity (where $N$ is the number of particles). Existing improvements in the literature…

Computation · Statistics 2023-03-08 Hai-Dang Dau , Nicolas Chopin

Hybrid Monte-Carlo (HMC) sampling smoother is a fully non-Gaussian four-dimensional data assimilation algorithm that works by directly sampling the posterior distribution formulated in the Bayesian framework. The smoother in its original…

Numerical Analysis · Computer Science 2016-12-21 Ahmed Attia , Razvan Stefanescu , Adrian Sandu

In statistical data assimilation (SDA) and supervised machine learning (ML), we wish to transfer information from observations to a model of the processes underlying those observations. For SDA, the model consists of a set of differential…

Data Analysis, Statistics and Probability · Physics 2020-01-22 Zheng Fang , Adrian S. Wong , Kangbo Hao , Alexander J. A. Ty , Henry D. I. Abarbanel

Pricing options is an important problem in financial engineering. In many scenarios of practical interest, financial option prices associated to an underlying asset reduces to computing an expectation w.r.t.~a diffusion process. In general,…

Computation · Statistics 2016-08-12 Deborshee Sen , Ajay Jasra , Yan Zhou