English
Related papers

Related papers: Online Sequential Monte Carlo smoother for partial…

200 papers

Monte Carlo and Quasi-Monte Carlo methods present a convenient approach for approximating the expected value of a random variable. Algorithms exist to adaptively sample the random variable until a user defined absolute error tolerance is…

Numerical Analysis · Mathematics 2023-11-14 Aleksei G. Sorokin , Jagadeeswaran Rathinavel

This project investigates the applicability of quasi-Monte Carlo methods to Euclidean lattice systems in order to improve the asymptotic error scaling of observables for such theories. The error of an observable calculated by averaging over…

High Energy Physics - Lattice · Physics 2013-11-20 Andreas Ammon , Tobias Hartung , Karl Jansen , Hernan Leovey , Andreas Griewank , Micheal Müller-Preussker

The efficient simulation of the mean value of a non-linear functional of the solution to a linear stochastic partial differential equation (SPDE) with additive Gaussian noise is considered. A Galerkin finite element method is employed along…

Probability · Mathematics 2019-07-25 Andreas Petersson

Online parameter identification is of importance, e.g., for model predictive control. Since the parameters have to be identified simultaneously to the process of the modeled system, dynamical update laws are used for state and parameter…

Numerical Analysis · Mathematics 2016-04-20 Romana Boiger , Barbara Kaltenbacher

Automatic differentiation (AD) has driven recent advances in machine learning, including deep neural networks and Hamiltonian Markov Chain Monte Carlo methods. Partially observed nonlinear stochastic dynamical systems have proved resistant…

Methodology · Statistics 2024-07-04 Kevin Tan , Giles Hooker , Edward L. Ionides

Stochastic processes play a fundamental role in physics, mathematics, engineering and finance. One potential application of quantum computation is to better approximate properties of stochastic processes. For example, quantum algorithms for…

Quantum Physics · Physics 2023-03-14 Adam Bouland , Aditi Dandapani , Anupam Prakash

This paper proposes a Sequential Monte Carlo approach for the Bayesian estimation of mixed causal and noncausal models. Unlike previous Bayesian estimation methods developed for these models, Sequential Monte Carlo offers extensive…

Econometrics · Economics 2025-01-08 Gianluca Cubadda , Francesco Giancaterini , Stefano Grassi

Bayesian inference for models that have an intractable partition function is known as a doubly intractable problem, where standard Monte Carlo methods are not applicable. The past decade has seen the development of auxiliary variable Monte…

Computation · Statistics 2017-10-13 Richard G. Everitt , Dennis Prangle , Philip Maybank , Mark Bell

In the following article we provide an exposition of exact computational methods to perform parameter inference from partially observed network models. In particular, we consider the duplication attachment (DA) model which has a likelihood…

Computation · Statistics 2013-06-20 Junshan Wang , Ajay Jasra , Maria De Iorio

In this paper, a novel stochastic extra-step quasi-Newton method is developed to solve a class of nonsmooth nonconvex composite optimization problems. We assume that the gradient of the smooth part of the objective function can only be…

Optimization and Control · Mathematics 2019-10-22 Minghan Yang , Andre Milzarek , Zaiwen Wen , Tong Zhang

This paper concerns the use of the expectation-maximisation (EM) algorithm for inference in partially observed diffusion processes. In this context, a well known problem is that all except a few diffusion processes lack closed-form…

Statistics Theory · Mathematics 2010-08-18 Jimmy Olsson , Jonas Ströjby

We analyze an online learning algorithm that adaptively combines outputs of two constituent algorithms (or the experts) running in parallel to model an unknown desired signal. This online learning algorithm is shown to achieve (and in some…

Machine Learning · Computer Science 2012-10-01 Mehmet A. Donmez , Sait Tunc , Suleyman S. Kozat

Statisticians often use Monte Carlo methods to approximate probability distributions, primarily with Markov chain Monte Carlo and importance sampling. Sequential Monte Carlo samplers are a class of algorithms that combine both techniques to…

Computation · Statistics 2022-06-20 Chenguang Dai , Jeremy Heng , Pierre E. Jacob , Nick Whiteley

We consider online change detection of high dimensional data streams with sparse changes, where only a subset of data streams can be observed at each sensing time point due to limited sensing capacities. On the one hand, the detection…

Machine Learning · Statistics 2020-09-23 Jie Guo , Hao Yan , Chen Zhang , Steven Hoi

This paper describes a new Monte Carlo method based on a novel stochastic potential switching algorithm. This algorithm enables the equilibrium properties of a system with potential $V$ to be computed using a Monte Carlo simulation for a…

Statistical Mechanics · Physics 2007-05-23 C. H. Mak

This paper presents an algorithm for Monte Carlo fixed-lag smoothing in state-space models defined by a diffusion process observed through noisy discrete-time measurements. Based on a particles approximation of the filtering and smoothing…

Applications · Statistics 2015-06-17 Anne Cuzol , Etienne Mémin

Constrained stochastic nonlinear optimization problems have attracted significant attention for their ability to model complex real-world scenarios in physics, economics, and biology. As datasets continue to grow, online inference methods…

Machine Learning · Statistics 2025-05-27 Xinchen Du , Wanrong Zhu , Wei Biao Wu , Sen Na

Given the ubiquity of streaming data, online algorithms have been widely used for parameter estimation, with second-order methods particularly standing out for their efficiency and robustness. In this paper, we study an online sketched…

Machine Learning · Statistics 2026-04-14 Wei Kuang , Mihai Anitescu , Sen Na

This paper concerns the use of sequential Monte Carlo methods (SMC) for smoothing in general state space models. A well-known problem when applying the standard SMC technique in the smoothing mode is that the resampling mechanism introduces…

Statistics Theory · Mathematics 2008-03-06 Jimmy Olsson , Olivier Cappé , Randal Douc , Eric Moulines

Model comparison for the purposes of selection, averaging and validation is a problem found throughout statistics. Within the Bayesian paradigm, these problems all require the calculation of the posterior probabilities of models within a…

Methodology · Statistics 2015-06-08 Yan Zhou , Adam M Johansen , John A D Aston