English
Related papers

Related papers: Stochastic filtering with moment representation

200 papers

To minimize the average of a set of log-convex functions, the stochastic Newton method iteratively updates its estimate using subsampled versions of the full objective's gradient and Hessian. We contextualize this optimization problem as…

Machine Learning · Statistics 2023-08-22 Michael C. Burkhart

Particle filters are broadly used to approximate posterior distributions of hidden states in state-space models by means of sets of weighted particles. While the convergence of the filter is guaranteed when the number of particles tends to…

Computation · Statistics 2017-11-01 Víctor Elvira , Joaquín Míguez , Petar M. Djurić

This paper introduces factored conditional filters, new filtering algorithms for simultaneously tracking states and estimating parameters in high-dimensional state spaces. The conditional nature of the algorithms is used to estimate…

Artificial Intelligence · Computer Science 2024-07-10 Dawei Chen , Samuel Yang-Zhao , John Lloyd , Kee Siong Ng

Stochastic equations play an important role in computational science, due to their ability to treat a wide variety of complex statistical problems. However, current algorithms are strongly limited by their sampling variance, which scales…

Numerical Analysis · Mathematics 2017-01-04 Bogdan Opanchuk , Simon Kiesewetter , Peter D. Drummond

Stochastic Kronecker graphs supply a parsimonious model for large sparse real world graphs. They can specify the distribution of a large random graph using only three or four parameters. Those parameters have however proved difficult to…

Machine Learning · Statistics 2011-06-10 David F. Gleich , Art B. Owen

We present a new algorithm to optimize distributions defined implicitly by parameterized stochastic diffusions. Doing so allows us to modify the outcome distribution of sampling processes by optimizing over their parameters. We introduce a…

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

In this paper, an alternative approximation to the innovation method is introduced for the parameter estimation of diffusion processes from partial and noisy observations. This is based on a convergent approximation to the first two…

Optimization and Control · Mathematics 2013-12-19 J. C. Jimenez

This paper is devoted to filtering, smoothing, and prediction of polynomial processes that are partially observed. These problems are known to allow for an explicit solution in the simpler case of linear Gaussian state space models. The key…

Probability · Mathematics 2025-07-10 Jan Kallsen , Ivo Richert

The problem of the optimal allocation (in the expected mean square error sense) of a measurement budget for particle filtering is addressed. We propose three different optimal intermittent filters, whose optimality criteria depend on the…

Systems and Control · Electrical Eng. & Systems 2022-06-29 Antoine Aspeel , Amaury Gouverneur , Raphaël M. Jungers , Benoit Macq

We propose a new algorithm for approximating the non-asymptotic second moment of the marginal likelihood estimate, or normalizing constant, provided by a particle filter. The computational cost of the new method is $O(M)$ per time step,…

Methodology · Statistics 2016-08-19 Svetoslav Kostov , Nick Whiteley

Filtering---estimating the state of a partially observable Markov process from a sequence of observations---is one of the most widely studied problems in control theory, AI, and computational statistics. Exact computation of the posterior…

Artificial Intelligence · Computer Science 2013-01-07 Bhaskara Marthi , Hanna Pasula , Stuart Russell , Yuval Peres

We present a new strategy for filtering high-dimensional multiscale systems characterized by high-order non-Gaussian statistics using observations from leading-order moments. A closed stochastic-statistical modeling framework suitable for…

Mathematical Physics · Physics 2024-07-09 Di Qi , Jian-Guo Liu

Stochastic processes are proposed whose master equations coincide with classical wave, telegraph, and Klein-Gordon equations. Similar to predecessors based on the Goldstein-Kac telegraph process, the model describes the motion of particles…

Statistical Mechanics · Physics 2015-05-18 A. V. Plyukhin

In this paper we study the problem of model reduction by moment matching for stochastic systems. We characterize the mathematical object which generalizes the notion of moment to stochastic differential equations and we find a class of…

Systems and Control · Electrical Eng. & Systems 2021-05-06 Giordano Scarciotti , Andrew R. Teel

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

In this paper, we aim to propose a consistent non-Gaussian Bayesian filter of which the system state is a continuous function. The distributions of the true system states, and those of the system and observation noises, are only assumed…

Optimization and Control · Mathematics 2024-04-09 Guangyu Wu , Anders Lindquist

We develop a stochastic parametrization, based on a `simple' deterministic model for the dynamics of steady longshore currents, that produces ensembles that are statistically consistent with field observations of these currents. Unlike…

Data Analysis, Statistics and Probability · Physics 2016-12-06 Juan M. Restrepo , Shankar C. Venkataramani

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

In this paper, we address the problem of uncertainty propagation through nonlinear stochastic dynamical systems. More precisely, given a discrete-time continuous-state probabilistic nonlinear dynamical system, we aim at finding the sequence…

Systems and Control · Electrical Eng. & Systems 2021-02-01 Ashkan Jasour , Allen Wang , Brian C. Williams