English
Related papers

Related papers: A variational approach to path estimation and para…

200 papers

Piecewise diffusion Markov processes (PDifMPs) form a versatile class of stochastic hybrid systems that combine continuous diffusion processes with discrete event-driven dynamics, enabling flexible modelling of complex real-world hybrid…

Methodology · Statistics 2025-11-18 Sascha Desmettre , Agnes Mallinger , Amira Meddah , Irene Tubikanec

This paper introduces Discrete Markov Probabilistic Models (DMPMs), a novel discrete diffusion algorithm for discrete data generation. The algorithm operates in discrete bit space, where the noising process is a continuous-time Markov chain…

Machine Learning · Statistics 2025-10-09 Le-Tuyet-Nhi Pham , Dario Shariatian , Antonio Ocello , Giovanni Conforti , Alain Durmus

Global variational approximation methods in graphical models allow efficient approximate inference of complex posterior distributions by using a simpler model. The choice of the approximating model determines a tradeoff between the…

Artificial Intelligence · Computer Science 2013-01-14 Tal El-Hay , Nir Friedman

The generalized perturbative approach is an all purpose variant of Stein's method used to obtain rates of normal approximation. Originally developed for functions of independent random variables this method is here extended to functions of…

Probability · Mathematics 2020-10-12 Christian Houdré , George Kerchev

We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under…

Optimization and Control · Mathematics 2014-07-03 Lorenzo Finesso , Angela Grassi , Peter Spreij

The estimation of the covariance function of a stochastic process, or signal, is of integral importance for a multitude of signal processing applications. In this work, we derive closed-form expressions for the variance of covariance…

Signal Processing · Electrical Eng. & Systems 2021-10-05 Filip Elvander , Johan Karlsson

In this paper, we propose a class of efficient, accurate, and general methods for solving state-estimation problems with equality and inequality constraints. The methods are based on recent developments in variable splitting and partially…

Optimization and Control · Mathematics 2020-12-02 Rui Gao , Filip Tronarp , Simo Särkkä

Stochastic variational inference for collapsed models has recently been successfully applied to large scale topic modelling. In this paper, we propose a stochastic collapsed variational inference algorithm for hidden Markov models, in a…

Machine Learning · Statistics 2015-12-08 Pengyu Wang , Phil Blunsom

We study the performance of a stochastic algorithm based on the power method that adaptively learns the large deviation functions characterizing the fluctuations of additive functionals of Markov processes, used in physics to model…

Statistical Mechanics · Physics 2023-03-30 Francesco Coghi , Hugo Touchette

A generic method for inferring a dynamical hidden Markov model from a time series is proposed. Under reasonable hypothesis, the model is updated in constant time whenever a new measurement arrives.

Formal Languages and Automata Theory · Computer Science 2021-05-05 Teodor Knapik

In this article a flexible Bayesian non-parametric model is proposed for non-homogeneous hidden Markov models. The model is developed through the amalgamation of the ideas of hidden Markov models and predictor dependent stick-breaking…

Methodology · Statistics 2012-05-10 Abhra Sarkar , Anindya Bhadra , Bani K. Mallick

This paper introduces a method to approximate Gaussian process regression by representing the problem as a stochastic differential equation and using variational inference to approximate solutions. The approximations are compared with full…

Machine Learning · Computer Science 2019-01-08 Wil O C Ward , Mauricio A Álvarez

Gradient matching is a promising tool for learning parameters and state dynamics of ordinary differential equations. It is a grid free inference approach, which, for fully observable systems is at times competitive with numerical…

Machine Learning · Statistics 2018-04-11 Nico S. Gorbach , Stefan Bauer , Joachim M. Buhmann

The aim of this paper is to approximate a finite-state Markov process by another process with fewer states, called herein the approximating process. The approximation problem is formulated using two different methods. The first method,…

We propose a scalable variational Bayes method for statistical inference for a single or low-dimensional subset of the coordinates of a high-dimensional parameter in sparse linear regression. Our approach relies on assigning a mean-field…

Machine Learning · Statistics 2025-08-12 Ismaël Castillo , Alice L'Huillier , Kolyan Ray , Luke Travis

We observe n possibly dependent random variables, the distribution of which is presumed to be stationary even though this might not be true, and we aim at estimating the stationary distribution. We establish a non-asymptotic deviation bound…

Statistics Theory · Mathematics 2023-07-10 Alexandre Lecestre

Undirected graphical models are applied in genomics, protein structure prediction, and neuroscience to identify sparse interactions that underlie discrete data. Although Bayesian methods for inference would be favorable in these contexts,…

Machine Learning · Statistics 2017-06-15 John Ingraham , Debora Marks

Motivated by applications in movement ecology, in this paper I propose a new class of integrated continuous-time hidden Markov models in which each observation depends on the underlying state of the process over the whole interval since the…

Methodology · Statistics 2019-10-01 Paul G Blackwell

We construct a novel estimator for the diffusion coefficient of the limiting homogenized equation, when observing the slow dynamics of a multiscale model, in the case when the slow dynamics are of bounded variation. Previous research…

Statistics Theory · Mathematics 2018-07-04 Theodoros Manikas , Anastasia Papavasiliou

Hidden Markov models (HMM) have been widely used by scientists to model stochastic systems: the underlying process is a discrete Markov chain and the observations are noisy realizations of the underlying process. Determining the number of…

Statistics Theory · Mathematics 2024-07-18 Yang Chen , Cheng-Der Fuh , Chu-Lan Michael Kao