English
Related papers

Related papers: An Expectation-Maximization Algorithm for Continuo…

200 papers

We consider the problem of sequential detection of a change in the statistical behavior of a hidden Markov model. By adopting a worst-case analysis with respect to the time of change and by taking into account the data that can be accessed…

Statistics Theory · Mathematics 2019-01-29 George V. Moustakides

We consider the problem of performing inference with imprecise continuous-time hidden Markov chains, that is, imprecise continuous-time Markov chains that are augmented with random output variables whose distribution depends on the hidden…

Probability · Mathematics 2017-05-09 Thomas Krak , Jasper De Bock , Arno Siebes

We study sequential Bayesian inference in stochastic kinetic models with latent factors. Assuming continuous observation of all the reactions, our focus is on joint inference of the unknown reaction rates and the dynamic latent states,…

Computation · Statistics 2014-09-10 Junjing Lin , Michael Ludkovski

Kinetic equations model distributions of particles in position-velocity phase space. Often, one is interested in studying the long-time behavior of particles in high-collisional regimes in which an approximate (advection)-diffusion model…

Numerical Analysis · Mathematics 2021-07-09 Emil Løvbak , Giovanni Samaey , Stefan Vandewalle

The need to calibrate increasingly complex statistical models requires a persistent effort for further advances on available, computationally intensive Monte Carlo methods. We study here an advanced version of familiar Markov Chain Monte…

Methodology · Statistics 2015-03-20 Alexandros Beskos , Konstantinos Kalogeropoulos , Erik Pazos

We introduce an extension of finite mixture models by incorporating skew-normal distributions within a Hidden Markov Model framework. By assuming a constant transition probability matrix and allowing emission distributions to vary according…

Methodology · Statistics 2025-09-25 Andrea Nigri , Marco Forti , Han Lin Shang

Inference in hidden Markov model has been challenging in terms of scalability due to dependencies in the observation data. In this paper, we utilize the inherent memory decay in hidden Markov models, such that the forward and backward…

Machine Learning · Statistics 2025-01-14 Felix X. -F. Ye , Yi-an Ma , Hong Qian

In this paper, we study a continuous-time discounted jump Markov decision process with both controlled actions and observations. The observation is only available for a discrete set of time instances. At each time of observation, one has to…

Optimization and Control · Mathematics 2019-07-16 Yunhan Huang , Veeraruna Kavitha , Quanyan Zhu

Advanced algorithms are necessary to obtain faster-than-real-time dynamic simulations in a number of different physical problems that are characterized by widely disparate time scales. Recent advanced dynamic Monte Carlo algorithms that…

Materials Science · Physics 2016-11-23 M. A. Novotny

The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement…

Machine Learning · Computer Science 2024-02-28 YeXin Huang

This paper considers maximum likelihood (ML) estimation in a large class of models with hidden Markov regimes. We investigate consistency of the ML estimator and local asymptotic normality for the models under general conditions which allow…

Statistics Theory · Mathematics 2021-12-07 Demian Pouzo , Zacharias Psaradakis , Martin Sola

The statistics of the diffusive motion of particles often serve as an experimental proxy for their interaction with the environment. However, inferring the physical properties from the observed trajectories is challenging. Inspired by a…

Soft Condensed Matter · Physics 2024-05-29 Amit Federbush , Amit Moscovich , Yohai Bar-Sinai

Aiming to generate realistic synthetic times series of the bivariate process of daily mean temperature and precipitations, we introduce a non-homogeneous hidden Markov model. The non-homogeneity lies in periodic transition probabilities…

Applications · Statistics 2018-10-29 Augustin Touron , Thi Thu Huong Hoang , Sylvie Parey

De-interleaving of the mixtures of Hidden Markov Processes (HMPs) generally depends on its representation model. Existing representation models consider Markov chain mixtures rather than hidden Markov, resulting in the lack of robustness to…

Machine Learning · Statistics 2024-06-04 Jiadi Bao , Mengtao Zhu , Yunjie Li , Shafei Wang

In this paper we consider fully Bayesian inference in general state space models. Existing particle Markov chain Monte Carlo (MCMC) algorithms use an augmented model that takes into account all the variable sampled in a sequential Monte…

Methodology · Statistics 2014-07-31 Christopher K. Carter , Eduardo F. Mendes , Robert Kohn

Sampling from the posterior is a key technical problem in Bayesian statistics. Rigorous guarantees are difficult to obtain for Markov Chain Monte Carlo algorithms of common use. In this paper, we study an alternative class of algorithms…

Statistics Theory · Mathematics 2024-08-26 Andrea Montanari , Yuchen Wu

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a…

High Energy Physics - Phenomenology · Physics 2023-09-06 N. T. Hunt-Smith , W. Melnitchouk , F. Ringer , N. Sato , A. W Thomas , M. J. White

In this article, we consider computing expectations w.r.t. probability measures which are subject to discretization error. Examples include partially observed diffusion processes or inverse problems, where one may have to discretize time…

Computation · Statistics 2021-02-25 Jeremy Heng , Ajay Jasra , Kody J. H. Law , Alexander Tarakanov

This paper presents an algorithm for Monte Carlo fixed-lag smoothing in state-space models defined by a diffusion process observed through noisy discrete-time measurements. Based on a particles approximation of the filtering and smoothing…

Applications · Statistics 2015-06-17 Anne Cuzol , Etienne Mémin

A stochastic hybrid system, also known as a switching diffusion, is a continuous-time Markov process with state space consisting of discrete and continuous parts. We consider parametric estimation of theQmatrix for the discrete state…

Probability · Mathematics 2020-10-14 Masaaki Fukasawa