English
Related papers

Related papers: Equivalence of Hidden Markov Models with Continuou…

200 papers

Consider a filtering process associated to a hidden Markov model with densities for which both the state space and the observation space are complete, separable, metric spaces. If the underlying, hidden Markov chain is strongly ergodic and…

Probability · Mathematics 2016-06-03 Thomas Kaijser

Deep sequence models are receiving significant interest in current machine learning research. By representing probability distributions that are fit to data using maximum likelihood estimation, such models can model data on general…

Systems and Control · Electrical Eng. & Systems 2024-09-09 Kristian Løvland , Bjarne Grimstad , Lars Struen Imsland

In this paper, we prove that finite state space non parametric hidden Markov models are identifiable as soon as the transition matrix of the latent Markov chain has full rank and the emission probability distributions are linearly…

Methodology · Statistics 2013-06-20 Elisabeth Gassiat , Alice Cleynen , Stéphane Robin

We consider a hidden Markov model with multiple observation processes, one of which is chosen at each point in time by a policy---a deterministic function of the information state---and attempt to determine which policy minimises the…

Probability · Mathematics 2015-03-17 James Y. Zhao

We introduce an extension of finite mixture models by incorporating skew-normal distributions within a Hidden Markov Model framework. By assuming a constant transition probability matrix and allowing emission distributions to vary according…

Methodology · Statistics 2025-09-25 Andrea Nigri , Marco Forti , Han Lin Shang

Hidden Markov models provide a natural statistical framework for the detection of the copy number variations (CNV) in genomics. In this paper, we consider a Hidden Markov Model involving several correlated hidden processes at the same time.…

Methodology · Statistics 2017-06-22 Xiaoqiang Wang , Emilie Lebarbier , Julie Aubert , Stéphane Robin

Hidden semi-Markov models (HSMMs) are latent variable models which allow latent state persistence and can be viewed as a generalization of the popular hidden Markov models (HMMs). In this paper, we introduce a novel spectral algorithm to…

Machine Learning · Statistics 2016-03-01 Igor Melnyk , Arindam Banerjee

A discrete-time stochastic process derived from a model of basketball is used to generalize any discrete distribution. The generalized distributions can have one or two more parameters than the parent distribution. Those derived from…

Applications · Statistics 2020-06-25 Rose Baker

We consider the problem of predicting the next observation given a sequence of past observations, and consider the extent to which accurate prediction requires complex algorithms that explicitly leverage long-range dependencies. Perhaps…

Machine Learning · Computer Science 2018-06-29 Vatsal Sharan , Sham Kakade , Percy Liang , Gregory Valiant

Multi-state models are frequently applied for representing processes evolving through a discrete set of state. Important classes of multi-state models arise when transitions between states may depend on the time since entry into the current…

Methodology · Statistics 2022-02-28 Rosario Barone , Andrea Tancredi

Finding the underlying probability distributions of a set of observed sequences under the constraint that each sequence is generated i.i.d by a distinct distribution is considered. The number of distributions, and hence the number of…

Information Theory · Computer Science 2018-10-16 Sara Shahi , Daniela Tuninetti , Natasha Devroye

We present several new results on the feasibility of inferring the hidden states in strongly-connected trackable weak models. Here, a weak model is a directed graph in which each node is assigned a set of colors which may be emitted when…

Machine Learning · Computer Science 2020-01-22 Mark Chilenski , George Cybenko , Isaac Dekine , Piyush Kumar , Gil Raz

A hidden Markov model is called observable if distinct initial laws give rise to distinct laws of the observation process. Observability implies stability of the nonlinear filter when the signal process is tight, but this need not be the…

Probability · Mathematics 2009-08-10 Ramon van Handel

The problem of reducing a Hidden Markov Model (HMM) to one of smaller dimension that exactly reproduces the same marginals is tackled by using a system-theoretic approach. Realization theory tools are extended to HMMs by leveraging suitable…

Machine Learning · Computer Science 2024-06-24 Tommaso Grigoletto , Francesco Ticozzi

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

Suppose that we are given a time series where consecutive samples are believed to come from a probabilistic source, that the source changes from time to time and that the total number of sources is fixed. Our objective is to estimate the…

Information Theory · Computer Science 2018-04-24 Mark Kozdoba , Shie Mannor

In this article, we consider abstract linear conservative systems and their time-discrete counterparts. Our main result is a representation formula expressing solutions of the continuous model through the solution of the corresponding…

Analysis of PDEs · Mathematics 2013-04-30 Sylvain Ervedoza , Enrique Zuazua

Consider longitudinal networks whose edges turn on and off according to a discrete-time Markov chain with exponential-family transition probabilities. We characterize when their joint distributions are also exponential families with the…

Methodology · Statistics 2024-03-12 William K. Schwartz , Sonja Petrović , Hemanshu Kaul

When is keeping a memory of observations worthwhile? We use hidden Markov models to look at phase transitions that emerge when comparing state estimates in systems with discrete states and noisy observations. We infer the underlying state…

Statistical Mechanics · Physics 2017-07-05 Emma Lathouwers , John Bechhoefer

Continuous-time multistate models are widely used for analyzing interval-censored data on disease progression over time. Sometimes, diseases manifest differently and what appears to be a coherent collection of symptoms is the expression of…

Methodology · Statistics 2024-10-08 Yidan Shi , Leilei Zeng , Mary E. Thompson , Suzanne L. Tyas