中文
相关论文

相关论文: Loss of memory of hidden Markov models and Lyapuno…

200 篇论文

Hidden semi-Markov Models (HSMM's) - while broadly in use - are restricted to a discrete and uniform time grid. They are thus not well suited to explain often irregularly spaced discrete event data from continuous-time phenomena. We show…

机器学习 · 统计学 2022-10-18 Nicolai Engelmann , Heinz Koeppl

The analyticity of the entropy and relative entropy rates of continuous-state hidden Markov models is studied here. Using the analytic continuation principle and the stability properties of the optimal filter, the analyticity of these rates…

信息论 · 计算机科学 2019-09-02 Vladislav Z. B. Tadic , Arnaud Doucet

We develop an abstract operator-theoretic variational principle for asymptotic growth rates arising from subadditive processes driven by Markov operators: for each invariant measure on the base, the growth rate equals the supremum of fiber…

动力系统 · 数学 2026-04-16 Pablo G. Barrientos , Isaia Nisoli

By making use of martingale representations, we derive the asymptotic normality of particle filters in hidden Markov models and a relatively simple formula for their asymptotic variances. Although repeated resamplings result in complicated…

统计理论 · 数学 2013-12-19 Hock Peng Chan , Tze Leung Lai

Consider the problem of predicting the next symbol given a sample path of length n, whose joint distribution belongs to a distribution class that may have long-term memory. The goal is to compete with the conditional predictor that knows…

统计理论 · 数学 2024-04-25 Yanjun Han , Tianze Jiang , Yihong Wu

We study the top Lyapunov exponent of a product of random $2 \times 2$ matrices appearing in the analysis of several statistical mechanical models with disorder, extending a previous treatment of the critical case (Giacomin and Greenblatt,…

We establish the existence of a full spectrum of Lyapunov exponents for memoryless random dynamical systems with absorption. To this end, we crucially embed the process conditioned to never being absorbed, the $Q$-process, into the…

We consider a hidden Markov model with multiple observation processes, one of which is chosen at each point in time by a policy---a deterministic function of the information state---and attempt to determine which policy minimises the…

概率论 · 数学 2015-03-17 James Y. Zhao

We prove what appears to be the first concentration of measure result for hidden Markov processes. Our bound is stated in terms of the contraction coefficients of the underlying Markov process, and strictly generalizes the Markov process…

概率论 · 数学 2007-05-23 Leonid Kontorovich

We show that maximum entropy (maxent) models can be modeled with certain kinds of HMMs, allowing us to construct maxent models with hidden variables, hidden state sequences, or other characteristics. The models can be trained using the…

人工智能 · 计算机科学 2013-01-07 Joshua Goodman

We consider a finite family of invertible $2 \times 2$ real matrices and a transitive Markov shift on the index set. Let $\lambda$ be the top Lyapunov exponent for random matrix products driven by the Markov shift. We prove that, if the…

动力系统 · 数学 2026-04-15 Nima Alibabaei

We give simple conditions that ensure exponential forgetting of the initial conditions of the filter for general state-space hidden Markov chain. The proofs are based on the coupling argument applied to the posterior Markov kernels. These…

统计理论 · 数学 2007-12-04 Randal Douc , Eric Moulines , Ya'Acov Ritov

Nonparametric identification and maximum likelihood estimation for finite-state hidden Markov models are investigated. We obtain identification of the parameters as well as the order of the Markov chain if the transition probability…

统计理论 · 数学 2015-10-01 Grigory Alexandrovich , Hajo Holzmann , Anna Leister

We consider a bivariate Markov chain $Z=\{Z_k\}_{k \geq 1}=\{(X_k,Y_k)\}_{k \geq 1}$ taking values on product space ${\cal Z}={\cal X} \times{ \cal Y}$, where ${\cal X}$ is possibly uncountable space and ${\cal Y}=\{1,\ldots, |{\cal Y}|\}$…

概率论 · 数学 2021-03-10 Jüri Lember , Joonas Sova

De-interleaving of the mixtures of Hidden Markov Processes (HMPs) generally depends on its representation model. Existing representation models consider Markov chain mixtures rather than hidden Markov, resulting in the lack of robustness to…

机器学习 · 统计学 2024-06-04 Jiadi Bao , Mengtao Zhu , Yunjie Li , Shafei Wang

This paper considers the asymptotic properties of the recursive maximum likelihood estimation in hidden Markov models. The paper is focused on the asymptotic behavior of the log-likelihood function and on the point-convergence and…

统计理论 · 数学 2009-09-24 Vladislav B. Tadić

This paper addresses the issue of model selection for hidden Markov models (HMMs). We generalize factorized asymptotic Bayesian inference (FAB), which has been recently developed for model selection on independent hidden variables (i.e.,…

机器学习 · 计算机科学 2012-06-22 Ryohei Fujimaki , Kohei Hayashi

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

统计理论 · 数学 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

In a growth-fragmentation system, cells grow in size slowly and split apart at random. Typically, the number of cells in the system grows exponentially and the distribution of the sizes of cells settles into an equilibrium 'asymptotic…

概率论 · 数学 2025-01-22 Denis Villemonais , Alexander Watson

In a real life process evolving over time, the relationship between its relevant variables may change. Therefore, it is advantageous to have different inference models for each state of the process. Asymmetric hidden Markov models fulfil…

机器学习 · 计算机科学 2023-05-16 Carlos Puerto-Santana , Pedro Larrañaga , Concha Bielza