English
Related papers

Related papers: An Infinite Hidden Markov Model With Similarity-Bi…

200 papers

A Semi-Hidden Markov Model (SHMM) for bursty error channels is defined by a state transition probability matrix $A$, a prior probability vector $\Pi$, and the state dependent output symbol error probability matrix $B$. Several processes are…

Signal Processing · Electrical Eng. & Systems 2019-06-03 Ayokunle Damilola Familua

Suppose that we are given a time series where consecutive samples are believed to come from a probabilistic source, that the source changes from time to time and that the total number of sources is fixed. Our objective is to estimate the…

Information Theory · Computer Science 2018-04-24 Mark Kozdoba , Shie Mannor

Many control tasks exhibit similar dynamics that can be modeled as having common latent structure. Hidden-Parameter Markov Decision Processes (HiP-MDPs) explicitly model this structure to improve sample efficiency in multi-task settings.…

Machine Learning · Computer Science 2021-02-15 Amy Zhang , Shagun Sodhani , Khimya Khetarpal , Joelle Pineau

Hidden Markov Processes (HMP) is one of the basic tools of the modern probabilistic modeling. The characterization of their entropy remains however an open problem. Here the entropy of HMP is calculated via the cycle expansion of the…

Information Theory · Computer Science 2009-11-13 Armen E. Allahverdyan

The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state…

Applications · Statistics 2014-01-16 Vasanthan Raghavan , Aram Galstyan , Alexander G. Tartakovsky

Hidden Markov models (HMMs) are a versatile statistical framework commonly used in ecology to characterize behavioural patterns from animal movement data. In HMMs, the observed data depend on a finite number of underlying hidden states,…

Methodology · Statistics 2024-12-24 Fanny Dupont , Marianne Marcoux , Nigel Hussey , Marie Auger-Méthé

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

Statistics Theory · Mathematics 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

We consider finite state space stationary hidden Markov models (HMMs) in the situation where the number of hidden states is unknown. We provide a frequentist asymptotic evaluation of Bayesian analysis methods. Our main result gives…

Statistics Theory · Mathematics 2014-10-27 Elisabeth Gassiat , Judith Rousseau

Inferring the sequence of states from observations is one of the most fundamental problems in Hidden Markov Models. In statistical physics language, this problem is equivalent to computing the marginals of a one-dimensional model with a…

Disordered Systems and Neural Networks · Physics 2015-05-13 Antoine Sinton

Automated fault localization is an important issue in model validation and verification. It helps the end users in analyzing the origin of failure. In this work, we show the early experiments with probabilistic analysis approaches in fault…

Software Engineering · Computer Science 2016-11-21 Ning Ge , Marc Pantel , Xavier Crégut

A Hidden Markov Model (HMM) is a common statistical model which is widely used for analysis of biological sequence data and other sequential phenomena. In the present paper we show how HMMs can be extended with side-constraints and present…

Artificial Intelligence · Computer Science 2010-08-02 Henning Christiansen , Christian Theil Have , Ole Torp Lassen , Matthieu Petit

A continuous-time Markov process $X$ can be conditioned to be in a given state at a fixed time $T > 0$ using Doob's $h$-transform. This transform requires the typically intractable transition density of $X$. The effect of the $h$-transform…

Probability · Mathematics 2024-09-16 Marc Corstanje , Frank van der Meulen , Moritz Schauer

Time series of conformational dynamics in proteins are usually evaluated with hidden Markov models (HMMs). This approach works well if the number of states and their connectivity is known. However, for the multi-domain protein Hsp90, a…

This paper studies the problem of ergodicity of transition probability matrices in Markovian models, such as hidden Markov models (HMMs), and how it makes very difficult the task of learning to represent long-term context for sequential…

Artificial Intelligence · Computer Science 2014-11-17 Y. Bengio , P. Frasconi

At the scale of the individual cell, protein production is a stochastic process with multiple time scales, combining quick and slow random steps with discontinuous and smooth variation. Hybrid stochastic processes, in particular…

Molecular Networks · Quantitative Biology 2019-05-02 Guilherme C. P. Innocentini , Fernando Antoneli , Arran Hodgkinson , Ovidiu Radulescu

Biological systems need to react to stimuli over a broad spectrum of timescales. If and how this ability can emerge without external fine-tuning is a puzzle. We consider here this problem in discrete Markovian systems, where we can leverage…

Disordered Systems and Neural Networks · Physics 2021-08-11 Faheem Mosam , Diego Vidaurre , Eric De Giuli

Control applications often feature tasks with similar, but not identical, dynamics. We introduce the Hidden Parameter Markov Decision Process (HiP-MDP), a framework that parametrizes a family of related dynamical systems with a…

Machine Learning · Computer Science 2013-08-19 Finale Doshi-Velez , George Konidaris

Large Language Models (LLMs) based on the pre-trained fine-tuning paradigm have become pivotal in solving natural language processing tasks, consistently achieving state-of-the-art performance. Nevertheless, the theoretical understanding of…

Machine Learning · Computer Science 2024-10-02 Jing Luo , Huiyuan Wang , Weiran Huang

Markov state models (MSMs) have been successful in computing metastable states, slow relaxation timescales and associated structural changes, and stationary or kinetic experimental observables of complex molecules from large amounts of…

Chemical Physics · Physics 2015-06-17 Frank Noe , Hao Wu , Jan-Hendrik Prinz , Nuria Plattner

The objective is to study an on-line Hidden Markov model (HMM) estimation-based Q-learning algorithm for partially observable Markov decision process (POMDP) on finite state and action sets. When the full state observation is available,…

Machine Learning · Computer Science 2018-09-25 Hyung-Jin Yoon , Donghwan Lee , Naira Hovakimyan