English
Related papers

Related papers: Sequential Bayesian Learning for Hidden Semi-Marko…

200 papers

Mixture models are a fundamental tool in applied statistics and machine learning for treating data taken from multiple subpopulations. The current practice for estimating the parameters of such models relies on local search heuristics…

Machine Learning · Computer Science 2012-09-07 Animashree Anandkumar , Daniel Hsu , Sham M. Kakade

Non-linear state space models are a widely-used class of models for biological, economic, and physical processes. Fitting these models to observed data is a difficult inference problem that has no straightforward solution. We take a…

Computation · Statistics 2013-05-03 Alexander Y. Shestopaloff , Radford M. Neal

An intrinsic problem of classifiers based on machine learning (ML) methods is that their learning time grows as the size and complexity of the training dataset increases. For this reason, it is important to have efficient computational…

Machine Learning · Computer Science 2013-04-16 Khadoudja Ghanem

Hidden Markov Models are widely used in classical computer science to model stochastic processes with a wide range of applications. This paper concerns the quantum analogues of these machines --- so-called Hidden Quantum Markov Models…

Quantum Physics · Physics 2015-03-05 Lewis A. Clark , Wei Huang , Thomas M. Barlow , Almut Beige

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

Time series of conformational dynamics in proteins are usually evaluated with hidden Markov models (HMMs). This approach works well if the number of states and their connectivity is known. However, for the multi-domain protein Hsp90, a…

Bayesian reasoning in linear mixed-effects models (LMMs) is challenging and often requires advanced sampling techniques like Markov chain Monte Carlo (MCMC). A common approach is to write the model in a probabilistic programming language…

Machine Learning · Computer Science 2025-03-25 Jinlin Lai , Justin Domke , Daniel Sheldon

The formalism of state estimation and hidden Markov models (HMMs) can simplify and clarify the discussion of stochastic thermodynamics in the presence of feedback and measurement errors. After reviewing the basic formalism, we use it to…

Statistical Mechanics · Physics 2015-11-13 John Bechhoefer

This paper proposes a new estimation algorithm for the parameters of an HMM as to best account for the observed data. In this model, in addition to the observation sequence, we have \emph{partial} and \emph{noisy} access to the hidden state…

Machine Learning · Computer Science 2012-03-22 Huseyin Ozkan , Arda Akman , Suleyman S. Kozat

The technological applications of hidden Markov models have been extremely diverse and successful, including natural language processing, gesture recognition, gene sequencing, and Kalman filtering of physical measurements. HMMs are highly…

Algebraic Geometry · Mathematics 2012-09-04 Andrew J. Critch

Cyber threat intelligence is one of the emerging areas of focus in information security. Much of the recent work has focused on rule-based methods and detection of network attacks using Intrusion Detection algorithms. In this paper we…

Machine Learning · Computer Science 2024-09-05 Soham Deshmukh , Rahul Rade , Faruk Kazi

In this work, we extend the idea of Quantum Markov chains [S. Gudder. Quantum Markov chains. J. Math. Phys., 49(7), 2008] in order to propose Quantum Hidden Markov Models (QHMMs). For that, we use the notions of Transition Operation…

Quantum Physics · Physics 2017-03-03 Michał Cholewa , Piotr Gawron , Przemysław Głomb , Dariusz Kurzyk

We present a new algorithm for discovering patterns in time series and other sequential data. We exhibit a reliable procedure for building the minimal set of hidden, Markovian states that is statistically capable of producing the behavior…

Machine Learning · Computer Science 2007-05-23 Cosma Rohilla Shalizi , Kristina Lisa Shalizi , James P. Crutchfield

The impact of randomness on model training is poorly understood. How do differences in data order and initialization actually manifest in the model, such that some training runs outperform others or converge faster? Furthermore, how can we…

Machine Learning · Computer Science 2024-01-23 Michael Y. Hu , Angelica Chen , Naomi Saphra , Kyunghyun Cho

This work tackles the problem of learning a set of language specific acoustic units from unlabeled speech recordings given a set of labeled recordings from other languages. Our approach may be described by the following two steps procedure:…

Machine Learning · Computer Science 2019-07-03 Lucas Ondel , Hari Krishna Vydana , Lukáš Burget , Jan Černocký

Automated fault localization is an important issue in model validation and verification. It helps the end users in analyzing the origin of failure. In this work, we show the early experiments with probabilistic analysis approaches in fault…

Software Engineering · Computer Science 2016-11-21 Ning Ge , Marc Pantel , Xavier Crégut

Hidden Markov Models (HMM) model a sequence of observations that are dependent on a hidden (or latent) state that follow a Markov chain. These models are widely used in diverse fields including ecology, speech recognition, and…

Optimization and Control · Mathematics 2024-09-05 Sidonie Foulon , Thérèse Truong , Anne-Louise Leutenegger , Hervé Perdry

Hidden Markov models (HMMs) are ubiquitous in time-series modelling, with applications ranging from chemical reaction modelling to speech recognition. These HMMs are often large, with high-dimensional memories. A recently-proposed…

Quantum Physics · Physics 2026-01-23 Rishi Sundar , Thomas Elliott

This paper proposes a generative model, the latent Dirichlet hidden Markov models (LDHMM), for characterizing a database of sequential behaviors (sequences). LDHMMs posit that each sequence is generated by an underlying Markov chain…

Machine Learning · Statistics 2013-05-27 Yin Song , Longbing Cao , Xuhui Fan , Wei Cao , Jian Zhang

Information seeking process is an important topic in information seeking behavior research. Both qualitative and empirical methods have been adopted in analyzing information seeking processes, with major focus on uncovering the latent…

Information Retrieval · Computer Science 2013-04-09 Shuguang Han , Zhen Yue , Daqing He