English
Related papers

Related papers: Sequential Bayesian Learning for Hidden Semi-Marko…

200 papers

Time series subject to change in regime have attracted much interest in domains such as econometry, finance or meteorology. For discrete-valued regimes, some models such as the popular Hidden Markov Chain (HMC) describe time series whose…

Machine Learning · Computer Science 2021-02-26 Fatoumata Dama , Christine Sinoquet

The Baum-Welsh algorithm together with its derivatives and variations has been the main technique for learning Hidden Markov Models (HMM) from observational data. We present an HMM learning algorithm based on the non-negative matrix…

Machine Learning · Computer Science 2011-01-11 George Cybenko , Valentino Crespi

We present an efficient exact algorithm for estimating state sequences from outputs (or observations) in imprecise hidden Markov models (iHMM), where both the uncertainty linking one state to the next, and that linking a state to its…

Artificial Intelligence · Computer Science 2012-10-08 Jasper De Bock , Gert de Cooman

We aim at the construction of a Hidden Markov Model (HMM) of assigned complexity (number of states of the underlying Markov chain) which best approximates, in Kullback-Leibler divergence rate, a given stationary process. We establish, under…

Optimization and Control · Mathematics 2014-07-03 Lorenzo Finesso , Angela Grassi , Peter Spreij

We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed…

Machine Learning · Computer Science 2020-12-18 Joachim Sicking , Maximilian Pintz , Maram Akila , Tim Wirtz

In this paper, we propose circular Hidden Quantum Markov Models (c-HQMMs), which can be applied for modeling temporal data in quantum datasets (with classical datasets as a special case). We show that c-HQMMs are equivalent to a constrained…

Quantum Physics · Physics 2021-11-03 Mohammad Ali Javidian , Vaneet Aggarwal , Zubin Jacob

People are living longer than ever before, and with this arises new complications and challenges for humanity. Among the most pressing of these challenges is of understanding the role of aging in the development of dementia. This paper is…

Methodology · Statistics 2018-08-07 Jonathan P Williams , Curtis B Storlie , Terry M Therneau , Clifford R Jack , Jan Hannig

State space models have long played an important role in signal processing. The Gaussian case can be treated algorithmically using the famous Kalman filter. Similarly since the 1970s there has been extensive application of Hidden Markov…

Statistics Theory · Mathematics 2007-06-13 Peter Bickel , Yaacov Ritov , Tobias Rydén

With the symbolic framework of Probability Bracket Notation (PBN), the Markov Sequence Projector (MSP) is introduced to expand the evolution formula of Homogeneous Markov Chains (HMCs). The well-known weather example, a Visible Markov Model…

Artificial Intelligence · Computer Science 2025-02-21 Xing M. Wang

The stock market presents a challenging environment for accurately predicting future stock prices due to its intricate and ever-changing nature. However, the utilization of advanced methodologies can significantly enhance the precision of…

Systems and Control · Electrical Eng. & Systems 2025-12-02 Luigi Catello , Ludovica Ruggiero , Lucia Schiavone , Mario Valentino

Hidden Markov Models (HMMs) are foundational tools for modeling sequential data with latent Markovian structure, yet fitting them to real-world data remains computationally challenging. In this work, we show that pre-trained large language…

Machine Learning · Computer Science 2026-04-27 Yijia Dai , Zhaolin Gao , Yahya Sattar , Sarah Dean , Jennifer J. Sun

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-10-04 Viktoriya Krakovna , Finale Doshi-Velez

We classify two types of Hierarchical Bayesian Model found in the literature as Hierarchical Prior Model (HPM) and Hierarchical Stochastic Model (HSM). Then, we focus on studying the theoretical implications of the HSM. Using examples of…

Applications · Statistics 2016-11-10 Stephen Wu , Panagiotis Angelikopoulos , James L. Beck , Petros Koumoutsakos

We study sequential Bayesian inference in stochastic kinetic models with latent factors. Assuming continuous observation of all the reactions, our focus is on joint inference of the unknown reaction rates and the dynamic latent states,…

Computation · Statistics 2014-09-10 Junjing Lin , Michael Ludkovski

We show how models for prediction with expert advice can be defined concisely and clearly using hidden Markov models (HMMs); standard HMM algorithms can then be used to efficiently calculate, among other things, how the expert predictions…

Machine Learning · Computer Science 2008-02-15 Wouter Koolen , Steven de Rooij

We investigate a novel modeling approach for end-to-end neural network training using hidden Markov models (HMM) where the transition probabilities between hidden states are modeled and learned explicitly. Most contemporary…

Machine Learning · Computer Science 2023-10-10 Daniel Mann , Tina Raissi , Wilfried Michel , Ralf Schlüter , Hermann Ney

Genetic sequence data are well described by hidden Markov models (HMMs) in which latent states correspond to clusters of similar mutation patterns. Theory from statistical genetics suggests that these HMMs are nonhomogeneous (their…

Applications · Statistics 2016-11-03 Lloyd T. Elliott , Yee Whye Teh

The problem of reducing a Hidden Markov Model (HMM) to one of smaller dimension that exactly reproduces the same marginals is tackled by using a system-theoretic approach. Realization theory tools are extended to HMMs by leveraging suitable…

Machine Learning · Computer Science 2024-06-24 Tommaso Grigoletto , Francesco Ticozzi

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

The proliferation of malware variants poses a significant challenges to traditional malware detection approaches, such as signature-based methods, necessitating the development of advanced machine learning techniques. In this research, we…

Machine Learning · Computer Science 2024-12-30 Ritik Mehta , Olha Jureckova , Mark Stamp