English
Related papers

Related papers: Estimate exponential memory decay in Hidden Markov…

200 papers

We consider the problem of predicting the next observation given a sequence of past observations, and consider the extent to which accurate prediction requires complex algorithms that explicitly leverage long-range dependencies. Perhaps…

Machine Learning · Computer Science 2018-06-29 Vatsal Sharan , Sham Kakade , Percy Liang , Gregory Valiant

We show that maximum entropy (maxent) models can be modeled with certain kinds of HMMs, allowing us to construct maxent models with hidden variables, hidden state sequences, or other characteristics. The models can be trained using the…

Artificial Intelligence · Computer Science 2013-01-07 Joshua Goodman

Matrix factor model is drawing growing attention for simultaneous two-way dimension reduction of well-structured matrix-valued observations. This paper focuses on robust statistical inference for matrix factor model in the ``diverging…

Methodology · Statistics 2023-06-07 Yong He , Xin-Bing Kong , Dong Liu , Ran Zhao

We develop a recursion for hidden Markov model of any order h, which allows us to obtain the posterior distribution of the latent state at every occasion, given the previous h states and the observed data. With respect to the well-known…

Statistics Theory · Mathematics 2012-01-04 Francesco Bartolucci

In chaotic dynamical systems such as the weather, prediction errors grow faster in some situations than in others. Real-time knowledge about the error growth could enable strategies to adjust the modelling and forecasting infrastructure…

Computational Physics · Physics 2023-04-26 Daniel Ayers , Jack Lau , Javier Amezcua , Alberto Carrassi , Varun Ojha

Predictability of behavior has emerged an an important characteristic in many fields including biology, medicine, and marketing. Behavior can be recorded as a sequence of actions performed by an individual over a given time period. This…

Methodology · Statistics 2017-11-13 Brian Vegetabile , Jenny Molet , Tallie Z. Baram , Hal Stern

Maximum a posteriori (MAP) inference in discrete-valued Markov random fields is a fundamental problem in machine learning that involves identifying the most likely configuration of random variables given a distribution. Due to the…

Machine Learning · Computer Science 2020-07-03 Jonathan N. Lee , Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

Factorial hidden Markov models (FHMMs) are powerful tools of modeling sequential data. Learning FHMMs yields a challenging simultaneous model selection issue, i.e., selecting the number of multiple Markov chains and the dimensionality of…

Machine Learning · Statistics 2015-06-29 Shaohua Li , Ryohei Fujimaki , Chunyan Miao

Loss development modelling is the actuarial practice of predicting the total 'ultimate' losses incurred on a set of policies once all claims are reported and settled. This poses a challenging prediction task as losses frequently take years…

Methodology · Statistics 2025-02-11 Conor Goold

In the paper, the approximate sequence for entropy of some binary hidden Markov models has been found to have two bound sequences, the low bound sequence and the upper bound sequence. The error bias of the approximate sequence is bound by a…

Information Theory · Computer Science 2011-12-30 Shuangping Chen , Jun Li , Mi Zhou

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

Training large deep neural networks is resource intensive. This study investigates whether Lyapunov exponents can accelerate this process by aiding in the selection of hyperparameters. To study this I formulate an optimization problem using…

Machine Learning · Computer Science 2024-10-10 Tirthankar Mittra

Entropy estimation, due in part to its connection with mutual information, has seen considerable use in the study of time series data including causality detection and information flow. In many cases, the entropy is estimated using…

Statistics Theory · Mathematics 2019-08-06 Alexander L Young , David B Dunson

We propose a Bayesian hidden Markov model for analyzing time series and sequential data where a special structure of the transition probability matrix is embedded to model explicit-duration semi-Markovian dynamics. Our formulation allows…

Methodology · Statistics 2022-05-23 Beniamino Hadj-Amar , Jack Jewson , Mark Fiecas

We consider active maximum a posteriori (MAP) inference problem for Hidden Markov Models (HMM), where, given an initial MAP estimate of the hidden sequence, we select to label certain states in the sequence to improve the estimation…

Machine Learning · Statistics 2015-09-02 Armen E. Allahverdyan , Aram Galstyan

Given noisy, partial observations of a time-homogeneous, finite-statespace Markov chain, conceptually simple, direct statistical inference is available, in theory, via its rate matrix, or infinitesimal generator, $\mathsf{Q}$, since $\exp…

Methodology · Statistics 2020-03-23 Chris Sherlock

We consider the problem of performing inference with imprecise continuous-time hidden Markov chains, that is, imprecise continuous-time Markov chains that are augmented with random output variables whose distribution depends on the hidden…

Probability · Mathematics 2017-05-09 Thomas Krak , Jasper De Bock , Arno Siebes

We consider the smoothing probabilities of hidden Markov model (HMM). We show that under fairly general conditions for HMM, the exponential forgetting still holds, and the smoothing probabilities can be well approximated with the ones of…

Machine Learning · Statistics 2011-05-11 J. Lember

We consider a hidden Markov model, where the signal process, given by a diffusion, is only indirectly observed through some noisy measurements. The article develops a variational method for approximating the hidden states of the signal…

Optimization and Control · Mathematics 2016-10-26 Tobias Sutter , Arnab Ganguly , Heinz Koeppl

People are living longer than ever before, and with this arises new complications and challenges for humanity. Among the most pressing of these challenges is of understanding the role of aging in the development of dementia. This paper is…

Methodology · Statistics 2018-08-07 Jonathan P Williams , Curtis B Storlie , Terry M Therneau , Clifford R Jack , Jan Hannig