English
Related papers

Related papers: When memory pays: Discord in hidden Markov models

200 papers

The impact of randomness on model training is poorly understood. How do differences in data order and initialization actually manifest in the model, such that some training runs outperform others or converge faster? Furthermore, how can we…

Machine Learning · Computer Science 2024-01-23 Michael Y. Hu , Angelica Chen , Naomi Saphra , Kyunghyun Cho

In this paper, we develop methods of nonlinear filtering and prediction of an unobservable Markov chain with a finite set of states. This Markov chain controls coefficients of AR(p) model. Using observations generated by AR(p) model we have…

Probability · Mathematics 2015-03-10 Vasily Vasilyev , Alexander Dobrovidov

Multivariate data sources with components of different information value seem to appear frequently in practice. Models in which the components change their homogeneity at different times are of significant importance. The fact whether any…

Optimization and Control · Mathematics 2020-11-04 Krzysztof Szajowski

We define an evolving in-time Bayesian neural network called a Hidden Markov Neural Network, which addresses the crucial challenge in time-series forecasting and continual learning: striking a balance between adapting to new data and…

Machine Learning · Statistics 2025-01-17 Lorenzo Rimella , Nick Whiteley

Reasoning models have achieved remarkable performance on tasks like math and logical reasoning thanks to their ability to search during reasoning. However, they still suffer from overthinking, often performing unnecessary reasoning steps…

Artificial Intelligence · Computer Science 2025-04-09 Anqi Zhang , Yulin Chen , Jane Pan , Chen Zhao , Aurojit Panda , Jinyang Li , He He

We study indeterminacies in realization of ornaments and how they can be incorporated in a stochastic performance model applicable for music information processing such as score-performance matching. We point out the importance of temporal…

Artificial Intelligence · Computer Science 2016-08-04 Eita Nakamura , Nobutaka Ono , Shigeki Sagayama , Kenji Watanabe

This paper deals with parameter estimation in pair hidden Markov models (pair-HMMs). We first provide a rigorous formalism for these models and discuss possible definitions of likelihoods. The model being biologically motivated, some…

Statistics Theory · Mathematics 2010-12-09 Ana Arribas-Gil , Elisabeth Gassiat , Catherine Matias

We consider the selection of prediction models for Markovian time series. For this purpose, we study the theoretical properties of the hold-out method. In the econometrics literature, the hold-out method is called out-of-sample and is the…

Statistics Theory · Mathematics 2022-04-13 Remy Garnier , Raphaël Langhendries , Joseph Rynkiewicz

We show how Markov mixed membership models (MMMM) can be used to predict the degradation of assets. We model the degradation path of individual assets, to predict overall failure rates. Instead of a separate distribution for each hidden…

Machine Learning · Computer Science 2020-06-03 Paul Hofmann , Zaid Tashman

We consider a change-point detection problem for a simple class of Piecewise Deterministic Markov Processes (PDMPs). A continuous-time PDMP is observed in discrete time and through noise, and the aim is to propose a numerical method to…

Optimization and Control · Mathematics 2017-09-28 Alice Cleynen , Benoîte de Saporta

We analyze the estimation of a time dependent perturbation acting on a continuously monitored quantum system. We describe the temporal fluctuations of the perturbation by a Hidden Markov Model, and we combine quantum measurement theory and…

Quantum Physics · Physics 2021-06-08 Claus Normann Madsen , Lia Valdetaro , Klaus Mølmer

In this paper, we prove that finite state space non parametric hidden Markov models are identifiable as soon as the transition matrix of the latent Markov chain has full rank and the emission probability distributions are linearly…

Methodology · Statistics 2013-06-20 Elisabeth Gassiat , Alice Cleynen , Stéphane Robin

Regime-switching models, in particular Hidden Markov Models (HMMs) where the switching is driven by an unobservable Markov chain, are widely-used in financial applications, due to their tractability and good econometric properties. In this…

Statistical Finance · Quantitative Finance 2016-02-18 Vikram Krishnamurthy , Elisabeth Leoff , Jörn Sass

We consider a hidden Markov model, where the signal process, given by a diffusion, is only indirectly observed through some noisy measurements. The article develops a variational method for approximating the hidden states of the signal…

Optimization and Control · Mathematics 2016-10-26 Tobias Sutter , Arnab Ganguly , Heinz Koeppl

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

Hidden Markov models (HMMs) offer a robust and efficient framework for analyzing time series data, modelling both the underlying latent state progression over time and the observation process, conditional on the latent state. However, a…

Applications · Statistics 2024-07-19 Ioannis Rotous , Alex Diana , Alessio Farcomeni , Eleni Matechou , Andréa Thiebault

Data analysts are essential in organizations, transforming raw data into insights that drive decision-making and strategy. This study explores how analysts' productivity evolves on a collaborative platform, focusing on two key learning…

Social and Information Networks · Computer Science 2025-03-27 Yue Yin

This paper is concerned with a characterization of the observability for a continuous-time hidden Markov model where the state evolves as a general continuous-time Markov process and the observation process is modeled as nonlinear function…

Probability · Mathematics 2020-02-25 Jin W. Kim , Prashant G. Mehta

Time series of conformational dynamics in proteins are usually evaluated with hidden Markov models (HMMs). This approach works well if the number of states and their connectivity is known. However, for the multi-domain protein Hsp90, a…

Transferring information from observations of a dynamical system to estimate the fixed parameters and unobserved states of a system model can be formulated as the evaluation of a discrete time path integral in model state space. The…

Chaotic Dynamics · Physics 2015-05-14 John C. Quinn , Henry D. I. Abarbanel