English
Related papers

Related papers: Fundamental limits for learning hidden Markov mode…

200 papers

Learning-based approaches to verifying unknown Markov decision processes (MDPs) often employ uncertain MDPs. These models use, for example, confidence intervals to capture transition uncertainty and allow synthesis of policies that are…

Machine Learning · Computer Science 2026-05-05 Yannik Schnitzer , Alessandro Abate , David Parker

We study parameterized MDPs (PMDPs) in which the key parameters of interest are unknown and must be learned using Bayesian inference. One key defining feature of such models is the presence of "uninformative" actions that provide no…

Systems and Control · Electrical Eng. & Systems 2023-05-16 Michael Gimelfarb , Michael Jong Kim

In this paper, we propose circular Hidden Quantum Markov Models (c-HQMMs), which can be applied for modeling temporal data in quantum datasets (with classical datasets as a special case). We show that c-HQMMs are equivalent to a constrained…

Quantum Physics · Physics 2021-11-03 Mohammad Ali Javidian , Vaneet Aggarwal , Zubin Jacob

Markov Decision Processes (MDPs) are a popular class of models suitable for solving control decision problems in probabilistic reactive systems. We consider parametric MDPs (pMDPs) that include parameters in some of the transition…

Logic in Computer Science · Computer Science 2018-06-14 Sebastian Arming , Ezio Bartocci , Krishnendu Chatterjee , Joost-Pieter Katoen , Ana Sokolova

We describe a generalization of the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) which is able to encode prior information that state transitions are more likely between "nearby" states. This is accomplished by defining a…

Machine Learning · Statistics 2017-07-24 Colin Reimer Dawson , Chaofan Huang , Clayton T. Morrison

This paper explores unsupervised learning of parsing models along two directions. First, which models are identifiable from infinite data? We use a general technique for numerically checking identifiability based on the rank of a Jacobian…

Machine Learning · Statistics 2012-06-15 Daniel Hsu , Sham M. Kakade , Percy Liang

We study large but finite neural networks that, in the thermodynamic limit, admit an exact low-dimensional mean-field description. We assume that the governing mean-field equations describing macroscopic quantities such as the mean firing…

Chaotic Dynamics · Physics 2026-02-11 Irmantas Ratas , Kestutis Pyragas

Markov state models (MSMs) have been successful in computing metastable states, slow relaxation timescales and associated structural changes, and stationary or kinetic experimental observables of complex molecules from large amounts of…

Chemical Physics · Physics 2015-06-17 Frank Noe , Hao Wu , Jan-Hendrik Prinz , Nuria Plattner

Analysis of multivariate healthcare time series data is inherently challenging: irregular sampling, noisy and missing values, and heterogeneous patient groups with different dynamics violating exchangeability. In addition, interpretability…

Machine Learning · Computer Science 2023-11-15 Onur Poyraz , Pekka Marttinen

We present and analyse three online algorithms for learning in discrete Hidden Markov Models (HMMs) and compare them with the Baldi-Chauvin Algorithm. Using the Kullback-Leibler divergence as a measure of generalisation error we draw…

Machine Learning · Statistics 2007-08-20 Roberto C. Alamino , Nestor Caticha

Since the early days of digital communication, Hidden Markov Models (HMMs) have now been routinely used in speech recognition, processing of natural languages, images, and in bioinformatics. An HMM $(X_i,Y_i)_{i\ge 1}$ assumes observations…

Statistics Theory · Mathematics 2009-02-06 J. Lember , A. Koloydenko

Epistemic uncertainty is often viewed as a reducible uncertainty that vanishes with increasing data. This perspective implicitly assumes parameter identifiability and equates epistemic uncertainty with predictive variability. In…

Machine Learning · Computer Science 2026-05-26 David Rügamer

Scientists use mathematical modelling to understand and predict the properties of complex physical systems. In highly parameterised models there often exist relationships between parameters over which model predictions are identical, or…

Data Analysis, Statistics and Probability · Physics 2017-03-24 Dhruva V. Raman , James Anderson , Antonis Papachristodoulou

Identifiability of parameters is an essential property for a statistical model to be useful in most settings. However, establishing parameter identifiability for Bayesian networks with hidden variables remains challenging. In the context of…

Statistics Theory · Mathematics 2014-06-04 Elizabeth S. Allman , John A. Rhodes , Elena Stanghellini , Marco Valtorta

Machine learning (ML) methods are highly flexible, but their ability to approximate the true data-generating process is fundamentally constrained by finite samples. We characterize a universal lower bound, the Limits-to-Learning Gap (LLG),…

Machine Learning · Statistics 2025-12-16 Zhimin Chen , Bryan Kelly , Semyon Malamud

We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the…

Statistics Theory · Mathematics 2017-05-19 Luc Lehéricy

Machine learning (ML) and deep learning models are extensively used for parameter optimization and regression problems. However, not all inverse problems in ML are ``identifiable,'' indicating that model parameters may not be uniquely…

Machine Learning · Computer Science 2023-07-24 Reza Sameni

The Monte Carlo within Metropolis (MCwM) algorithm, interpreted as a perturbed Metropolis-Hastings (MH) algorithm, provides an approach for approximate sampling when the target distribution is intractable. Assuming the unperturbed Markov…

Computation · Statistics 2019-07-31 Felipe Medina-Aguayo , Daniel Rudolf , Nikolaus Schweizer

We propose DenseHMM - a modification of Hidden Markov Models (HMMs) that allows to learn dense representations of both the hidden states and the observables. Compared to the standard HMM, transition probabilities are not atomic but composed…

Machine Learning · Computer Science 2020-12-18 Joachim Sicking , Maximilian Pintz , Maram Akila , Tim Wirtz

This paper considers cluster detection in Block Markov Chains (BMCs). These Markov chains are characterized by a block structure in their transition matrix. More precisely, the $n$ possible states are divided into a finite number of $K$…

Probability · Mathematics 2019-07-31 Jaron Sanders , Alexandre Proutière , Se-Young Yun