English
Related papers

Related papers: Entropy of Hidden Markov Processes via Cycle Expan…

200 papers

This work derives a theoretical value for the entropy of a Linear Additive Markov Process (LAMP), an expressive model able to generate sequences with a given autocorrelation structure. While a first-order Markov Chain model generates new…

Information Theory · Computer Science 2023-01-10 Bridget Smart , Matthew Roughan , Lewis Mitchell

This Letter presents a neural estimator for entropy production, or NEEP, that estimates entropy production (EP) from trajectories of relevant variables without detailed information on the system dynamics. For steady state, we rigorously…

Statistical Mechanics · Physics 2020-10-06 Dong-Kyum Kim , Youngkyoung Bae , Sangyun Lee , Hawoong Jeong

Hidden Markov model (HMM) has been successfully used for sequential data modeling problems. In this work, we propose to power the modeling capacity of HMM by bringing in neural network based generative models. The proposed model is termed…

Machine Learning · Computer Science 2020-05-26 Dong Liu , Antoine Honoré , Saikat Chatterjee , Lars K. Rasmussen

A possibly time-dependent transition intensity matrix or generator $(Q(t))$ characterizes the law of a Markov jump process (MP). For a time homogeneous MP, the transition probability matrix (TPM) can be expressed as a matrix exponential of…

Methodology · Statistics 2025-07-23 Dario Gasbarra , Sangita Kulathinal , Etienne Sebag

Characterizing the sleep-wake cycle in adolescents is an important prerequisite to better understand the association of abnormal sleep patterns with subsequent clinical and behavioral outcomes. The aim of this research was to develop hidden…

Applications · Statistics 2022-12-22 Semhar B. Ogbagaber , Yifan Cui , Kaigang Li , Ronald J. Iannotti , Paul S. Albert

The use of stochastic models, in effect piecewise deterministic Markov processes (PDMP), has become increasingly popular especially for the modeling of chemical reactions and cell biophysics. Yet, exact simulation methods, for the…

Numerical Analysis · Mathematics 2015-04-28 Romain Veltz

This paper reveals the intrinsic structure of Matrix Product States (MPS) by establishing their deep connection to entangled hidden Markov models (EHMMs). It is demonstrated that a significant class of MPS can be derived as the outcomes of…

Quantum Physics · Physics 2025-02-19 Abdessatar Souissi

In this paper, we propose an algorithm for estimating the parameters of a time-homogeneous hidden Markov model from aggregate observations. This problem arises when only the population level counts of the number of individuals at each time…

Machine Learning · Computer Science 2021-11-16 Rahul Singh , Qinsheng Zhang , Yongxin Chen

Detecting broken time-reversibility at micro- and nanoscale is often difficult when experiments offer limited state resolution. We introduce a lumping method that builds an effective semi-Markov model able to reproduce exactly the full…

Statistical Mechanics · Physics 2025-12-16 Gianluca Teza , Attilio L. Stella , Trevor GrandPre

Entropy production characterizes the thermodynamic irreversibility and reflects the amount of heat dissipated into the environment and free energy lost in nonequilibrium systems. According to the thermodynamic uncertainty relation, we…

Statistical Mechanics · Physics 2020-05-01 Tan Van Vu , Van Tuan Vo , Yoshihiko Hasegawa

In the general process of eliminating dynamic variables in Markovian models, there exists a difference in the irreversible entropy production between the original and reduced dynamics. We call this difference the hidden entropy production,…

Statistical Mechanics · Physics 2022-06-28 Kyogo Kawaguchi , Yohei Nakayama

Hamiltonian Monte Carlo (HMC) is a powerful Markov chain Monte Carlo (MCMC) method for performing approximate inference in complex probabilistic models of continuous variables. In common with many MCMC methods, however, the standard HMC…

Computation · Statistics 2017-04-12 Matthew M. Graham , Amos J. Storkey

We study the problem of synthesizing a policy that maximizes the entropy of a Markov decision process (MDP) subject to a temporal logic constraint. Such a policy minimizes the predictability of the paths it generates, or dually, maximizes…

Optimization and Control · Mathematics 2019-06-17 Yagiz Savas , Melkior Ornik , Murat Cubuktepe , Mustafa O. Karabag , Ufuk Topcu

We focus on a data sequence produced by repetitive quantum measurement on an internal hidden quantum system, and call it a hidden Markovian process. Using a quantum version of the Perron-Frobenius theorem, we derive novel upper and lower…

Quantum Physics · Physics 2020-10-08 Masahito Hayashi , Yuuya Yoshida

We prove that under mild positivity assumptions the entropy rate of a hidden Markov chain varies analytically as a function of the underlying Markov chain parameters. A general principle to determine the domain of analyticity is stated. An…

Probability · Mathematics 2007-07-13 Guangyue Han , Brian Marcus

An autoregressive process with Markov regime is an autoregressive process for which the regression function at each time point is given by a nonobservable Markov chain. In this paper we consider the asymptotic properties of the maximum…

Statistics Theory · Mathematics 2007-06-13 Randal Douc , Eric Moulines , Tobias Ryden

The minimum entropy production principle provides an approximative variational characterization of close-to-equilibrium stationary states, both for macroscopic systems and for stochastic models. Analyzing the fluctuations of the empirical…

Mathematical Physics · Physics 2009-11-05 C. Maes , K. Netocny

Consider a measure-preserving transition kernel $T$ on an arbitrary probability space $(\mathbb X,\mathcal cA,\pi)$. In this level of generality, we prove that a one-step hyper-contractivity estimate of the form $\|T\|_{p\to q}\le 1$ with…

Probability · Mathematics 2026-02-20 Justin Salez

How heterogeneous multiscale methods (HMM) handle fluctuations acting on the slow variables in fast-slow systems is investigated. In particular, it is shown via analysis of central limit theorems (CLT) and large deviation principles (LDP)…

Probability · Mathematics 2016-01-12 David Kelly , Eric Vanden-Eijnden

The minimum realization problem of hidden Markov models (HMM's) is a fundamental question of stationary discrete-time processes with a finite alphabet. It was shown in the literature that tensor decomposition methods give the hidden Markov…

Optimization and Control · Mathematics 2020-08-27 Yoshito Ohta