English
Related papers

Related papers: Hidden Markov Process: A New Representation, Entro…

200 papers

Energy flow in bio-molecular motors and machines are vital to their function. Yet experimental observations are often limited to a small subset of variables that participate in energy transport and dissipation. Here we show, through a…

Statistical Mechanics · Physics 2016-08-17 Shou-Wen Wang , Kyogo Kawaguchi , Shin-ichi Sasa , Lei-Han Tang

Entropy production characterizes the thermodynamic irreversibility and reflects the amount of heat dissipated into the environment and free energy lost in nonequilibrium systems. According to the thermodynamic uncertainty relation, we…

Statistical Mechanics · Physics 2020-05-01 Tan Van Vu , Van Tuan Vo , Yoshihiko Hasegawa

This work aims at providing a new model for time series classification based on learning from just one example. We assume that time series can be well characterized as a parametric random process, a sort of Hidden semi-Markov Model…

Machine Learning · Statistics 2022-11-18 Adrián Pérez Herrero , Paulo Félix Lamas , Jesús María Rodríguez Presedo

We address the problem of analyzing sets of noisy time-varying signals that all report on the same process but confound straightforward analyses due to complex inter-signal heterogeneities and measurement artifacts. In particular we…

Hidden Markov Models, HMM's, are mathematical models of Markov processes with state that is hidden, but from which information can leak. They are typically represented as 3-way joint-probability distributions. We use HMM's as denotations of…

Logic in Computer Science · Computer Science 2023-06-22 Annabelle McIver , Carroll Morgan , Tahiry Rabehaja

We investigate a stationary process's crypticity---a measure of the difference between its hidden state information and its observed information---using the causal states of computational mechanics. Here, we motivate crypticity and cryptic…

Data Analysis, Statistics and Probability · Physics 2015-05-30 John R. Mahoney , Christopher J. Ellison , Ryan G. James , James P. Crutchfield

The theory of ``Markov-up'' processes is being developed. This is a new class of stochastic processes with ``partial'' markovian features; it could also be called ``one-sided Markov''. Such a behavior may be found in the real world and in…

Probability · Mathematics 2024-07-01 D. O. Kalikaeva

In this work we introduce a method for estimating entropy rate and entropy production rate from finite symbolic time series. From the point of view of statistics, estimating entropy from a finite series can be interpreted as a problem of…

Statistical Mechanics · Physics 2021-02-24 Raul Salgado-Garcia , Cesar Maldonado

Continuous-time multistate models are widely used for analyzing interval-censored data on disease progression over time. Sometimes, diseases manifest differently and what appears to be a coherent collection of symptoms is the expression of…

Methodology · Statistics 2024-10-08 Yidan Shi , Leilei Zeng , Mary E. Thompson , Suzanne L. Tyas

In [Haruna, T. and Nakajima, K., 2011. Physica D 240, 1370-1377], the authors introduced the duality between values (words) and orderings (permutations) as a basis to discuss the relationship between information theoretic measures for…

Chaotic Dynamics · Physics 2015-06-04 Taichi Haruna , Kohei Nakajima

The master equation and, more generally, Markov processes are routinely used as models for stochastic processes. They are often justified on the basis of randomization and coarse-graining assumptions. Here instead, we derive n-th order…

Statistical Mechanics · Physics 2012-09-27 Julian Lee , Steve Pressé

This report addresses state inference for hidden Markov models. These models rely on unobserved states, which often have a meaningful interpretation. This makes it necessary to develop diagnostic tools for quantification of state…

Statistics Theory · Mathematics 2018-10-26 Jean-Baptiste Durand , Y. Guédon

Renewal processes are broadly used to model stochastic behavior consisting of isolated events separated by periods of quiescence, whose durations are specified by a given probability law. Here, we identify the minimal sufficient statistic…

Statistical Mechanics · Physics 2023-07-19 Sarah Marzen , James P. Crutchfield

The paper studies information-theoretic opacity, an information-flow privacy property, in a setting involving two agents: A planning agent who controls a stochastic system and an observer who partially observes the system states. The goal…

Systems and Control · Electrical Eng. & Systems 2024-11-20 Chongyang Shi , Yuheng Bu , Jie Fu

In stochastic modeling, the excess entropy -- the mutual information shared between a process's past and future -- represents the fundamental lower bound of the memory needed to simulate its dynamics. However, this bound cannot be saturated…

Quantum Physics · Physics 2026-02-27 Kelvin Onggadinata , Andrew Tanggara , Mile Gu , Dagomir Kaszlikowski

We describe a generalization of the Hierarchical Dirichlet Process Hidden Markov Model (HDP-HMM) which is able to encode prior information that state transitions are more likely between "nearby" states. This is accomplished by defining a…

Machine Learning · Statistics 2017-07-24 Colin Reimer Dawson , Chaofan Huang , Clayton T. Morrison

Stochastic thermodynamics allows us to define heat and work for microscopic systems far from thermodynamic equilibrium, based on observations of their stochastic dynamics. However, a complete account of the energetics necessitates that all…

Statistical Mechanics · Physics 2021-08-31 Jannik Ehrich

We define the projected entropy S(T) at a given temperature T in the context of an Ising model transition matrix calculation as the entropy associated with the distribution of Markov chain realizations in energy-magnetization, E-H, space.…

Statistical Mechanics · Physics 2018-10-17 David Yevick

Semi-Markov processes play an important role in the effective description of partially accessible systems in stochastic thermodynamics. They occur, for instance, in coarse-graining procedures such as state lumping and when analyzing waiting…

Statistical Mechanics · Physics 2026-01-19 Alexander M. Maier , Jonas H. Fritz , Udo Seifert

The rate of entropy production by a stochastic process quantifies how far it is from thermodynamic equilibrium. Equivalently, entropy production captures the degree to which detailed balance and time-reversal symmetry are broken. Despite…

Statistical Mechanics · Physics 2020-12-02 Luca Cocconi , Rosalba Garcia-Millan , Zigan Zhen , Bianca Buturca , Gunnar Pruessner