English
Related papers

Related papers: Entropy Rate Estimation for Markov Chains with Lar…

200 papers

In this paper, we elaborate over the well-known interpretability issue in echo state networks. The idea is to investigate the dynamics of reservoir neurons with time-series analysis techniques taken from research on complex systems.…

Data Analysis, Statistics and Probability · Physics 2016-11-21 Filippo Maria Bianchi , Lorenzo Livi , Cesare Alippi

The switch Markov chain has been extensively studied as the most natural Markov Chain Monte Carlo approach for sampling graphs with prescribed degree sequences. We use comparison arguments with other, less natural but simpler to analyze,…

Discrete Mathematics · Computer Science 2018-10-29 Georgios Amanatidis , Pieter Kleer

Traditional thermodynamic trade-off relations usually apply to quantities that depend linearly on probability distributions. In contrast, many important information-theoretic measures, such as entropies, are nonlinear and therefore…

Statistical Mechanics · Physics 2026-02-17 Yoshihiko Hasegawa

The reflected entropy $S_R(A:B)$ of a density matrix $\rho_{AB}$ is a bipartite correlation measure lower-bounded by the quantum mutual information $I(A:B)$. In holographic states satisfying the quantum extremal surface formula, where the…

High Energy Physics - Theory · Physics 2021-10-12 Patrick Hayden , Onkar Parrikar , Jonathan Sorce

For a Markovian dynamics on discrete states, the logarithmic ratio of waiting-time distributions between two successive, instantaneous transitions in forward and backward direction is a measure of time-irreversibility. It thus serves as an…

Statistical Mechanics · Physics 2024-06-13 Ellen Meyberg , Julius Degünther , Udo Seifert

We obtain the entropy of flexible linear chains composed of M monomers placed on the square lattice using a transfer matrix approach. An excluded volume interaction is included by considering the chains to be self-and mutually avoiding, and…

Statistical Mechanics · Physics 2009-11-07 W. G. Dantas , J. F. Stilck

Markov random fields are used to model high dimensional distributions in a number of applied areas. Much recent interest has been devoted to the reconstruction of the dependency structure from independent samples from the Markov random…

Computational Complexity · Computer Science 2010-03-09 Guy Bresler , Elchanan Mossel , Allan Sly

Current methods for pattern analysis in time series mainly rely on statistical features or probabilistic learning and inference methods to identify patterns and trends in the data. Such methods do not generalize well when applied to…

Artificial Intelligence · Computer Science 2023-05-01 Yushan Huang , Yuchen Zhao , Alexander Capstick , Francesca Palermo , Hamed Haddadi , Payam Barnaghi

A simple method for finding the entropy and redundancy of a reasonable long sample of English text by direct computer processing and from first principles according to Shannon theory is presented. As an example, results on the entropy of…

Computation and Language · Computer Science 2009-11-19 Fabio G. Guerrero

The scalable calculation of matrix determinants has been a bottleneck to the widespread application of many machine learning methods such as determinantal point processes, Gaussian processes, generalised Markov random fields, graph models…

Numerical Analysis · Computer Science 2017-04-25 Jack Fitzsimons , Diego Granziol , Kurt Cutajar , Michael Osborne , Maurizio Filippone , Stephen Roberts

We show that the way in which the Shannon entropy of sequences produced by an information source converges to the source's entropy rate can be used to monitor how an intelligent agent builds and effectively uses a predictive model of its…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 James P. Crutchfield , David P. Feldman

Given a sufficient statistic for a parametric family of distributions, one can estimate the parameter without access to the data. However, the memory or code size for storing the sufficient statistic may nonetheless still be prohibitive.…

Information Theory · Computer Science 2017-11-17 Masahito Hayashi , Vincent Y. F. Tan

We investigate the mixing properties of a model of reversible Markov chains in random environment, which notably contains the simple random walk on the superposition of a deterministic graph and a second graph whose vertex set has been…

Probability · Mathematics 2026-05-13 Bastien Dubail

Time-homogeneous Markov chains are often used as disease progression models in studies of cost-effectiveness and optimal decision-making. Maximum likelihood estimation of these models can be challenging when data are collected at a time…

Methodology · Statistics 2022-09-26 Duncan Ermini Leaf

Despite substantial progress in non-equilibrium physics, steady-state (s.s.) probabilities remain intractable to analysis. For a Markov process, s.s. probabilities can be expressed in terms of transition rates using the Matrix-Tree theorem…

Statistical Mechanics · Physics 2021-09-07 Ugur Cetiner , Jeremy Gunawardena

We study the problem of learning sparse structure changes between two Markov networks $P$ and $Q$. Rather than fitting two Markov networks separately to two sets of data and figuring out their differences, a recent work proposed to learn…

Machine Learning · Statistics 2016-04-11 Song Liu , Taiji Suzuki , Raissa Relator , Jun Sese , Masashi Sugiyama , Kenji Fukumizu

Estimating the transition dynamics of controlled Markov chains is crucial in fields such as time series analysis, reinforcement learning, and system exploration. Traditional non-parametric density estimation methods often assume independent…

Statistics Theory · Mathematics 2025-05-21 Imon Banerjee , Vinayak Rao , Harsha Honnappa

Based on the theory of stochastic chemical kinetics, the inherent randomness and stochasticity of biochemical reaction networks can be accurately described by discrete-state continuous-time Markov chains. The analysis of such processes is,…

Numerical Analysis · Mathematics 2014-10-14 Andreychenko Alexander , Mikeev Linar , Wolf Verena

Consider the standard stochastic reaction network model where the dynamics is given by a continuous-time Markov chain over a discrete lattice. For such models, estimation of parameter sensitivities is an important problem, but the existing…

Quantitative Methods · Quantitative Biology 2019-05-01 Patrik Dürrenberger , Ankit Gupta , Mustafa Khammash

We study the error introduced by entropy regularization in infinite-horizon discrete discounted Markov decision processes. We show that this error decreases exponentially in the inverse regularization strength, both in a weighted…

Optimization and Control · Mathematics 2025-12-16 Johannes Müller , Semih Cayci