English
Related papers

Related papers: Information-Theoretic Reduction of Markov Chains

200 papers

Using an information theoretic point of view, we investigate how a dynamics acting on a network can be coarse grained through the use of graph partitions. Specifically, we are interested in how aggregating the state space of a Markov…

Physics and Society · Physics 2017-11-07 Mauro Faccin , Michael T. Schaub , Jean-Charles Delvenne

Many biological systems can be described by finite Markov models. A general method for simplifying master equations is presented that is based on merging adjacent states. The approach preserves the steady-state probability distribution and…

Biological Physics · Physics 2021-03-01 David Seiferth , Peter Sollich , Stefan Klumpp

Stochastic processes on complex networks, where each node is in one of several compartments, and neighboring nodes interact with each other, can be used to describe a variety of real-world spreading phenomena. However, computational…

Social and Information Networks · Computer Science 2019-06-28 Gerrit Großmann , Luca Bortolussi

This review paper provides an introduction of Markov chains and their convergence rates which is an important and interesting mathematical topic which also has important applications for very widely used Markov chain Monte Carlo (MCMC)…

Probability · Mathematics 2021-09-03 Yu Hang Jiang , Tong Liu , Zhiya Lou , Jeffrey S. Rosenthal , Shanshan Shangguan , Fei Wang , Zixuan Wu

The paper is devoted to studies of perturbed Markov chains commonly used for description of information networks. In such models, the matrix of transition probabilities for the corresponding Markov chain is usually regularised by adding a…

A lumping of a Markov chain is a coordinate-wise projection of the chain. We characterise the entropy rate preservation of a lumping of an aperiodic and irreducible Markov chain on a finite state space by the random growth rate of the…

Information Theory · Computer Science 2015-04-21 Bernhard C. Geiger , Christoph Temmel

Given a strongly stationary Markov chain and a finite set of stopping rules, we prove the existence of a polynomial algorithm which projects the Markov chain onto a minimal Markov chain without redundant information. Markov complexity is…

Probability · Mathematics 2007-05-23 Giacomo Aletti

The goal of information retrieval is to recommend a list of document candidates that are most relevant to a given query. Listwise learning trains neural retrieval models by comparing various candidates simultaneously on a large scale,…

Information Retrieval · Computer Science 2021-07-30 Zhizhong Chen , Carsten Eickhoff

Markov chains are an important tool for modelling and evaluating systems in computer science, economics, biology and numerous other fields. Thus, approximating Markov chains is a useful tool for decreasing the computational effort needed…

Probability · Mathematics 2025-07-16 Patrick Sonnentag

Detecting broken time-reversibility at micro- and nanoscale is often difficult when experiments offer limited state resolution. We introduce a lumping method that builds an effective semi-Markov model able to reproduce exactly the full…

Statistical Mechanics · Physics 2025-12-16 Gianluca Teza , Attilio L. Stella , Trevor GrandPre

We consider the problem of testing the identity of a reversible Markov chain against a reference from a single trajectory of observations. Employing the recently introduced notion of a lumping-congruent Markov embedding, we show that, at…

Probability · Mathematics 2023-02-17 Geoffrey Wolfer , Shun Watanabe

The concepts of probability, statistics and stochastic theory are being successfully used in structural engineering. Markov Chain modelling is a simple stochastic process model that has found its application in both describing stochastic…

Applications · Statistics 2007-08-14 K. Balaji Rao

This simple note lays out a few observations which are well known in many ways but may not have been said in quite this way before. The basic idea is that when comparing two different Markov chains it is useful to couple them is such a way…

Probability · Mathematics 2017-11-16 James E. Johndrow , Jonathan C. Mattingly

We consider the Markov chain approximations for singular stable-like processes. First we obtain properties of some Markov chains. Then we construct the approximating Markov chains and give a necessary condition for weak convergence of these…

Probability · Mathematics 2012-10-11 Fangjun Xu

We study the approximation of a Markov chain on a reduced state space, for both discrete- and continuous-time Markov chains. In this context, we extend the existing theory of formal error bounds for the approximated transient distributions.…

Probability · Mathematics 2025-02-12 Fabian Michel , Markus Siegle

We present a Markov-chain analysis of blockwise-stochastic algorithms for solving partially block-separable optimization problems. Our main contributions to the extensive literature on these methods are statements about the Markov operators…

Optimization and Control · Mathematics 2023-11-01 D. Russell Luke

We study an information-theoretic minimax problem for finite multivariate Markov chains on $d$-dimensional product state spaces. Given a family $\mathcal B=\{P_1,\ldots,P_n\}$ of $\pi$-stationary transition matrices and a class $\mathcal F…

Probability · Mathematics 2026-02-17 Zheyuan Lai , Michael C. H. Choi

We study the problem of learning the transition matrices of a set of Markov chains from a single stream of observations on each chain. We assume that the Markov chains are ergodic but otherwise unknown. The learner can sample Markov chains…

Machine Learning · Computer Science 2019-11-14 Mohammad Sadegh Talebi , Odalric-Ambrym Maillard

We explore a simple mathematical model of network computation, based on Markov chains. Similar models apply to a broad range of computational phenomena, arising in networks of computers, as well as in genetic, and neural nets, in social…

Information Retrieval · Computer Science 2009-04-18 Dusko Pavlovic

We consider state-aggregation schemes for Markov chains from an information-theoretic perspective. Specifically, we consider aggregating the states of a Markov chain such that the mutual information of the aggregated states separated by T…

Physics and Society · Physics 2021-08-23 Mauro Faccin , Michael T. Schaub , Jean-Charles Delvenne