English
Related papers

Related papers: Divergence Inequalities with Applications in Ergod…

200 papers

Nonlinear time series models with exogenous regressors are essential in econometrics, queuing theory, and machine learning, though their statistical analysis remains incomplete. Key results, such as the law of large numbers and the…

Statistics Theory · Mathematics 2025-10-24 Attila Lovas

Using elementary methods, we prove that for a countable Markov chain $P$ of ergodic degree $d > 0$ the rate of convergence towards the stationary distribution is subgeometric of order $n^{-d}$, provided the initial distribution satisfies…

Probability · Mathematics 2007-05-23 Stefano Isola

We study normal approximations for a class of discrete-time occupancy processes, namely, Markov chains with transition kernels of product Bernoulli form. This class encompasses numerous models which appear in the complex networks…

Probability · Mathematics 2018-11-13 Liam Hodgkinson , Ross McVinish , Philip K. Pollett

A complete time-parameterized statistical model quantifying the divergent evolution of protein structures in terms of the patterns of conservation of their secondary structures is inferred from a large collection of protein 3D structure…

Quantitative Methods · Quantitative Biology 2023-08-15 Sandun Rajapaksa , Lloyd Allison , Peter J. Stuckey , Maria Garcia de la Banda , Arun S. Konagurthu

Tight bounds for several symmetric divergence measures are introduced, given in terms of the total variation distance. Each of these bounds is attained by a pair of 2 or 3-element probability distributions. An application of these bounds…

Information Theory · Computer Science 2016-11-15 Igal Sason

We study ergodic properties of some Markov chains models in random environments when the random Markov kernels that define the dynamic satisfy some usual drift and small set conditions but with random coefficients. In particular, we adapt a…

Probability · Mathematics 2021-08-16 Lionel Truquet

We investigate the problem of quantifying contraction coefficients of Markov transition kernels in Kantorovich ($L^1$ Wasserstein) distances. For diffusion processes, relatively precise quantitative bounds on contraction rates have recently…

Probability · Mathematics 2018-08-22 Andreas Eberle , Mateusz B. Majka

We study a majority based preference diffusion model in which the members of a social network update their preferences based on those of their connections. Consider an undirected graph where each node has a strict linear order over a set of…

Social and Information Networks · Computer Science 2023-12-27 Ahad N. Zehmakan

This article provides the first procedure for computing a fully data-dependent interval that traps the mixing time $t_{\text{mix}}$ of a finite reversible ergodic Markov chain at a prescribed confidence level. The interval is computed from…

Machine Learning · Computer Science 2015-11-04 Daniel Hsu , Aryeh Kontorovich , Csaba Szepesvári

We suggest an approach to obtaining general two-sided bounds on the rate of convergence in terms of special "weighted" norms related to total variation. Some important classes of continuous-time Markov chains are considered:…

Probability · Mathematics 2015-07-15 A. Zeifman , V. Korolev

There has been substantial interest in developing Markov chain Monte Carlo algorithms based on piecewise-deterministic Markov processes. However existing algorithms can only be used if the target distribution of interest is differentiable…

Statistics Theory · Mathematics 2021-11-12 Augustin Chevallier , Sam Power , Andi Q. Wang , Paul Fearnhead

In this paper we describe a triple correspondence between graph limits, information theory and group theory. We put forward a new graph limit concept called log-convergence that is closely connected to dense graph limits but its main…

Combinatorics · Mathematics 2015-04-06 Balazs Szegedy

We study the convergence rate to stationarity for a class of exchangeable partition-valued Markov chains called cut-and-paste chains. The law governing the transitions of a cut-and-paste chain are determined by products of i.i.d. stochastic…

Probability · Mathematics 2012-09-25 Harry Crane , Steven P. Lalley

The data-processing inequality, that is, $I(U;Y) \le I(U;X)$ for a Markov chain $U \to X \to Y$, has been the method of choice for proving impossibility (converse) results in information theory and many other disciplines. Various…

Information Theory · Computer Science 2016-08-01 Yury Polyanskiy , Yihong Wu

Expressions for (EPI Shannon type) Divergence-Power Inequalities (DPI) in two cases (time-discrete and band-limited time-continuous) of stationary random processes are given. The new expressions connect the divergence rate of the sum of…

Information Theory · Computer Science 2016-11-17 Jacob Binia

We present an extension of the ergodic, mixing and Bernoulli levels of the ergodic hierarchy in dynamical systems, the information geometric ergodic hierarchy (IGEH), making use of statistical models on curved manifolds in the context of…

Mathematical Physics · Physics 2017-06-28 Ignacio S. Gomez , Mariela Portesi

During the last two decades, concentration of measure has been a subject of various exciting developments in convex geometry, functional analysis, statistical physics, high-dimensional statistics, probability theory, information theory,…

Information Theory · Computer Science 2015-10-13 Maxim Raginsky , Igal Sason

We present a numerical method to compute expectations of functionals of a piecewise-deterministic Markov process. We discuss time dependent functionals as well as deterministic time horizon problems. Our approach is based on the…

Probability · Mathematics 2012-01-31 Adrien Brandejsky , Benoîte de Saporta , François Dufour

We report opposite statistical mechanical behaviors of the two major paradigms in which quantum correlation measures are defined, viz., the entanglement-separability paradigm and the information-theoretic one. We show this by considering…

Quantum Physics · Physics 2012-08-13 R. Prabhu , Aditi Sen De , Ujjwal Sen

We introduce an inequality which may be viewed as a generalization of both the Brascamp-Lieb inequality and its reverse (Barthe's inequality), and prove its information-theoretic (i.e.\ entropic) formulation. This result leads to a unified…

Information Theory · Computer Science 2017-12-05 Jingbo Liu , Thomas A. Courtade , Paul Cuff , Sergio Verdu