English
Related papers

Related papers: Divergence Inequalities with Applications in Ergod…

200 papers

The relative entropy is a principal measure of distinguishability in quantum information theory, with its most important property being that it is non-increasing with respect to noisy quantum operations. Here, we establish a remainder term…

Quantum Physics · Physics 2015-08-31 Mario Berta , Marius Lemm , Mark M. Wilde

This paper is focused on derivations of data-processing and majorization inequalities for $f$-divergences, and their applications in information theory and statistics. For the accessibility of the material, the main results are first…

Information Theory · Computer Science 2020-01-08 Igal Sason

Informational dependence between statistical or quantum subsystems can be described with Fisher matrix or Fubini-Study metric obtained from variations of the sample/configuration space coordinates. Using these non-covariant objects as…

High Energy Physics - Theory · Physics 2019-01-30 Vitaly Vanchurin

This work focuses on time-inhomogeneous Markov chains with two time scales. Our motivations stem from applications in reliability and dependability, queueing networks, financial engineering and manufacturing systems, where two-time-scale…

Probability · Mathematics 2007-05-23 George Yin , Hanqin Zhang

Information inequalities appear in many database applications such as query output size bounds, query containment, and implication between data dependencies. Recently Khamis et al. proposed to study the algorithmic aspects of information…

Databases · Computer Science 2023-09-22 Miika Hannula

We investigate the cutoff phenomenon for Markov processes under information divergences such as $f$-divergences and R\'enyi divergences. We classify most common divergences into four types, namely $L^2$-type, $\mathrm{TV}$-type,…

Probability · Mathematics 2025-01-23 Youjia Wang , Michael C. H. Choi

Renyi's "thinning" operation on a discrete random variable is a natural discrete analog of the scaling operation for continuous random variables. The properties of thinning are investigated in an information-theoretic context, especially in…

Information Theory · Computer Science 2010-08-17 Peter Harremoes , Oliver Johnson , Ioannis Kontoyiannis

We study the limit behaviour of a generally non-linear ordinary differential equation whose solution is a superadditive generalisation of a stochastic matrix, and provide necessary and sufficient conditions for this solution to be ergodic,…

Probability · Mathematics 2016-09-21 Jasper De Bock

In this paper, we establish novel concentration inequalities for additive functionals of geometrically ergodic Markov chains similar to Rosenthal inequalities for sums of independent random variables. We pay special attention to the…

Probability · Mathematics 2025-09-26 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Marina Sheshukova

This paper studies a large number of homogeneous Markov decision processes where the transition probabilities and costs are coupled in the empirical distribution of states (also called mean-field). The state of each process is not known to…

Optimization and Control · Mathematics 2020-12-03 Jalal Arabneydi , Amir G. Aghdam

The analysis of panel count data has garnered considerable attention in the literature, leading to the development of multiple statistical techniques. In inferential analysis, most works focus on leveraging estimating equation-based…

Methodology · Statistics 2025-10-08 Udita Goswami , Shuvashree Mondal

We study the relationship between two classical approaches for quantitative ergodic properties : the first one based on Lyapunov type controls and popularized by Meyn and Tweedie, the second one based on functional inequalities (of…

Probability · Mathematics 2007-05-23 Dominique Bakry , Patrick Cattiaux , Arnaud Guillin

Variational inequalities are an important tool, which includes minimization, saddles, games, fixed-point problems. Modern large-scale and computationally expensive practical applications make distributed methods for solving these problems…

Optimization and Control · Mathematics 2023-03-01 Aleksandr Beznosikov , Alexander Gasnikov

Improved rates of convergence for ergodic homogeneous Markov chains are studied. In comparison to the earlier papers the setting is also generalised to the case without a unique dominated measure. Examples are provided where the new bound…

Probability · Mathematics 2021-11-02 Alexander Veretennikov , Maria Veretennikova

In this paper a concentration inequality is proved for the deviation in the ergodic theorem in the case of discrete time observations of diffusion processes. The proof is based on the geometric ergodicity property for diffusion processes.…

Probability · Mathematics 2011-09-16 Leonid Galtchouk , Serguei Pergamenchtchikov

We study data processing inequalities that are derived from a certain class of generalized information measures, where a series of convex functions and multiplicative likelihood ratios are nested alternately. While these information…

Information Theory · Computer Science 2011-09-27 Neri Merhav

We propose a general approach for quantitative convergence analysis of non-reversible Markov processes, based on the concept of second-order lifts and a variational approach to hypocoercivity. To this end, we introduce the flow Poincar{\'e}…

Analysis of PDEs · Mathematics 2025-07-22 Andreas Eberle , Arnaud Guillin , Leo Hahn , Francis Lörler , Manon Michel

We study the mixing time of two popular discrete-time Markov chains in continuous space, the Unadjusted Langevin Algorithm and the Proximal Sampler, which are discretizations of the Langevin dynamics. We extend mixing time analyses for…

Statistics Theory · Mathematics 2025-02-13 Siddharth Mitra , Andre Wibisono

The paper studies an improved estimate for the rate of convergence for nonlinear homogeneous discrete-time Markov chains. These processes are nonlinear in terms of the distribution law. Hence, the transition kernels are dependent on the…

Probability · Mathematics 2021-05-21 Aleksandr Shchegolev

Imprecise continuous-time Markov chains are a robust type of continuous-time Markov chains that allow for partially specified time-dependent parameters. Computing inferences for them requires the solution of a non-linear differential…

Probability · Mathematics 2018-10-11 Alexander Erreygers , Jasper De Bock