English
Related papers

Related papers: The Renyi Capacity and Center

200 papers

This paper fills a gap in our understanding of the interaction between information and computation. It unifies other approaches to measuring information like Kolmogorov complexity and Shannon information. We define a theory about…

Information Theory · Computer Science 2016-11-24 P. W. Adriaans

A well-known technique in estimating probabilities of rare events in general and in information theory in particular (used, e.g., in the sphere-packing bound), is that of finding a reference probability measure under which the event of…

Information Theory · Computer Science 2014-12-23 Rami Atar , Neri Merhav

Various properties of isoperimetric, functional, Transport-Entropy and concentration inequalities are studied on a Riemannian manifold equipped with a measure, whose generalized Ricci curvature is bounded from below. First, stability of…

Functional Analysis · Mathematics 2010-11-11 Emanuel Milman

This paper develops systematic approaches to obtain $f$-divergence inequalities, dealing with pairs of probability measures defined on arbitrary alphabets. Functional domination is one such approach, where special emphasis is placed on…

Information Theory · Computer Science 2016-12-06 Igal Sason , Sergio Verdú

R\'enyi entropy of order \alpha is a general measure of entropy. In this paper we derive estimations for the R\'enyi entropy of the mixture of sources in terms of the entropy of the single sources. These relations allow to compute the…

Information Theory · Computer Science 2012-04-13 Marek Śmieja , Jacek Tabor

Given a Radon probability measure $\mu$ supported in $\mathbb{R}^d$, we are interested in those points $x$ around which the measure is concentrated infinitely many times on thin annuli centered at $x$. Depending on the lower and upper…

Classical Analysis and ODEs · Mathematics 2022-08-26 Zoltán Buczolich , Stéphane Seuret

In this work, we provide some novel results that establish both the existence of Henig global proper efficient points and their density in the efficient set for vector optimization problems in arbitrary normed spaces. Our results do not…

Optimization and Control · Mathematics 2024-11-01 Fernando García-Castaño , Miguel Ángel Melguizo-Padial

The Raney numbers are a class of combinatorial numbers generalising the Fuss--Catalan numbers. They are indexed by a pair of positive real numbers $(p,r)$ with $p>1$ and $0 < r \le p$, and form the moments of a probability density function.…

Mathematical Physics · Physics 2015-06-16 Peter J. Forrester , Dang-Zheng Liu , Paul Zinn-Justin

This work investigates binary hypothesis testing between $H_0\sim P_0$ and $H_1\sim P_1$ in the finite-sample regime under asymmetric error constraints. By employing the ``reverse" R\'enyi divergence, we derive novel non-asymptotic bounds…

Information Theory · Computer Science 2026-01-21 Roberto Bruno , Adrien Vandenbroucque , Amedeo Roberto Esposito

We study data processing inequalities that are derived from a certain class of generalized information measures, where a series of convex functions and multiplicative likelihood ratios are nested alternately. While these information…

Information Theory · Computer Science 2011-09-27 Neri Merhav

The widely claimed replicability crisis in science may lead to revised standards of significance. The customary frequentist confidence intervals, calibrated through hypothetical repetitions of the experiment that is supposed to have…

Statistics Theory · Mathematics 2020-02-11 Luigi Pace , Alessandra Salvan

This work explores properties of Strong Data-Processing constants for R\'enyi Divergences. Parallels are made with the well-studied $\varphi$-Divergences, and it is shown that the order $\alpha$ of R\'enyi Divergences dictates whether…

Information Theory · Computer Science 2026-01-15 Adrien Vandenbroucque , Amedeo Roberto Esposito , Michael Gastpar

Computing entanglement entropy and its cousins is often challenging even in the simplest continuum and lattice models, partly because such entropies depend nontrivially on all geometric characteristics of the entangling region. Quantum…

Quantum Physics · Physics 2016-04-28 Mohammad F. Maghrebi

The conditional quantum mutual information $I(A;B|C)$ of a tripartite state $\rho_{ABC}$ is an information quantity which lies at the center of many problems in quantum information theory. Three of its main properties are that it is…

Quantum Physics · Physics 2015-03-17 Mario Berta , Kaushik P. Seshadreesan , Mark M. Wilde

We adapt arguments concerning information-theoretic convergence in the Central Limit Theorem to the case of dependent random variables under Rosenblatt mixing conditions. The key is to work with random variables perturbed by the addition of…

Probability · Mathematics 2008-10-06 Oliver Johnson

In this work the information loss in deterministic, memoryless systems is investigated by evaluating the conditional entropy of the input random variable given the output random variable. It is shown that for a large class of systems the…

Information Theory · Computer Science 2013-04-18 Bernhard C. Geiger , Gernot Kubin

We study nonparametric Bayesian statistical inference for the parameters governing a pure jump process of the form $$Y_t = \sum_{k=1}^{N(t)} Z_k,~~~ t \ge 0,$$ where $N(t)$ is a standard Poisson process of intensity $\lambda$, and $Z_k$ are…

Statistics Theory · Mathematics 2019-10-02 Richard Nickl , Jakob Söhl

Notion of effective size of support (Ess) of a random variable is introduced. A small set of natural requirements that a measure of Ess should satisfy is presented. The measure with prescribed properties is in a direct (exp-) relationship…

Statistics Theory · Mathematics 2007-06-13 M. Grendar

We generalize the topological entanglement entropy to a family of topological Renyi entropies parametrized by a parameter alpha, in an attempt to find new invariants for distinguishing topologically ordered phases. We show that,…

Strongly Correlated Electrons · Physics 2010-01-05 Steven T. Flammia , Alioscia Hamma , Taylor L. Hughes , Xiao-Gang Wen

We prove that any strongly mixing action of a countable abelian group on a probability space has higher order mixing properties. This is achieved via introducing and utilizing $\mathcal R$-limits, a notion of convergence which is based on…

Dynamical Systems · Mathematics 2021-07-28 Vitaly Bergelson , Rigoberto Zelada