English
Related papers

Related papers: R\'enyi entropy and variance comparison for symmet…

200 papers

We establish the first tight lower bound of $\Omega(\log\log\kappa)$ on the query complexity of sampling from the class of strongly log-concave and log-smooth distributions with condition number $\kappa$ in one dimension. Whereas existing…

Statistics Theory · Mathematics 2021-06-11 Sinho Chewi , Patrik Gerber , Chen Lu , Thibaut Le Gouic , Philippe Rigollet

By using the existing sharp estimates of density function for rotationally invariant symmetric $\alpha$-stable L\'{e}vy processes and rotationally invariant symmetric truncated $\alpha$-stable L\'{e}vy processes, we obtain that Harnack…

Probability · Mathematics 2011-05-17 Jian Wang

Recently, an interesting quantity called the quantum Renyi divergence (or "sandwiched" Renyi relative entropy) was defined for pairs of positive semi-definite operators $\rho$ and $\sigma$. It depends on a parameter $\alpha$ and acts as a…

Quantum Physics · Physics 2014-07-28 Nilanjana Datta , Felix Leditzky

Numerous entropy-type characteristics (functionals) generalizing R\'enyi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and…

Statistics Theory · Mathematics 2011-03-28 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

We calculate the limiting behavior of relative Renyi entropy when the first probability distribution is close to the second one in a non-regular location-shift family which is generated by a probability distribution whose support is an…

Probability · Mathematics 2007-06-13 Masahito Hayashi

A comprehensive investigation of the entanglement characteristics is carried out on tripartite spin-1/2 systems, examining prototypical tripartite states, the thermal Heisenberg model, and the transverse field Ising model. The entanglement…

Quantum Physics · Physics 2024-11-05 Marwa Mannaï , Hisham Sati , Tim Byrnes , Chandrashekar Radhakrishnan

Shannon's Entropy Power Inequality can be viewed as characterizing the minimum differential entropy achievable by the sum of two independent random variables with fixed differential entropies. The entropy power inequality has played a key…

Information Theory · Computer Science 2012-07-31 Varun Jog , Venkat Anantharam

In this letter we show that the R\'enyi entanglement entropy of a region of large size $\ell$ in a one-dimensional critical model whose ground state breaks conformal invariance (such as in those described by non-unitary conformal field…

High Energy Physics - Theory · Physics 2015-06-19 Davide Bianchini , Olalla A. Castro-Alvaredo , Benjamin Doyon , Emanuele Levi , Francesco Ravanini

We investigate bounds in the transmission of classical information through quantum systems. Our focus lies in the generalized Holevo theorem, which provides a single-letter Holevo-like inequality from arbitrary quantum distance measures.…

For normalized sums $Z_n$ of i.i.d. random variables, we explore necessary and sufficient conditions which guarantee the normal approximation with respect to the R\'enyi divergence of infinite order. In terms of densities $p_n$ of $Z_n$,…

Probability · Mathematics 2024-06-21 Sergey G. Bobkov , Friedrich Götze

Configurational entropy, or complexity, plays a critical role in characterizing disordered systems such as glasses, yet its measurement often requires significant computational resources. Recently, R\'enyi entropy, a one-parameter…

Disordered Systems and Neural Networks · Physics 2025-08-27 Nina Javerzat , Eric Bertin , Misaki Ozawa

We study graph orientations that minimize the entropy of the in-degree sequence. The problem of finding such an orientation is an interesting special case of the minimum entropy set cover problem previously studied by Halperin and Karp…

Data Structures and Algorithms · Computer Science 2008-10-28 Jean Cardinal , Samuel Fiorini , Gwenaël Joret

A lower bound on the R\'enyi differential entropy of a sum of independent random vectors is demonstrated in terms of rearrangements. For the special case of Boltzmann-Shannon entropy, this lower bound is better than that given by the…

Information Theory · Computer Science 2015-05-07 Liyao Wang , Mokshay Madiman

We study the problem of exact sampling under an exponential communication cost, specifically Campbell's average codeword length $L(t)$ of order $t$, and R\'enyi's entropy. We provide a lower bound on the Campbell cost of exact sampling that…

Information Theory · Computer Science 2026-04-03 Spencer Hill , Fady Alajaji , Tamás Linder

We investigate the R\'enyi entropy of independent sums of integer valued random variables through Fourier theoretic means, and give sharp comparisons between the variance and the R\'enyi entropy, for Poisson-Bernoulli variables. As…

Probability · Mathematics 2024-03-19 Mokshay Madiman , James Melbourne , Cyril Roberto

Let $X$ be a real-valued random variable with distribution function $F$. Set $X_1,\dots, X_m$ to be independent copies of $X$ and let $F_m$ be the corresponding empirical distribution function. We show that there are absolute constants…

Probability · Mathematics 2023-08-10 Daniel Bartl , Shahar Mendelson

We study the R\'enyi entropies in the spin-$1/2$ anisotropic Heisenberg chain after a quantum quench starting from the N\'eel state. The quench action method allows us to obtain the stationary R\'enyi entropies for arbitrary values of the…

Statistical Mechanics · Physics 2018-11-13 Vincenzo Alba , Pasquale Calabrese

We prove the exponential convergence to the equilibrium, quantified by R\'enyi divergence, of the solution of the Fokker-Planck equation with drift given by the gradient of a strictly convex potential. This extends the classical exponential…

Analysis of PDEs · Mathematics 2019-06-19 Yu Cao , Jianfeng Lu , Yulong Lu

We establish quantitative stability results for the entropy power inequality (EPI). Specifically, we show that if uniformly log-concave densities nearly saturate the EPI, then they must be close to Gaussian densities in the quadratic…

Information Theory · Computer Science 2016-10-26 Thomas A. Courtade , Max Fathi , Ashwin Pananjady

Consider tossing a collection of coins, each fair or biased towards heads, and take the distribution of the total number of heads that result. It is natural to conjecture that this distribution should be 'more random' when each coin is…

Probability · Mathematics 2019-11-20 Erwan Hillion , Oliver Johnson