English
Related papers

Related papers: R\'enyi entropy and variance comparison for symmet…

200 papers

We establish for dual quantization the counterpart of Kieffer's uniqueness result for compactly supported one dimensional probability distributions having a $\log$-concave density (also called strongly unimodal): for such distributions,…

Probability · Mathematics 2020-10-22 Benjamin Jourdain , Gilles Pagès

The conventional channel resolvability problem refers to the determination of the minimum rate required for an input process so that the output distribution approximates a target distribution in either the total variation distance or the…

Information Theory · Computer Science 2018-12-04 Lei Yu , Vincent Y. F. Tan

We derive a strengthened monotonicity inequality for quantum relative entropy by employing properties of $\alpha$-R\'{e}nyi relative entropy. We develop a unifying treatment towards the improvement of some quantum entropy inequalities. In…

Quantum Physics · Physics 2016-03-21 Lin Zhang

We revisit generalized entropic formulations of the uncertainty principle for an arbitrary pair of quantum observables in two-dimensional Hilbert space. R\'enyi entropy is used as uncertainty measure associated with the distribution…

Quantum Physics · Physics 2014-06-23 Steeve Zozor , Gustavo Martín Bosyk , Mariela Portesi

If $- \infty < \alpha < \beta < \infty $ and $f \in C^{3} \left( [ \alpha , \beta ] \times {\bf R}^{2} , {\bf R} \right) $ is bounded, while $y \in C^{2} \left( [ \alpha , \beta ] , {\bf R} \right) $ solves the typical one-dimensional…

Optimization and Control · Mathematics 2015-02-18 Nikolaos E. Sofronidis

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës

A framework for deriving R\'enyi entropy-power inequalities (EPIs) is presented that uses linearization and an inequality of Dembo, Cover, and Thomas. Simple arguments are given to recover the previously known R\'enyi EPIs and derive new…

Information Theory · Computer Science 2020-04-08 Olivier Rioul

The R\'enyi and Shannon entropies are information-theoretic measures which have enabled to formulate the position-momentum uncertainty principle in a much more adequate and stringent way than the (variance-based) Heisenberg-like relation.…

Quantum Physics · Physics 2013-05-24 Pablo Sánchez-Moreno , Steeve Zozor , Jesus S. Dehesa

We obtain uncertainty and certainty relations of state-independent form for the three Pauli observables with use of the R\'enyi entropies of order $\alpha\in(0;1]$. It is shown that these entropic bounds are tight in the sense that they are…

Quantum Physics · Physics 2014-04-03 Alexey E. Rastegin

Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation T_a. That is, if X and Y are independent random variables on Z_+ with ultra-log-concave…

Information Theory · Computer Science 2009-09-24 Yaming Yu , Oliver Johnson

Given a branching random walk$\{Z_n\}_{n\geq0}$ on $\mathbb{R}$, let $Z_n([y,\infty))$ be the number of particles located in $[y,\infty)$ at generation $n$. It is known from \cite{Biggins1977} that under some mild conditions, $n^{-1}\log…

Probability · Mathematics 2020-12-03 Shuxiong Zhang

We study a likelihood ratio test for the location of the mode of a log-concave density. Our test is based on comparison of the log-likelihoods corresponding to the unconstrained maximum likelihood estimator of a log-concave density and the…

Statistics Theory · Mathematics 2018-06-05 Charles R. Doss , Jon A. Wellner

An information theoretic approach to bounds in superconformal field theories is proposed. It is proved that the supersymmetric R\'enyi entropy $\bar S_\alpha$ is a monotonically decreasing function of $\alpha$ and $(\alpha-1)\bar S_\alpha$…

High Energy Physics - Theory · Physics 2023-03-03 Yang Zhou

Estimating statistical properties is fundamental in statistics and computer science. In this paper, we propose a unified quantum algorithm framework for estimating properties of discrete probability distributions, with estimating R\'enyi…

Quantum Physics · Physics 2024-04-04 Xinzhao Wang , Shengyu Zhang , Tongyang Li

We compute the R\'enyi entropies of the massless Dirac field on the Euclidean torus (the Lorentzian cylinder at non-zero temperature) for arbitrary spatial regions. We do it by the resolvent method, i.e., we express the entropies in terms…

High Energy Physics - Theory · Physics 2022-02-24 David Blanco , Tomás Ferreira Chase , Juan Laurnagaray , Guillem Pérez-Nadal

Quantum key distribution requires tight and reliable bounds on the secret key rate to ensure robust security. This is particularly so for the regime of finite block sizes, where the optimization of generalized R\'enyi entropic quantities is…

Quantum Physics · Physics 2026-04-09 Rebecca R. B. Chung , Nelly H. Y. Ng , Yu Cai

This paper proposes an $\alpha$-leakage measure for $\alpha\in[0,\infty)$ by a cross entropy interpretation of R{\'{e}}nyi entropy. While R\'{e}nyi entropy was originally defined as an $f$-mean for $f(t) = \exp((1-\alpha)t)$, we reveal that…

Information Theory · Computer Science 2024-01-30 Ni Ding , Mohammad Amin Zarrabian , Parastoo Sadeghi

How low can the joint entropy of $n$ $d$-wise independent (for $d\ge2$) discrete random variables be, subject to given constraints on the individual distributions (say, no value may be taken by a variable with probability greater than $p$,…

Discrete Mathematics · Computer Science 2022-04-05 Dmytro Gavinsky , Pavel Pudlák

We consider the generalized differential entropy of normalized sums of independent and identically distributed (IID) continuous random variables. We prove that the R\'{e}nyi entropy and Tsallis entropy of order $\alpha\ (\alpha>0)$ of the…

Information Theory · Computer Science 2011-06-20 Hongfei Cui , Jianqiang Sun , Yiming Ding

We provide an operational interpretation of the multivariate R\'enyi divergence in terms of economic-theoretic tasks based on betting, risk aversion, and multiple lotteries. We show that the multivariate R\'enyi divergence…

Quantum Physics · Physics 2026-01-27 Andrés F. Ducuara , Erkka Haapasalo , Ryo Takakura