Related papers: Bernoulli sums and R\'enyi entropy inequalities

This paper gives upper and lower bounds on the minimum error probability of Bayesian $M$-ary hypothesis testing in terms of the Arimoto-R\'enyi conditional entropy of an arbitrary order $\alpha$. The improved tightness of these bounds over…

We study random exponential sums of the form $\sum_{k=1}^nX_k\times\ex p\{i(\lambda_k^{(1)}t_1+...+\lambda_k^{(s)}t_s)\}$, where $\{X_n\}$ is a sequence of random variables and $\{\lambda_n^{(i)}:1\leq i\leq s\}$ are sequences of real…

Observational entropy -- a quantity that unifies Boltzmann's entropy, Gibbs' entropy, von Neumann's macroscopic entropy, and the diagonal entropy -- has recently been argued to play a key role in a modern formulation of statistical…

We introduce a new measure of interdependence among the components of a random vector along the main diagonal of the vector copula, i.e. along the line $u_{1}=\ldots=u_{J}$, for $\left(u_{1},\ldots,u_{J}\right)\in\left[0,1\right]^{J}$. Our…

We exhibit infinitely many new, constrained inequalities for the von Neumann entropy, and show that they are independent of each other and the known inequalities obeyed by the von Neumann entropy (basically strong subadditivity). The new…

We investigate the role of convexity in R\'enyi entropy power inequalities. After proving that a general R\'enyi entropy power inequality in the style of Bobkov-Chistyakov (2015) fails when the R\'enyi parameter $r\in(0,1)$, we show that…

We derive a strengthened monotonicity inequality for quantum relative entropy by employing properties of $\alpha$-R\'{e}nyi relative entropy. We develop a unifying treatment towards the improvement of some quantum entropy inequalities. In…

Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…

The Renyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or…

By virtue of the generalized Hellmann-Feynman theorem for ensemble average, we obtain internal energy and average energy consumed by the resistance R in a quantized RLC electric circuit. We also calculate entropy-variation with respect to…

We prove the concavity of $p$-R\'enyi entropy power for positive solutions to the doubly nonlinear diffusion equations on $\mathbb{R}^n$ or compact Riemannian manifolds with nonnegative Ricci curvature. As applications, we give new proofs…

We investigate the R\'enyi entanglement entropies for the one-dimensional massless free boson compactified on a circle, which describes the low energy sector of several interacting many-body 1d systems (Luttinger Liquid). We focus on…

Phase-space versions of quantum mechanics -- from Wigner's original distribution to modern discrete-qudit constructions -- represent some states with negative quasi-probabilities. Conventional Shannon and R\'enyi entropies become…

Uncertainty relations are central to quantum physics. While they were originally formulated in terms of variances, they have later been successfully expressed with entropies following the advent of Shannon information theory. Here, we…

We find a sharp combinatorial bound for the metric entropy of sets in R^n and general classes of functions. This solves two basic combinatorial conjectures on the empirical processes. 1. A class of functions satisfies the uniform Central…

Renyi entropy associated with spin tomograms of quantum states is shown to obey to new inequalities containing the dependence on quantum Fourier transform. The limiting inequality for the von Neumann entropy of spin quantum states and a new…

We explore asymptotically optimal bounds for deviations of Bernoulli convolutions from the Poisson limit in terms of the Shannon relative entropy and the Pearson $\chi^2$-distance. The results are based on proper non-uniform estimates for…

The distribution of the sum of r-th power of standard normal random variables is a generalization of the chi-squared distribution. In this paper, we represent the probability density function of the random variable by an one-dimensional…

We prove anti-concentration results for polynomials of independent random variables with arbitrary degree. Our results extend the classical Littlewood-Offord result for linear polynomials, and improve several earlier estimates. We discuss…

We study multi-charged moments and symmetry-resolved R\'enyi entropy of free compact boson for multiple disjoint intervals. The R\'enyi entropy evaluation involves computing the partition function of the theory on Riemann surfaces with…