English
Related papers

Related papers: R\'enyi entropy and variance comparison for symmet…

200 papers

Let $\{X_{\alpha}\}$ be a family of random variables following a certain type of distributions with finite expectation $\mathbf{E}[X_{\alpha}]$ and finite variance ${\rm Var}(X_{\alpha})$, where $\alpha$ is a parameter. Motivated by the…

Probability · Mathematics 2024-04-04 Ze-Chun Hu , Renming Song , Yuan Tan

This work investigates binary hypothesis testing between $H_0\sim P_0$ and $H_1\sim P_1$ in the finite-sample regime under asymmetric error constraints. By employing the ``reverse" R\'enyi divergence, we derive novel non-asymptotic bounds…

Information Theory · Computer Science 2026-01-21 Roberto Bruno , Adrien Vandenbroucque , Amedeo Roberto Esposito

We establish a lower bound on the entropy of weighted sums of (possibly dependent) random variables $(X_1, X_2, \dots, X_n)$ possessing a symmetric joint distribution. Our lower bound is in terms of the joint entropy of $(X_1, X_2, \dots,…

Information Theory · Computer Science 2018-01-16 Jing Hao , Varun Jog

The redundancy for universal lossless compression of discrete memoryless sources in Campbell's setting is characterized as a minimax R\'enyi divergence, which is shown to be equal to the maximal $\alpha$-mutual information via a generalized…

Information Theory · Computer Science 2019-03-12 Semih Yagli , Yücel Altuğ , Sergio Verdú

Two typical fixed-length random number generation problems in information theory are considered for general sources. One is the source resolvability problem and the other is the intrinsic randomness problem. In each of these problems, the…

Information Theory · Computer Science 2024-05-14 Ryo Nomura , Hideki Yagi

On the triangular and kagome lattices, short-ranged resonating valence bond (RVB) wave functions can be sampled without the sign problem using a recently-developed Pfaffian Monte Carlo scheme. In this paper, we study the Renyi entanglement…

Strongly Correlated Electrons · Physics 2017-03-15 Julia Wildeboer , Alexander Seidel , Roger G. Melko

We introduce R\'enyi entropy of a subsystem energy as a natural quantity which closely mimics the behavior of the entanglement entropy and can be defined for all the quantum many body systems. For this purpose, consider a quantum chain in…

Strongly Correlated Electrons · Physics 2019-11-13 Khadijeh Najafi , M. A. Rajabpour

In this paper, we calculate the R\'enyi entropy of one single interval on a circle at finite temperature in 2D CFT. In the low temperature limit, we expand the thermal density matrix level by level in the vacuum Verma module, and calculate…

High Energy Physics - Theory · Physics 2015-06-19 Bin Chen , Jie-qiang Wu

For $\alpha,z>0$ with $\alpha\ne1$, motivated by comparison between different kinds of R\'enyi divergences in quantum information, we consider log-majorization between the matrix functions \begin{align*}…

Functional Analysis · Mathematics 2018-08-14 Fumio Hiai

It has been shown that the $\alpha-z$ R{\'e}nyi relative entropy satisfies the Data Processing Inequality (DPI) for a certain range of $\alpha$'s and $z$'s. Moreover, the range is completely characterized by Zhang in `20. We prove necessary…

Mathematical Physics · Physics 2020-10-28 Sarah Chehade

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

We explore an asymptotic behavior of R\'enyi entropy along convolutions in the central limit theorem with respect to the increasing number of i.i.d. summands. In particular, the problem of monotonicity is addressed under suitable moment…

Probability · Mathematics 2018-03-01 Sergey G. Bobkov , Arnaud Marsiglietti

We show a general phenomenon of the constrained functional value for densities satisfying general convexity conditions, which generalizes the observation in Bobkov and Madiman (2011) that the entropy per coordinate in a log-concave random…

Information Theory · Computer Science 2020-10-27 Yanjun Han

We study the {\em robust proper learning} of univariate log-concave distributions (over continuous and discrete domains). Given a set of samples drawn from an unknown target distribution, we want to compute a log-concave hypothesis…

Data Structures and Algorithms · Computer Science 2016-06-10 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We show that the R\'enyi entropies of single particle, extended wave functions for disordered systems contain information about the multifractal spectrum. It is shown for moments of the R\'enyi entropy, $S_{n}$, where $|n|<1$, it is…

Mesoscale and Nanoscale Physics · Physics 2013-02-04 Xiao Chen , Benjamin Hsu , Taylor L. Hughes , Eduardo Fradkin

The entropy of probability distribution defined by Shannon has several extensions. R\'enyi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum…

Mathematical Physics · Physics 2019-09-04 Farrukh Mukhamedov , Kyouhei Ohmura , Noboru Watanabe

R\'enyi entanglement entropy provides a new window to study the AdS/CFT correspondence. In this paper we consider the short interval expansion of R\'enyi entanglement entropy in two-dimensional conformal field theory. This amounts to do the…

High Energy Physics - Theory · Physics 2013-12-19 Bin Chen , Jia-ju Zhang

Compressed Counting (CC)} was recently proposed for approximating the $\alpha$th frequency moments of data streams, for $0<\alpha \leq 2$. Under the relaxed strict-Turnstile model, CC dramatically improves the standard algorithm based on…

Data Structures and Algorithms · Computer Science 2008-08-21 Ping Li

We prove a new logarithmic epiperimetric inequality for multiplicity-one stationary cones with isolated singularity by flowing in the radial direction any given trace along appropriately chosen directions. In contrast to previous…

Analysis of PDEs · Mathematics 2019-03-13 Max Engelstein , Luca Spolaor , Bozhidar Velichkov

Based on the problem of quantum data compression in a lossless way, we present here an operational interpretation for the family of quantum R\'enyi entropies. In order to do this, we appeal to a very general quantum encoding scheme that…

Quantum Physics · Physics 2017-10-05 G. Bellomo , G. M. Bosyk , F. Holik , S. Zozor