English
Related papers

Related papers: Sharp Bounds on Arimoto's Conditional R\'{e}nyi En…

200 papers

We introduce a variant of the R\'enyi entropy definition that aligns it with the well-known H\"older mean: in the new formulation, the r-th order R\'enyi Entropy is the logarithm of the inverse of the r-th order H\"older mean. This brings…

Information Theory · Computer Science 2018-11-16 Francisco José Valverde-Albacete , Carmen Peláez-Moreno

Since their introduction in the early sixties, the R\'enyi entropies have been used in many contexts, ranging from information theory to astrophysics, turbulence phenomena and others. In this note, we enlighten the main connections between…

Mathematical Physics · Physics 2014-01-20 Giuseppe Toscani

This paper proposes an $\alpha$-leakage measure for $\alpha\in[0,\infty)$ by a cross entropy interpretation of R{\'{e}}nyi entropy. While R\'{e}nyi entropy was originally defined as an $f$-mean for $f(t) = \exp((1-\alpha)t)$, we reveal that…

Information Theory · Computer Science 2024-01-30 Ni Ding , Mohammad Amin Zarrabian , Parastoo Sadeghi

Rare events play a key role in many applications and numerous algorithms have been proposed for estimating the probability of a rare event. However, relatively little is known on how to quantify the sensitivity of the probability with…

Probability · Mathematics 2019-02-06 Paul Dupuis , Markos A. Katsoulakis , Yannis Pantazis , Luc Rey-Bellet

We express the joint R\'enyi entropy of progressively censored order statistics in terms of an incomplete integral of the hazard function, and provide a simple estimate of the joint R\'enyi entropy of progressively Type-II censored data.…

Methodology · Statistics 2013-03-25 Akram Kohansal , Saeid Rezakhah

The asymptotic restriction problem for tensors can be reduced to finding all parameters that are normalized, monotone under restrictions, additive under direct sums and multiplicative under tensor products, the simplest of which are the…

Mathematical Physics · Physics 2023-02-13 Dávid Bugár , Péter Vrana

We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…

Information Theory · Computer Science 2008-12-18 Jean-François Bercher

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

It is known that the variance and entropy of quantum observables decompose into intrinsically quantum and classical contributions. Here a general method of constructing quantum-classical decompositions of resources such as uncertainty is…

Quantum Physics · Physics 2023-07-07 Michael J. W. Hall

The equivalence between non-extensive C. Tsallis entropy and the extensive entropy introduced by Alfr\'ed R\'enyi is discussed. The R\'enyi entropy is studied from the perspective of the geometry of the Lebesgue and generalised, exotic…

Data Analysis, Statistics and Probability · Physics 2014-02-25 Giorgio Sonnino , György Steinbrecher , Alberto Sonnino

R\'enyi divergence is related to R\'enyi entropy much like Kullback-Leibler divergence is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as a measure of information that satisfies almost the same…

Information Theory · Computer Science 2014-04-25 Tim van Erven , Peter Harremoës

The entropy accumulation theorem, and its subsequent generalized version, is a powerful tool in the security analysis of many device-dependent and device-independent cryptography protocols. However, it has the drawback that the finite-size…

Quantum Physics · Physics 2025-12-22 Amir Arqand , Thomas A. Hahn , Ernest Y. -Z. Tan

This paper introduces "swiveled Renyi entropies" as an alternative to the Renyi entropic quantities put forward in [Berta et al., Phys. Rev. A 91, 022333 (2015)]. What distinguishes the swiveled Renyi entropies from the prior proposal of…

Quantum Physics · Physics 2016-03-22 Frédéric Dupuis , Mark M. Wilde

We study the distribution of the order of a random permutation of $[n]$ through the lens of R\'enyi entropy. In particular, we obtain an asymptotic for the R\'enyi $q$-entropy of the order in the full range $1 \leq q \leq \infty$. For $q >…

Combinatorics · Mathematics 2026-05-15 Adrian Beker

Numerous entropy-type characteristics (functionals) generalizing R\'enyi entropy are widely used in mathematical statistics, physics, information theory, and signal processing for characterizing uncertainty in probability distributions and…

Statistics Theory · Mathematics 2011-03-28 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

The exact range of the joined values of several R\'{e}nyi entropies is determined. The method is based on topology with special emphasis on the orientation of the objects studied. Like in the case when only two orders of R\'{e}nyi entropies…

Information Theory · Computer Science 2009-04-17 Peter Harremoës

Entanglement criteria for an $n$-partite quantum system with continuous variables are formulated in terms of R\'{e}nyi entropies. R\'{e}nyi entropies are widely used as a good information measure due to many nice properties. Derived…

Quantum Physics · Physics 2017-05-22 Alexey E. Rastegin

Rare events, and more general risk-sensitive quantities-of-interest (QoIs), are significantly impacted by uncertainty in the tail behavior of a distribution. Uncertainty in the tail can take many different forms, each of which leads to a…

Probability · Mathematics 2019-11-22 Jeremiah Birrell , Paul Dupuis , Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

Quantum processes can exhibit scenarios beyond a fixed order of events. We propose information inequalities that, when violated, constitute sufficient conditions to certify quantum processes without a fixed causal order -- causally…

Quantum Physics · Physics 2025-05-21 Matheus Capela , Kaumudibikash Goswami