English
Related papers

Related papers: The case for shifting the Renyi Entropy

200 papers

The Shannon entropy of a random variable has much behaviour analogous to a signed measure. Previous work has explored this connection by defining a signed measure on abstract sets, which are taken to represent the information that different…

Information Theory · Computer Science 2025-05-28 Keenan J. A. Down , Pedro A. M. Mediano

The definition of weighted entropy allows for easy calculation of the entropy of the mixture of measures. In this paper we investigate the problem of equivalent definition of the general entropy function in weighted form. We show that under…

Information Theory · Computer Science 2013-05-15 Marek Śmieja

Building on work of Kontsevich, we introduce a definition of the entropy of a finite probability distribution in which the "probabilities" are integers modulo a prime p. The entropy, too, is an integer mod p. Entropy mod p is shown to be…

Number Theory · Mathematics 2020-12-03 Tom Leinster

By generalizing the density matrix to a transition matrix between two states, represented as $|\phi\rangle$ and $|\psi\rangle$, one can define the pseudoentropy analogous to the entanglement entropy. In this paper, we establish an operator…

High Energy Physics - Theory · Physics 2024-05-15 Wu-zhong Guo , Jiaju Zhang

Quantum key distribution requires tight and reliable bounds on the secret key rate to ensure robust security. This is particularly so for the regime of finite block sizes, where the optimization of generalized R\'enyi entropic quantities is…

Quantum Physics · Physics 2026-04-09 Rebecca R. B. Chung , Nelly H. Y. Ng , Yu Cai

In this paper, we examine the Renyi entropy rate of stationary ergodic processes. For a special class of stationary ergodic processes, we prove that the Renyi entropy rate always exists and can be polynomially approximated by its defining…

Information Theory · Computer Science 2022-07-18 Chengyu Wu , Yonglong Li , Li Xu , Guangyue Han

We present a general method for calculating R\'enyi entropies in the ground state of a one-dimensional critical system with mixed open boundaries, for an interval starting at one of its ends. In the conformal field theory framework, this…

Statistical Mechanics · Physics 2025-11-12 Benoit Estienne , Yacine Ikhlef , Andrei Rotaru

We investigate the large-time asymptotics of nonlinear diffusion equations $u_t = \Delta u^p$ in dimension $n \ge 1$, in the exponent interval $p > n/(n+2)$, when the initial datum $u_0$ is of bounded second moment. Precise rates of…

Analysis of PDEs · Mathematics 2015-06-19 J. A. Carrillo , G. Toscani

Since its origin in the thermodynamics of the 19th century, the concept of entropy has also permeated other fields of physics and mathematics, such as Classical and Quantum Statistical Mechanics, Information Theory, Probability Theory,…

Machine Learning · Statistics 2025-03-06 Salomé A. Sepúveda Fontaine , José M. Amigó

This article is a continuation of my paper [arxiv: 1409.1015v2]. R\'enyi and Tsallis entropies are associated to positive linear operators and properties of some functions related to these entropies are investigated.

Classical Analysis and ODEs · Mathematics 2014-12-17 Ioan Raşa

Estimating statistical properties is fundamental in statistics and computer science. In this paper, we propose a unified quantum algorithm framework for estimating properties of discrete probability distributions, with estimating R\'enyi…

Quantum Physics · Physics 2024-04-04 Xinzhao Wang , Shengyu Zhang , Tongyang Li

Using a Corner Transfer Matrix approach, we compute the bipartite entanglement R\'enyi entropy in the off-critical perturbations of non-unitary conformal minimal models realised by lattice spin chains Hamiltonians related to the Forrester…

High Energy Physics - Theory · Physics 2016-07-18 Davide Bianchini , Francesco Ravanini

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

Majorization is a stochastic ordering relation that compares the relative diversity of probability distributions with numerous applications in econometrics, spectral theory, and ecology. It is well-known that the majorization partial order…

Information Theory · Computer Science 2026-05-25 Anuj Kumar Yadav , Yanina Y. Shkel

The R\'enyi entanglement entropy (REE) is an entanglement quantifier considered as a natural generalisation of the entanglement entropy. When it comes to stochastic local operations and classical communication (SLOCC), however, only a…

Quantum Physics · Physics 2020-09-03 Hyukjoon Kwon , A. J. Paige , M. S. Kim

In this work, we analyze alternative effective sample size (ESS) metrics for importance sampling algorithms, and discuss a possible extended range of applications. We show the relationship between the ESS expressions used in the literature…

Statistics Theory · Mathematics 2026-02-27 L. Martino , V. Elvira

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

Information Theory · Computer Science 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

Entanglement criteria for an $n$-partite quantum system with continuous variables are formulated in terms of R\'{e}nyi entropies. R\'{e}nyi entropies are widely used as a good information measure due to many nice properties. Derived…

Quantum Physics · Physics 2017-05-22 Alexey E. Rastegin

We study systematically resource measures of coherence and entanglement based on R\'enyi relative entropies, which include the logarithmic robustness of coherence, geometric coherence, and conventional relative entropy of coherence together…

Quantum Physics · Physics 2017-11-29 Huangjun Zhu , Masahito Hayashi , Lin Chen