English
Related papers

Related papers: Geometry of R\'enyi Entropy on the Majorization La…

200 papers

We prove that Sharma-Mittal entropy is a subadditive and supermodular function on the lattice of all $n$-dimensional probability distributions, ordered according to the partial order relation defined by majorization among vectors. Our…

Information Theory · Computer Science 2026-05-28 Roberto Bruno , Ugo Vaccaro

We establish two structural majorization relations, which we call precursors, underlying the properties of supermodularity and subadditivity on the lattice induced by majorization. These are precursors in that they immediately imply that…

Information Theory · Computer Science 2026-05-29 Alexander Stévins , Michael G. Jabbour , Serge Deside , Nicolas J. Cerf

In this paper, we investigate the complete monotonicity of R\'enyi entropy along the heat flow. We confirm this property for the order of derivative up to $4$, when the order of R\'enyi entropy is in certain regimes. We also investigate…

Information Theory · Computer Science 2025-11-04 Hao Wu , Lei Yu , Laigang Guo

Entropy and relative or cross entropy measures are two very fundamental concepts in information theory and are also widely used for statistical inference across disciplines. The related optimization problems, in particular the maximization…

Statistics Theory · Mathematics 2021-06-18 Abhik Ghosh , Ayanendranath Basu

We study analytically the corrections to the leading terms in the Renyi entropy of a massive lattice theory, showing significant deviations from naive expectations. In particular, we show that finite size and finite mass effects give rise…

High Energy Physics - Theory · Physics 2012-05-31 Elisa Ercolessi , Stefano Evangelisti , Fabio Franchini , Francesco Ravanini

Distributions of abundances or frequencies play an important role in many fields of science, from biology to sociology, as does the R\'enyi entropy, which measures the diversity of a statistical ensemble. We derive a mathematical relation…

Populations and Evolution · Quantitative Biology 2016-12-26 Thierry Mora , Aleksandra M. Walczak

The R\'enyi entropy is a mathematical generalization of the concept of entropy and it encodes the total information of a system as a funtion of its order parameter $\alpha$. The meaning of the R\'enyi entropy in physics is not completely…

General Physics · Physics 2015-10-15 Nicolò Masi

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës

A comparative study of one-dimensional quantum structures which allow analytic expressions for the position and momentum R\'{e}nyi $R(\alpha)$ and Tsallis $T(\alpha)$ entropies, focuses on extracting the most characteristic physical…

Quantum Physics · Physics 2019-01-15 O. Olendski

A natural link between the notions of majorization and strongly Sperner posets is elucidated. It is then used to obtain a variety of consequences, including new R\'enyi entropy inequalities for sums of independent, integer-valued random…

Combinatorics · Mathematics 2020-02-07 Mokshay Madiman , Liyao Wang , Jae Oh Woo

This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…

Information Theory · Computer Science 2018-12-11 Igal Sason

Concepts of information theory are increasingly used to characterize collective phenomena in condensed matter systems, such as the use of entanglement entropies to identify emergent topological order in interacting quantum many-body…

Strongly Correlated Electrons · Physics 2015-09-28 Johannes Helmes , Jean-Marie Stéphan , Simon Trebst

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

The equivalence between non-extensive C. Tsallis entropy and the extensive entropy introduced by Alfr\'ed R\'enyi is discussed. The R\'enyi entropy is studied from the perspective of the geometry of the Lebesgue and generalised, exotic…

Data Analysis, Statistics and Probability · Physics 2014-02-25 Giorgio Sonnino , György Steinbrecher , Alberto Sonnino

We compute R\'enyi entropies for the statistics of a noisy simultaneous observation of two complementary observables in two-dimensional quantum systems. The relative amount of uncertainty between two states depends on the uncertainty…

Quantum Physics · Physics 2015-11-17 Alfredo Luis , Gustavo Martín Bosyk , Mariela Portesi

We improve the entropic uncertainty relations for position and momentum coarse-grained measurements. We derive the continuous, coarse-grained counterparts of the discrete uncertainty relations based on the concept of majorization. The…

Quantum Physics · Physics 2015-06-30 Łukasz Rudnicki

We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…

Adaptation and Self-Organizing Systems · Physics 2007-10-11 Fariel Shafee

Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend…

Information Theory · Computer Science 2019-07-16 Mengfan Zheng , Ling Liu , Cong Ling

R\'enyi entropies are conceptually valuable and experimentally relevant generalisations of the celebrated von Neumann entanglement entropy. After a quantum quench in a clean quantum many-body system they generically display a universal…

Statistical Mechanics · Physics 2022-08-04 Bruno Bertini , Katja Klobas , Vincenzo Alba , Gianluca Lagnese , Pasquale Calabrese

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag
‹ Prev 1 2 3 10 Next ›