English
Related papers

Related papers: An overview of generalized entropic forms

200 papers

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

Information Theory · Computer Science 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

For certain groups, parabolic subgroups appear as stabilizers of flags of sets or vector spaces. Quotients by these parabolic subgroups represent orbits of flags, and their cardinalities asymptotically reveal entropies (as rates of…

Information Theory · Computer Science 2025-12-03 Ryan Leal , Jingtong Sun , Juan Pablo Vigneaux

A two-parameter family of complexity measures $\tilde{C}^{(\alpha,\beta)}$ based on the R\'enyi entropies is introduced and characterized by a detailed study of its mathematical properties. This family is the generalization of a continuous…

Quantum Physics · Physics 2015-05-13 R. Lopez-Ruiz , A. Nagy , E. Romera , J. Sanudo

Entropy has emerged as a dynamic, interdisciplinary, and widely accepted quantitative measure of uncertainty across different disciplines. A unified understanding of entropy measures, supported by a detailed review of their theoretical…

Probability · Mathematics 2025-03-21 Naveen Kumar , Ambesh Dixit , Vivek Vijay

We review a new form of entropy suggested by us, with origin in mixing of states of systems due to interactions and deformations of phase cells. It is demonstrated that this nonextensive form also leads to asymmetric maximal entropy…

Statistical Mechanics · Physics 2009-06-16 Fariel Shafee

The well-known Heisenberg--Robertson uncertainty relation for a pair of noncommuting observables, is expressed in terms of the product of variances and the commutator among the operators, computed for the quantum state of a system.…

Quantum Physics · Physics 2019-09-25 David Puertas Centeno , Mariela Portesi

The Sharma-Mittal entropies generalize the celebrated Shannon, R\'enyi and Tsallis entropies. We report a closed-form formula for the Sharma-Mittal entropies and relative entropies for arbitrary exponential family distributions. We…

Information Theory · Computer Science 2021-04-29 Frank Nielsen , Richard Nock

We propose a new interpretation of measures of information and disorder by connecting these concepts to group theory in a new way. Entropy and group theory are connected here by their common relation to sets of permutations. A combinatorial…

Information Theory · Computer Science 2019-11-25 David J. Galas

Tsallis and R\'{e}nyi entropy measures are two possible different generalizations of the Boltzmann-Gibbs entropy (or Shannon's information) but are not generalizations of each others. It is however the Sharma-Mittal measure, which was…

Statistical Mechanics · Physics 2014-10-13 Marco Masi

In this work, we study generalized entropies and information geometry in a group-theoretical framework. We explore the conditions that ensure the existence of some natural properties and at the same time of a group-theoretical structure for…

Mathematical Physics · Physics 2021-08-03 Miguel A. Rodríguez , Álvaro Romaniega , Piergiulio Tempesta

We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…

Information Theory · Computer Science 2024-11-26 Iryna Bodnarchuk , Yuliya Mishura , Kostiantyn Ralchenko

As an application of generalised statistical mechanics, it is studied a possible route toward a consistent generalised information theory in terms of a family of non-extensive, non-parametric entropies $H^\pm_D(P)$. Unlike other proposals…

Information Theory · Computer Science 2021-03-23 Jesús Fuentes , Octavio Obregón

We consider Shannon entropy, Fisher information, R\'enyi entropy, and Tsallis entropy to study the quantum droplet phase in Bose-Einstein condensates. In the beyond mean-field description, the Gross-Pitaevskii equation with Lee-Huang-Yang…

Quantum Gases · Physics 2024-10-04 Sk Siddik , Golam Ali Sekh

We propose a unifying picture where the notion of generalized entropy is related to information theory by means of a group-theoretical approach. The group structure comes from the requirement that an entropy be well defined with respect to…

Statistical Mechanics · Physics 2016-04-13 Gabriele Sicuro , Piergiulio Tempesta

We define the class of multivariate group entropies as a novel set of information - theoretical measures, which extends significantly the family of group entropies. We propose new examples related to the "super-exponential" universality…

Mathematical Physics · Physics 2020-12-03 Piergiulio Tempesta

The Shannon entropy, the desequilibrium and their generalizations (R\'enyi and Tsallis entropies) of the three-dimensional single-particle systems in a spherically-symmetric potential $V(r)$ can be decomposed into angular and radial parts.…

Quantum Physics · Physics 2017-01-17 J. S. Dehesa , I. V. Toranzo , D. Puertas-Centeno

There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the…

Information Theory · Computer Science 2017-08-22 John C. Baez , Tobias Fritz , Tom Leinster

We consider two (natural) families of observables $O_k$ for systems with dimension $d=3,4,5$: the spin observables $S_x$, $S_y$ and $S_z$, and the observables that have mutually unbiased bases as eigenstates. We derive tight entropic…

Quantum Physics · Physics 2017-03-15 Alberto Riccardi , Chiara Macchiavello , Lorenzo Maccone

The Shannon based conditional entropy that underlies five-dimensional Einstein-Hilbert gravity coupled to a dilaton field is investigated in the context of dynamical holographic AdS/QCD models. Considering the UV and IR dominance limits of…

High Energy Physics - Theory · Physics 2016-09-22 Alex E. Bernardini , Roldao da Rocha

Recently, in [P. Jizba and J. Korbel, Physica A 444, 2016, 808-827], four generalized Shannon-Khinchin [GSK] axioms have been proposed and a generalized entropy which uniquely satisfies the GSK axioms has been derived. In this comment, we…

Mathematical Physics · Physics 2016-09-05 Velimir M. Ilic , Miomir S. Stankovic