English
Related papers

Related papers: A step beyond Tsallis and Renyi entropies

200 papers

In this research paper, it is proved that an approximation to Gibbs-Shannon entropy measure naturally leads to Tsallis entropy for the real parameter q =2 . Several interesting measures based on the input as well as output of a discrete…

Information Theory · Computer Science 2012-01-06 Garimella Rama Murthy

The notion of entropy penetrates much of science. A key feature of the all-important notion of Boltzmann-Gibbs-Shannon entropy is its extensivity (additivity over independent subsystems). However, there is a need for other quantities. In…

Mathematical Physics · Physics 2008-07-29 Flemming Topsoe

The asymptotic correspondence between the probability mass function of the $q$-deformed multinomial distribution and the $q$-generalised Kullback-Leibler divergence, also known as Tsallis relative entropy, is established. The probability…

Statistical Mechanics · Physics 2025-03-10 Keisuke Okamura

We combine an axiomatics of R\'{e}nyi with the $q$--deformed version of Khinchin axioms to obtain a measure of information (i.e., entropy) which accounts both for systems with embedded self-similarity and non-extensivity. We show that the…

Mathematical Physics · Physics 2015-11-11 Petr Jizba , Jan Korbel

The definition of weighted entropy allows for easy calculation of the entropy of the mixture of measures. In this paper we investigate the problem of equivalent definition of the general entropy function in weighted form. We show that under…

Information Theory · Computer Science 2013-05-15 Marek Śmieja

The equilibrium distributions of probabilities providing maximality of Renyi and Tsallis entropies are rederived. New S-forms of them are found which are normalised with corresponding entropies in contrast to the usual Z-forms normalised…

Statistical Mechanics · Physics 2007-05-23 A. G. Bashkirov

The Renyi entropies constitute a family of information measures that generalizes the well-known Shannon entropy, inheriting many of its properties. They appear in the form of unconditional and conditional entropies, relative entropies or…

Quantum Physics · Physics 2014-01-28 Martin Müller-Lennert , Frédéric Dupuis , Oleg Szehr , Serge Fehr , Marco Tomamichel

Tsallis has proposed a generalisation of the standard entropy, which has since been applied to a variety of physical systems. In the canonical ensemble approach that is mostly used, average energy is given by an unnromalised, or normalised,…

Statistical Mechanics · Physics 2009-10-31 S. Kalyana Rama

When at equilibrium, large-scale systems obey conventional thermodynamics because they belong to microscopic configurations (or states) that are typical. Crucially, the typical states usually represent only a small fraction of the total…

Statistical Mechanics · Physics 2025-01-14 Bernat Corominas-Murtra , Rudolf Hanel , Petr Jizba

In this note we introduce a new family of entropy powers which are related to generalized entropies, called Sharma-Mittal entropies, and we prove their concavity along diffusion processes generated by $L^2$-Wasserstein gradient flows of…

Information Theory · Computer Science 2022-02-28 Mario Bukal

In this paper, we investigate new procedures for statistical testing based on Tsallis entropy, a parametric generalization of Shannon entropy. Focusing on multivariate generalized Gaussian and $q$-Gaussian distributions, we develop…

Methodology · Statistics 2025-06-18 Mehmet Sıddık Çadırcı

We propose a generalized entropy maximization procedure, which takes into account the generalized averaging procedures and information gain definitions underlying the generalized entropies. This novel generalized procedure is then applied…

Statistical Mechanics · Physics 2015-05-13 G. Baris Bagci , Ugur Tirnakli

A two parameter generalization of Boltzmann-Gibbs-Shannon entropy based on natural logarithm is introduced. The generalization of the Shannon-Kinchinn axioms corresponding to the two parameter entropy is proposed and verified. We present…

Statistical Mechanics · Physics 2013-03-08 R. Chandrashekar , C. Ravikumar , J. Segar

We discuss the generalized von Neumann (Tsallis) entropy and the generalized Fisher information (GFI) in nonextensive quantum systems, by using the interpolation approximation (IA) which has been shown to yield good results for the quantal…

Statistical Mechanics · Physics 2009-09-22 Hideo Hasegawa

Gauss' law of error is generalized in Tsallis statistics such as multifractal systems, in which Tsallis entropy plays an essential role instead of Shannon entropy. For the generalization, we apply the new multiplication operation determined…

Statistical Mechanics · Physics 2007-05-23 Hiroki Suyari , Makoto Tsukada

We discuss the idea that the Tsallis-type (q-additive) entropic chain rule allows for a wider class of entropic functionals than previously thought. In particular, we point out that the ensuing entropy solutions (e.g., Tsallis entropy) can…

Mathematical Physics · Physics 2017-11-15 Petr Jizba , Jan Korbel

We have discussed the Tsallis entropy in finite $N$-unit nonextensive systems, by using the multivariate $q$-Gaussian probability distribution functions (PDFs) derived by the maximum entropy methods with the normal average and the…

Statistical Mechanics · Physics 2015-05-14 Hideo Hasegawa

Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend…

Information Theory · Computer Science 2019-07-16 Mengfan Zheng , Ling Liu , Cong Ling

We show that if one uses the invariant form of the Boltzmann-Shannon continuous entropy, it is possible to obtain the generalized Pareto-Tsallis density function, using an appropriate "prior" measure m_{q}(x) and a "Boltzman constraint"…

Statistical Mechanics · Physics 2007-05-23 F. Brouers , O. Sotolongo

We demonstrate and discuss the process of gaining information and show an example in which some specific way of gaining information about an object results in the Tsallis form of entropy rather than in the Shannon one.

Statistical Mechanics · Physics 2009-11-13 Grzegorz Wilk , Zbigniew Wlodarczyk