English
Related papers

Related papers: Tsallis entropy and generalized Shannon additivity

200 papers

The Tsallis entropy, which possesses non-extensive property, is derived from the first principle employing the non-extensive Hamiltonian or the $q$-deformed Hamiltonian with the canonical ensemble assumption in statistical mechanics. Here,…

Statistical Mechanics · Physics 2025-03-11 Paradon Krisut , Sikarin Yoo-Kong

A method of estimating the joint probability mass function of a pair of discrete random variables is described. This estimator is used to construct the conditional Shannon-R\'eyni-Tsallis entropies estimates. From there almost sure rates of…

Statistics Theory · Mathematics 2020-02-18 Ba Amadou Diadie , Lo Gane Samb

Shannon entropy for discrete distributions is a fundamental and widely used concept, but its continuous analogue, known as differential entropy, lacks essential properties such as positivity and compatibility with the discrete case. In this…

Probability · Mathematics 2025-08-07 Yuliya Mishura , Kostiantyn Ralchenko

The formalism of statistical mechanics can be generalized by starting from more general measures of information than the Shannon entropy and maximizing those subject to suitable constraints. We discuss some of the most important examples of…

Statistical Mechanics · Physics 2015-05-13 Christian Beck

We study minimization of a parametric family of relative entropies, termed relative $\alpha$-entropies (denoted $\mathscr{I}_{\alpha}(P,Q)$). These arise as redundancies under mismatched compression when cumulants of compressed lengths are…

Information Theory · Computer Science 2014-10-21 M. Ashok Kumar , Rajesh Sundaresan

We prove characterization theorems for relative entropy (also known as Kullback-Leibler divergence), q-logarithmic entropy (also known as Tsallis entropy), and q-logarithmic relative entropy. All three have been characterized axiomatically…

Information Theory · Computer Science 2017-12-14 Tom Leinster

This article is a continuation of my paper [arxiv: 1409.1015v2]. R\'enyi and Tsallis entropies are associated to positive linear operators and properties of some functions related to these entropies are investigated.

Classical Analysis and ODEs · Mathematics 2014-12-17 Ioan Raşa

A definition of the nonadditive (nonextensive) conditional entropy indexed by q is presented. Based on the composition law in terms of it, the Shannon-Khinchin axioms are generalized and the uniqueness theorem is established for the Tsallis…

Quantum Physics · Physics 2007-05-23 Sumiyoshi Abe , A. K. Rajagopal

Uncertainty relations emerging from the Tsallis entropy are derived and discussed. In particular we found a positively defined function that saturates the so called entropic inequalities for entropies characterizing the physical states…

Quantum Physics · Physics 2013-05-29 Grzegorz Wilk , Zbigniew Wlodarczyk

Estimating entropies from limited data series is known to be a non-trivial task. Naive estimations are plagued with both systematic (bias) and statistical errors. Here, we present a new 'balanced estimator' for entropy functionals Shannon,…

Statistical Mechanics · Physics 2008-04-30 Juan A. Bonachela , Haye Hinrichsen , Miguel A. Munoz

Extensions of Fannes' inequality with partial sums of the Tsallis entropy are obtained for both the classical and quantum cases. The definition of kth partial sum under the prescribed order of terms is given. Basic properties of introduced…

Quantum Physics · Physics 2011-06-03 Alexey E. Rastegin

In this paper we derived a 6N dimensional non-homogeneous evolution equation of Tsallis non-equilibrium entropy; presented a formula for entropy production rate (i.e. the law of entropy increase) for Tsallis entropy only when its index q>0,…

Statistical Mechanics · Physics 2014-06-10 Xing Xiu-San

We discuss the entropic criterion for separability of compound quantum systems for general non-additive entropic forms based on arbitrary concave functions $f$. For any separable state, the generalized entropy of the whole system is shown…

Quantum Physics · Physics 2015-05-20 R. Rossignoli , N. Canosa

Tsallis entropy is a generalized diversity index first derived in Patil and Taillie (1982) and then rediscovered in community ecology by Keylock (2005). Bayesian nonparametric estimation of Shannon entropy and Simpson's diversity under…

Statistics Theory · Mathematics 2014-11-26 Annalisa Cerquetti

Based on the Tsallis entropy, the nonextensive thermodynamic properties are studied as a q-deformation of classical statistical results using only probabilistic methods and straightforward calculations. It is shown that the constant in the…

Statistical Mechanics · Physics 2007-05-23 Franck Jedrzejewski

We present our view in a standing debate about the definition and meaning of power-law entropies for continuous systems. Our suggestion is that such arguments should take into account the generalized operations of addition and…

Statistical Mechanics · Physics 2018-10-17 Anthony J. Creaco , Nikolaos Kalogeropoulos

The maximum entropy principle is often used for bi-level or multi-level thresholding of images. For this purpose, some methods are available based on Shannon and Tsallis entropies. In this paper, we discuss them and propose a method based…

Computer Vision and Pattern Recognition · Computer Science 2015-08-06 Amelia Carolina Sparavigna

We give the tight bounds of Tsallis relative operator entropy by using Hermite-Hadamard's inequality. Some reverse inequalities related to Young inequalities are also given. In addition, operator inequalities for normalized positive linear…

Functional Analysis · Mathematics 2017-05-08 Hamid Reza Moradi , Shigeru Furuichi , Nicuşor Minculete

We provide generalized entanglement constraints in multi-qubit systems in terms of Tsallis entropy. Using quantum Tsallis entropy of order $q$, we first provide a generalized monogamy inequality of multi-qubit entanglement for $q=2$ or $3$.…

Quantum Physics · Physics 2016-12-15 Jeong San Kim

We generalize the usual exponential Boltzmann factor to any reasonable and potentially observable distribution function, $B(E)$. By defining generalized logarithms $\Lambda$ as inverses of these distribution functions, we are led to a…

Statistical Mechanics · Physics 2007-05-23 Rudolf Hanel , Stefan Thurner