相关论文: Generalized statistics: yet another generalization
In a paper [8] the authors classify entropy into three categories, as a thermodynamics quantity, as a measure of information production, and as a means of statistical inference. An entropy measure introduced by Mathai falls into the second…
We show how generalized Gibbs-Shannon entropies can provide new insights on the statistical properties of texts. The universal distribution of word frequencies (Zipf's law) implies that the generalized entropies, computed at the word level,…
We address an information-theoretic approach to noise and disturbance in quantum measurements. Properties of corresponding probability distributions are characterized by means of both the R\'{e}nyi and Tsallis entropies. Related…
Pinsker's and Fannes' type bounds on the Tsallis relative entropy are derived. The monotonicity property of the quantum $f$-divergence is used for its estimating from below. For order $\alpha\in(0,1)$, a family of lower bounds of Pinsker…
We discuss a basic thermodynamic properties of systems with multifractal structure. This is possible by extending the notion of Gibbs-Shannon's entropy into more general framework - Renyi's information entropy. We show a connection of…
In this paper a new operational definition of Renyi entropy and Renyi divergence is presented. Other operational definitions are mentioned.
Existing polarization theories have mostly been concerned with Shannon's information measures, such as Shannon entropy and mutual information, and some related measures such as the Bhattacharyya parameter. In this work, we extend…
The requirement that an entropy function be composable is key: it means that the entropy of a compound system can be calculated in terms of the entropy of its independent components. We prove that, under mild regularity assumptions, the…
We describe in detail two numerical simulation methods valid to study systems whose thermostatistics is described by generalized entropies, such as Tsallis. The methods are useful for applications to non-trivial interacting systems with a…
We construct the generalized entropy optimized by a given arbitrary statistical distribution with a finite linear expectation value of a random quantity of interest. This offers, via the maximum entropy principle, a unified basis for a…
The paper extends the analysis of the entropies of the Poisson distribution with parameter $\lambda$. It demonstrates that the Tsallis and Sharma-Mittal entropies exhibit monotonic behavior with respect to $\lambda$, whereas two generalized…
The quantum relative Renyi entropy of two density matrices was recently extended when the two do not commute, from which a conditional entropy is identified. This is here extended to the corresponding Tsallis relative entropy and to its…
Recently, information theoretic analysis has become a popular framework for understanding the generalization behavior of deep neural networks. It allows a direct analysis for stochastic gradient/Langevin descent (SGD/SGLD) learning…
In the nonextensive Tsallis scenario, Page's conjecture for the average entropy of a subsystem[Phys. Rev. Lett. {\bf 71}, 1291(1993)] as well as its demonstration are generalized, i.e., when a pure quantum system, whose Hilbert space…
The aim of the present paper is to present a careful and accessible discussion of the formal aspects of Boltzmann-Gibbs and Tsallis entropies. We begin with a brief overview of Boltzmann-Gibbs entropy, highlighting its main properties and…
We consider the concept of generalized measure-theoretic entropy, where instead of the Shannon entropy function we consider an arbitrary concave function defined on the unit interval, vanishing in the origin. Under mild assumptions on this…
This article is a continuation of my paper [arxiv: 1409.1015v2]. R\'enyi and Tsallis entropies are associated to positive linear operators and properties of some functions related to these entropies are investigated.
The entropy of probability distribution defined by Shannon has several extensions. R\'enyi entropy is one of the general extensions of Shannon entropy and is widely used in engineering, physics, and so on. On the other hand, the quantum…
The uniqueness theorem for Tsallis entropy was presented in {\it H.Suyari, IEEE Trans. Inform. Theory, Vol.50, pp.1783-1787 (2004)} by introducing the generalized Shannon-Khinchin's axiom. In the present paper, this result is generalized…
Uncertainty relations emerging from the Tsallis entropy are derived and discussed. In particular we found a positively defined function that saturates the so called entropic inequalities for entropies characterizing the physical states…