Related papers: Generalized statistics: yet another generalization
In recent years, learning for neural networks can be viewed as optimization in the space of probability measures. To obtain the exponential convergence to the optimizer, the regularizing term based on Shannon entropy plays an important…
Within the Tsallis thermodynamics' framework, and using scaling properties of the entropy, we derive a generalization of the Gibbs-Duhem equation. The analysis suggests a transformation of variables that allows standard thermodynamics to be…
An analysis of the thermodynamic behavior of quantum systems can be performed from a geometrical perspective investigating the structure of the state space. We have developed such an analysis for nonextensive thermostatistical frameworks,…
We show that the stochastic interpretation of Tsallis' thermostatistics given recently by Beck [Phys. Rev. Lett {\bf 87}, 180601 (2001)] leads naturally to a multi-parameter generalization. The resulting class of distributions is able to…
Tsallis' non-extensive entropy is extended to incorporate the dependence on affinities between the microstates of a system. At the core of our construction of the extended entropy ($\mathcal{H}$) is the concept of the effective number of…
We introduce a new generalization of relative entropy to non-negative vectors with sums $\gt 1$. We show in a purely combinatorial setting, with no probabilistic considerations, that in the presence of linear constraints defining a convex…
Entropy is a fundamental concept in equilibrium statistical mechanics, yet its origin in the non-equilibrium dynamics of isolated quantum systems is not fully understood. A strong consensus is emerging around the idea that the stationary…
We present simple and computationally efficient nonparametric estimators of R\'enyi entropy and mutual information based on an i.i.d. sample drawn from an unknown, absolutely continuous distribution over $\R^d$. The estimators are…
More and more works deal with statistical systems far from equilibrium, dominated by unidirectional stochastic processes augmented by rare resets. We analyze the construction of the entropic distance measure appropriate for such dynamics.…
We discuss the generalized von Neumann (Tsallis) entropy and the generalized Fisher information (GFI) in nonextensive quantum systems, by using the interpolation approximation (IA) which has been shown to yield good results for the quantal…
In this short paper, we establish a variational expression of the Tsallis relative entropy. In addition, we derive a generalized thermodynamic inequality and a generalized Peierls-Bogoliubov inequality. Finally we give a generalized…
We analyze systematically composable composite entropy of two Tsallis subsystems with different q indices. H-theorem and thermal balance relation are commented.
The notion of complex-valued information entropy measure is presented. It applies in particular to directed networks (digraphs). The corresponding statistical physics notions are outlined. The studied network, serving as a case study, in…
Though Shannon entropy of a probability measure $P$, defined as $- \int_{X} \frac{\ud P}{\ud \mu} \ln \frac{\ud P}{\ud\mu} \ud \mu$ on a measure space $(X, \mathfrak{M},\mu)$, does not qualify itself as an information measure (it is not a…
A class of estimators of the R\'{e}nyi and Tsallis entropies of an unknown distribution $f$ in $\mathbb{R}^m$ is presented. These estimators are based on the $k$th nearest-neighbor distances computed from a sample of $N$ i.i.d. vectors with…
Recently, Zou obtained the generalized results on the bounds for Tsallis relative operator entropy. In this short paper, we give precise bounds for Tsallis relative operator entropy. We also give precise bounds of relative operator entropy.
We present an argument justifying the origin of the escort distributions used in calculations involving the Tsallis entropy. We rely on an induced hyperbolic Riemannian metric reflecting the generalized composition property of the Tsallis…
Generalized entropy, that has been recently proposed, puts all the known and apparently different entropies like The Tsallis, the R\'{e}nyi, the Barrow, the Kaniadakis, the Sharma-Mittal and the loop quantum gravity entropy within a single…
We propose a one-parameter family \ $\mathbb{R}_q$ \ of deformations of the reals, which is motivated by the generalized additivity of the Tsallis entropy. We introduce a generalized multiplication which is distributive with respect to the…
The Tsallis and R\'enyi entropies are important quantities in the information theory, statistics and related fields because the Tsallis entropy is an one parameter generalization of the Shannon entropy and the R\'enyi entropy includes…