Related papers: Classical and Nonextensive Information Theory
This article serves as a brief introduction to the Shannon information theory. Concepts of information, Shannon entropy and channel capacity are mainly covered. All these concepts are developed in a totally combinatorial flavor. Some issues…
Complex systems often exhibit multiple levels of organization covering a wide range of physical scales, so the study of the hierarchical decomposition of their structure and function is frequently convenient. To better understand this…
Numerical experiments support the interesting conjecture that statistical methods be applicable not only to fully-chaotic systems, but also at the edge of chaos by using Tsallis' generalizations of the standard exponential and entropy. In…
Uncertainty relations emerging from the Tsallis entropy are derived and discussed. In particular we found a positively defined function that saturates the so called entropic inequalities for entropies characterizing the physical states…
We present a quantum information theory that allows for a consistent description of entanglement. It parallels classical (Shannon) information theory but is based entirely on density matrices (rather than probability distributions) for the…
We consider the additivity of the minimal output entropy and the classical information capacity of a class of quantum channels. For this class of channels the norm of the output is maximized for the output being a normalized projection. We…
We present the conclusive mathematical structure behind Tsallis statistics. We obtain mainly the following five theoretical results: (i) the one-to-one correspondence between the q-multinomial coefficient and Tsallis entropy, (ii) symmetry…
The property of Tsallis entropy is examined when considering tow systems with different temperatures to be in contact with each other and to reach the thermal equilibrium. It is verified that the total Tsallis entropy of the two systems…
We investigate the gravitational origin of the Tsallis entropy, characterized by the nonadditive index $\delta$. Utilizing Wald's formalism within the framework of $f(R)$ modified theories of gravity, we evaluate the entropy on the black…
Characterizing correlations in a quantum system on the basis of the results of the projective measurements can be performed with different means including the calculation of the classical mutual information. Generally, estimating such…
In this paper, we show that 1) additive energy is not appropriate for discussing the validity of Tsallis or R\'enyi statistics for nonextensive systems at meta-equilibrium; 2) $N$-body systems with nonadditive energy or entropy should be…
We find the value of constants related to constraints in characterization of some known statistical distributions and then we proceed to use the idea behind maximum entropy principle to derive generalized version of this distributions using…
A nonextensive thermostatic approach to chaotic dynamical systems is developed by expressing generalized Tsallis distribution as escort distribution. We explicitly show the thermodynamic limit and also derive the Legendre Transform…
We analyze systematically composable composite entropy of two Tsallis subsystems with different q indices. H-theorem and thermal balance relation are commented.
Entropy is a famous and well established concept in physics and engineering that can be used for explanation of basic fundamentals as well it finds applications in several areas, from quantum physics to astronomy, from network communication…
We consider an extension of $\epsilon$-entropy to a KL-divergence based complexity measure for randomized density estimation methods. Based on this extension, we develop a general information-theoretical inequality that measures the…
The purpose of this note is to give the general solution of two functional equations connected to the Shannon entropy and also to the Tsallis entropy. As a result of this, we present the regular solution of these equations, as well.…
Information theory provides tools to predict the performance of a learning algorithm on a given dataset. For instance, the accuracy of learning an unknown parameter can be upper bounded by reducing the learning task to hypothesis testing…
Most astrophysical plasmas are observed to have velocity distribution functions exhibiting non-Maxwellian suprathermal tails. The high energy particle populations are accurately represented by the family of kappa-distributions where the use…
Within the Tsallis thermodynamics' framework, and using scaling properties of the entropy, we derive a generalization of the Gibbs-Duhem equation. The analysis suggests a transformation of variables that allows standard thermodynamics to be…