Related papers: Information theory and generalized statistics
The formalism of statistical mechanics can be generalized by starting from more general measures of information than the Shannon entropy and maximizing those subject to suitable constraints. We discuss some of the most important examples of…
We discuss basic statistical properties of systems with multifractal structure. This is possible by extending the notion of the usual Gibbs--Shannon entropy into more general framework - Renyi's information entropy. We address the…
We discuss a basic thermodynamic properties of systems with multifractal structure. This is possible by extending the notion of Gibbs-Shannon's entropy into more general framework - Renyi's information entropy. We show a connection of…
We provide a unifying axiomatics for Renyi's entropy and non-extensive entropy of Tsallis. It is shown that the resulting entropy coincides with Csiszar's measure of directed divergence known from communication theory.
We find the value of constants related to constraints in characterization of some known statistical distributions and then we proceed to use the idea behind maximum entropy principle to derive generalized version of this distributions using…
Statistical mechanics is generalized on the basis of an information theory for inexact or incomplete probability distributions. A parameterized normalization is proposed and leads to a nonextensive entropy. The resulting incomplete…
Statistical mechanics is generalized on the basis of an additive information theory for incomplete probability distributions. The incomplete normalization $\sum_{i=1}^wp_i^q=1$ is used to obtain generalized entropy $S=-k\sum_{i=1}^wp_i^q\ln…
We introduce an information-theoretic measure, the Renyi information, to describe the galaxy distribution in space. We discuss properties of the information measure, and demonstrate its relationship with the probability distribution…
This paper extends the idea of a generalized estimator for a scalar parameter (Vos, 2022) to multi-dimensional parameters both with and without nuisance parameters. The title reflects the fact that generalized estimators provide more than…
We introduce a generalized thermostatistics based on Kolmogorov-Nagumo averages and appropriately selected information measures. The formalism includes Tsallis non-extensive thermostatistics, but also extensive thermostatistics based on…
The necessary information for specifying a complex system may not be completely accessible to us, i.e., to mathematical treatments. This is not to be confounded with the incompleteness of our knowledge about whatever systems or nature,…
Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…
We discuss the generalized von Neumann (Tsallis) entropy and the generalized Fisher information (GFI) in nonextensive quantum systems, by using the interpolation approximation (IA) which has been shown to yield good results for the quantal…
A field theory with generalized statistics in one space dimension is introduced. The statistics enters the scene through the coupling of the matter fields to a statistical gauge field, as it happens in the Chern-Simons theory in two…
Tsallis and R\'{e}nyi entropy measures are two possible different generalizations of the Boltzmann-Gibbs entropy (or Shannon's information) but are not generalizations of each others. It is however the Sharma-Mittal measure, which was…
The notion of group entropy is proposed. It enables to unify and generalize many different definitions of entropy known in the literature, as those of Boltzmann-Gibbs, Tsallis, Abe and Kaniadakis. Other new entropic functionals are…
A generalized information formula related to logical probability and fuzzy set is deduced from the classical information formula. The new information measure accords with to Popper's criterion for knowledge evolution very much. In…
Widespread use of the Internet and social networks invokes the generation of big data, which is proving to be useful in a number of applications. To deal with explosively growing amounts of data, data analytics has emerged as a critical…
We formulate a theory of generalized Fock spaces which underlies the different forms of quantum statistics such as ``infinite'', Bose-Einstein and Fermi-Dirac statistics. Single-indexed systems as well as multi-indexed systems that cannot…
We consider nonequilibrium systems with complex dynamics in stationary states with large fluctuations of intensive quantities (e.g. the temperature, chemical potential, or energy dissipation) on long time scales. Depending on the…