Related papers: The expression of ensemble average internal energy…
A class of conserved models of wealth distributions are studied where wealth (or money) is assumed to be exchanged between a pair of agents in a population like the elastically colliding molecules of a gas exchanging energy. All sorts of…
The paper analyzes the probability distribution of the occupancy numbers and the entropy of a system at the equilibrium composed by an arbitrary number of non-interacting bosons. The probability distribution is derived both by tracing out…
Boltzmann-Sanov and Cramer-Chernoff's theorems provide large deviation probabilities, entropy, and rate functions for the spatial distribution of systems and the total internal energy of an ensemble respectively. By the method of Lagrange's…
Behavior of condensed matter systems deviating from the standard equilibrium conditions is discussed. Statistical properties of coupled dynamic-stochastic systems are studied within a combination of the maximum information principle and the…
We study the properties of Tsallis entropy and Shannon entropy from the point of view of algorithmic randomness. In algorithmic information theory, there are two equivalent ways to define the program-size complexity K(s) of a given finite…
Complementarity relations between various characterizations of a probability distribution are at the core of information theory. In particular, lower and upper bounds for the entropic function are of great importance. In applied topics, we…
We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…
The microscopic foundation of the generalized equilibrium statistical mechanics based on the Tsallis entropy is given by using the Gibbs idea of statistical ensembles of the classical and quantum mechanics. The equilibrium distribution…
The best-known and most commonly used distribution-property estimation technique uses a plug-in estimator, with empirical frequency replacing the underlying distribution. We present novel linear-time-computable estimators that significantly…
In ordinary statistical mechanics the Boltzmann-Shannon entropy is related to the Maxwell-Bolzmann distribution $p_i$ by means of a twofold link. The first link is differential and is offered by the Jaynes Maximum Entropy Principle. The…
A proof of the relativistic $H$-theorem by including nonextensive effects is given. As it happens in the nonrelativistic limit, the molecular chaos hypothesis advanced by Boltzmann does not remain valid, and the second law of thermodynamics…
This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…
We study the energy distribution in the extended resonant level model at equilibrium. Previous investigations [Phys. Rev. B {\bf 89}, 161306 (2014), Phys. Rev. B {\bf 93}, 115318 (2016)] have found, for a resonant electronic level…
Information based thermodynamic logic is revisited. It consists of two parts: Part A applies the modern theory of probability in which an arbitrary convex function \phi is employed as an analytic "device" to express information as…
This work investigates a modified Schelling model within the scope and aims of Social Physics. The main purpose is to see if how the concepts of potential and kinetic energy can be represented within a computational sociological system. A…
We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…
In this paper, we introduce the generalized Gompertz-power series class of distributions which is obtained by compounding generalized Gompertz and power series distributions. This compounding procedure follows same way that was previously…
In this work, it is suggested that the extremum complexity distribution of a high dimensional dynamical system can be interpreted as a piecewise uniform distribution in the phase space of its accessible states. When these distributions are…
Shannon information entropy is a natural measure of probability (de)localization and thus (un)predictability in various procedures of data analysis for model systems. We pay particular attention to links between the Shannon entropy and the…
We provide a simple physical interpretation, in the context of the second law of thermodynamics, to the information inequality (a.k.a. the Gibbs' inequality, which is also equivalent to the log-sum inequality), asserting that the relative…