Related papers: What do generalized entropies look like? An axioma…
This is an analysis of the additivity of the entropy of thermodynamical systems with finite heat baths. It is presented an expression for the physical entropy of weakly interacting ergodic systems, and it is shown that it is valid for both…
It is not obvious how to extend Shannon's original information entropy to higher dimensions, and many different approaches have been tried. We replace the English text symbol sequence originally used to illustrate the theory by a discrete,…
Kolmogorov-Sinai entropy is an invariant of measure-preserving actions of the group of integers that is central to classification theory. There are two recently developed invariants, sofic entropy and Rokhlin entropy, that generalize…
G\'acs' coarse-grained algorithmic entropy leverages universal computation to quantify the information content of any given physical state. Unlike the Boltzmann and Gibbs-Shannon entropies, it requires no prior commitment to macrovariables…
It is shown that the structure of thermodynamics is "form invariant", when it is derived using maximum entropy principle for various choices of entropy and even beyond equilibrium. By the form invariance of thermodynamics, it is meant that…
This article proposes a new two-parameter generalized entropy, which can be reduced to the Tsallis and the Shannon entropy for specific values of its parameters. We develop a number of information-theoretic properties of this generalized…
The principal methods for the definition of thermodynamic entropy are discussed with special reference to those developed by Carath\'eodory, the Keenan School, Lieb and Yngvason, and the present authors. An improvement of the latter method…
The log-periodic equation for the entropy $S = - (k/a) \sum_{i=1}^{N} p_{i} \sin(a \ln p_{i})$, based on the forgotten Sharma-Taneja entropy measure, is studied for the first time with $N$ the total number of system states and $p_{i}$ the…
There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the…
The existence of the {\em typical set} is key for data compression strategies and for the emergence of robust statistical observables in macroscopic physical systems. Standard approaches derive its existence from a restricted set of…
Thermodynamics can be formulated in either of two approaches, the phenomenological approach, which refers to the macroscopic properties of systems, and the statistical approach, which describes systems in terms of their microscopic…
The combinatorial basis of entropy by Boltzmann can be written $H= {N}^{-1} \ln \mathbb{W}$, where $H$ is the dimensionless entropy of a system, per unit entity, $N$ is the number of entities and $\mathbb{W}$ is the number of ways in which…
Shannon's entropy power inequality (EPI) can be viewed as a statement of concavity of an entropic function of a continuous random variable under a scaled addition rule: $$f(\sqrt{a}\,X + \sqrt{1-a}\,Y) \ge a f(X) + (1-a) f(Y) \quad \forall…
An entropic-force scenario, i.e., entropic cosmology, assumes that the horizon of the universe has an entropy and a temperature. In the present study, in order to examine entropic cosmology, we derive entropic-force terms not only from the…
In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…
This study establishes a universal mechanism for entropy production in isolated quantum systems governed by interactions that induce random-phase fluctuations. By developing a resolvent-based framework, we demonstrate that steady-state…
We consider Shannon entropy, Fisher information, R\'enyi entropy, and Tsallis entropy to study the quantum droplet phase in Bose-Einstein condensates. In the beyond mean-field description, the Gross-Pitaevskii equation with Lee-Huang-Yang…
A well-known result across information theory, machine learning, and statistical physics shows that the maximum entropy distribution under a mean constraint has an exponential form called the Gibbs-Boltzmann distribution. This is used for…
We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…
A statistical thermodynamic approach of moving particles forming an elastic body is presented which leads to reveal molecular-mechanical properties of classical and nonextensive dynamical systems. We derive the Boltzmann-Gibbs (BG) entropy…