Related papers: The Renyi entropy as a "free entropy" for complex …
We show that Tsallis ensemble of power-law distributions provides a mechanical model of nonextensive equilibrium thermodynamics for small interacting Hamiltonian systems, i.e., using Boltzmann's original nomenclature, we prove that it is an…
Within its range of applicability, the Boltzmann equation seems unique in its capacity to accurately describe the transition from almost any initial state to a self-equilibrated thermal state. Using information-theoretic methods to rephrase…
In this paper we examine the average R\'{e}nyi entropy $S_{\alpha}$ of a subsystem $A$ when the whole composite system $AB$ is a random pure state. We assume that the Hilbert space dimensions of $A$ and $AB$ are $m$ and $m n$ respectively.…
The Renyi statistics in the canonical and microcanonical ensembles is examined in the general case and in particular for the ideal gas. In the microcanonical ensemble the Renyi statistics is equivalent with the Boltzmann-Gibbs statistics.…
Increasing the number $N$ of elements of a system typically makes the entropy to increase. The question arises on {\it what particular entropic form} we have in mind and {\it how it increases} with $N$. Thermodynamically speaking it makes…
If the N bosons that compose an ideal Bose-Einstein gas with energy E and volume V are each assumed to have the average energy of the system E/N, the entropy is easily expressed in terms of the number of bosons N and the number of…
We demonstrate and characterize a first-principles approach to modeling the mass action dynamics of metabolism. Starting from a basic definition of entropy expressed as a multinomial probability density using Boltzmann probabilities with…
Systems with a long-term stationary state that possess as a spatio-temporally fluctuation quantity $\beta$ can be described by a superposition of several statistics, a "super statistics". We consider first, the Gamma, log-normal and…
The problem of assigning probability distributions which objectively reflect the prior information available about experiments is one of the major stumbling blocks in the use of Bayesian methods of data analysis. In this paper the method of…
The equilibrium distributions of probabilities providing maximality of Renyi and Tsallis entropies are rederived. New S-forms of them are found which are normalised with corresponding entropies in contrast to the usual Z-forms normalised…
Certain fluctuations in particle number at fixed total energy lead exactly to a cut-power law distribution in the one-particle energy, via the induced fluctuations in the phase-space volume ratio. The temperature parameter is expressed…
Observational entropy -- a quantity that unifies Boltzmann's entropy, Gibbs' entropy, von Neumann's macroscopic entropy, and the diagonal entropy -- has recently been argued to play a key role in a modern formulation of statistical…
Maximum entropy principle (MEP) offers an effective and unbiased approach to inferring unknown probability distributions when faced with incomplete information, while neural networks provide the flexibility to learn complex distributions…
When at equilibrium, large-scale systems obey conventional thermodynamics because they belong to microscopic configurations (or states) that are typical. Crucially, the typical states usually represent only a small fraction of the total…
We present a maximum entropy approach to analyze the internal dynamics of a small system in contact with a large bath e.g. a solute-solvent system. For the small solute, the fluctuations around the mean values of observables are not…
Bekenstein's conjectured entropy bound for a system of linear size $R$ and energy $E$, namely $S \leq 2 \pi E R$, has counterexamples for many of the ways in which the "system," $R$, $E$, and $S$ may be defined. One consistent set of…
For spatially bounded free fields, the Bekenstein bound states that the specific entropy satisfies the inequality $\frac{S}{E} \leq 2 \pi R$, where $R$ stands for the radius of the smallest sphere that circumscribes the system. The validity…
We calculate analytically the Renyi entropy for the zeta-urn model with a Gibbs measure definition of the micro-state probabilities. This allows us to obtain the singularities in the R\'enyi entropy from those of the thermodynamic…
In ordinary statistical mechanics the Boltzmann-Shannon entropy is related to the Maxwell-Bolzmann distribution $p_i$ by means of a twofold link. The first link is differential and is offered by the Jaynes Maximum Entropy Principle. The…
Statistical mechanics reveals that the properties of a macroscopic physical system emerge as an average over an ensemble of statistically independent microscopic subsystems, each occupying a specific microstate. In the study of quantum…