Related papers: On Entropy Minimization and Convergence
We study the time evolution of eleven microscopic entropy definitions (of Boltzmann-surface, Gibbs-volume, canonical, coarse-grained-observational, entanglement and diagonal type) and three microscopic temperature definitions (based on…
It is always some constraint that yields any nontrivial structure from statistical averages. As epitomized by the Boltzmann distribution, the energy conservation is often the principal constraint acting on mechanical systems. Here, we…
In recent papers, several authors have claimed that a definition of the thermodynamic entropy in terms of the logarithm of a volume in phase space, originally suggested by Gibbs, is the only valid definition. Arguing from the Gibbs entropy,…
The positivity conditions of the relative entropy between two thermal equilibrium states $\hat{\rho}_1$ and $\hat{\rho}_2$ are used to obtain upper and lower bounds for the subtraction of their entropies, the Helmholtz potential and the…
Using statistical thermodynamics, we derive a general expression of the stationary probability distribution for thermodynamic systems driven out of equilibrium by several thermodynamic forces. The local equilibrium is defined by imposing…
Gibbs' thermodynamic entropy is given by the logarithm of the phase volume, which itself responds to heat transfer to and from thermal reservoirs. We compare the thermodynamic dissipation described by phase-volume loss with heat-transfer…
We consider the estimation of an unknown parameter $\theta$ through a quantum probe at thermal equilibrium. The probe is assumed to be in a Gibbs state according to its Hamiltonian $H_\theta$, which is divided in a parameter-encoding term…
The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…
Gibbs' theorem, which is originally intended for canonical ensembles with complete statistics has been generalized to open systems with incomplete statistics. As a result of this generalization, it is shown that the stationary equilibrium…
Within an inherently classical perspective, there is always an unavoidable energy cost associated with the information deletion and this common lore is at the heart of the Landauer's conjecture that does not impose, per se, any relevant…
The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…
We examine the fundamental aspects of statistical mechanics, dividing the problem into a discussion purely about probability, which we analyse from a Bayesian standpoint. We argue that the existence of a unique maximising probability…
"Bounds on information combining" are entropic inequalities that determine how the information (entropy) of a set of random variables can change when these are combined in certain prescribed ways. Such bounds play an important role in…
A Hamiltonian model living in a bounded phase space and with long-range interactions is studied. It is shown, by analytical computations, that there exists an energy interval in which the microcanonical entropy is a decreasing convex…
We recall some of the history of the information-theoretic approach to deriving core results in probability theory and indicate parts of the recent resurgence of interest in this area with current progress along several interesting…
We report universal statistical properties displayed by ensembles of pure states that naturally emerge in quantum many-body systems. Specifically, two classes of state ensembles are considered: those formed by i) the temporal trajectory of…
We develop new modified cosmological scenarios by applying the first law of thermodynamics at the Universe horizon, utilizing a new entropic functional that generalizes the standard Boltzmann-Gibbs-Shannon entropy. In particular, starting…
Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…
Previous results on Renyi and Wang's formalism of the Tsallis thermostatics are founded by using an extensive variable z connected to the entropic parameter q. It is shown that in the thermodynamical limit both the Tsallis and Renyi…
Quantum ergodicity asserts that almost all infinite sequences of eigenstates of a quantized ergodic system are equidistributed in the phase space. On the other hand, there are might exist exceptional sequences which converge to different…