Related papers: On Entropy Minimization and Convergence
The microcanonical ensemble has long been a starting point for the development of thermodynamics from statistical mechanics. However, this approach presents two problems. First, it predicts that the entropy is only defined on a discrete set…
Information theory on a time-discrete setting in the framework of time series analysis is generalized to the time-continuous case. Considerations of the Roessler and Lorenz dynamics as well as the Ornstein-Uhlenbeck process yield for…
In contrast to the canonical ensemble where thermodynamic functions are smooth for all finite system sizes, the microcanonical entropy can show nonanalytic points also for finite systems, even if the Hamiltonian is smooth. The relation…
Shannon entropy, a cornerstone of information theory, statistical physics and inference methods, is uniquely identified by the Shannon-Khinchin or Shore-Johnson axioms. Generalizations of Shannon entropy, motivated by the study of…
We investigate the overdamped stochastic dynamics of a particle in an asymptotically flat external potential field, in contact with a thermal bath. For an infinite system size, the particles may escape the force field and diffuse freely at…
We expand upon a natural analogy between Bayesian statistics and statistical physics in which sample size corresponds to inverse temperature. This analogy motivates the definition of two novel statistical quantities: a learning capacity and…
The ``Gibbs Paradox'' refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to…
We propose a compression-based version of the empirical entropy of a finite string over a finite alphabet. Whereas previously one considers the naked entropy of (possibly higher order) Markov processes, we consider the sum of the…
The maximum entropy principle, as applied to quantum systems, is a fundamental prescript positing that for a quantum system for which we only have partial knowledge, the maximum entropy state consistent with the partial knowledge is a…
We show that there exists a natural way to define a condition of generalized thermal equilibrium between systems governed by Tsallis thermostatistics, under the hypotheses that i) the coupling between the systems is weak, ii) the structure…
In this paper we study aspects of the ergodic theory of the geodesic flow on a non-compact negatively curved manifold. It is a well known fact that every continuous potential on a compact metric space has a maximizing measure.…
Certain fluctuations in particle number at fixed total energy lead exactly to a cut-power law distribution in the one-particle energy, via the induced fluctuations in the phase-space volume ratio. The temperature parameter is expressed…
We study the informational underpinnings of thermodynamics and statistical mechanics, using an abstract framework, general probabilistic theories, capable of describing arbitrary physical theories. This allows one to abstract the…
The thermodynamic definition of entropy can be extended to nonequilibrium systems based on its relation to information. To apply this definition in practice requires access to the physical system's microstates, which may be prohibitively…
We consider the Microcanonical Variational Principle for the vortex system in a bounded domain. In particular we are interested in the thermodynamic properties of the system in domains of second kind, i.e. for which the equivalence of…
We introduce a definition of coarse-grained entropy that unifies measurement-based (observational entropy) and max-entropy-based (Jaynes) approaches to coarse-graining, by identifying physical constraints with information theoretic priors.…
Maximum entropy estimation is of broad interest for inferring properties of systems across many different disciplines. In this work, we significantly extend a technique we previously introduced for estimating the maximum entropy of a set of…
We revisit the concavity property of the thermodynamic entropy in order to formulate a general proof of the minimum energy principle as well as of other equivalent extremum principles that are valid for thermodynamic potentials and…
We assume that markovian dynamics on a finite graph enjoys a gauge symmetry under local scalings of the probability density, derive the transformation law for the transition rates and interpret the thermodynamic force as a gauge potential.…
The physical foundations of a variety of emerging technologies --- ranging from the applications of quantum entanglement in quantum information to the applications of nonequilibrium bulk and interface phenomena in microfluidics, biology,…