Related papers: Duality Symmetry, Two Entropy Functions, and an Ei…
In this paper, we derive both the Adam-Gibbs and the Rosenfield relations from the microscopic point of view and compare them with the numerical calculation for one and two dimensional systems. The comparison shows there is an excellent…
Gibbs paradox in the context of statistical mechanics addresses the issue of additivity of entropy of mixing gases. The usual discussion attributes the paradoxical situation to classical distinguishability of identical particles and credits…
The black hole area theorem suggests that classical general relativity is the thermodynamic limit of a quantum statistics. The degrees of freedom of the statistical theory cannot be the spacetime metric. We argue that the statistical theory…
Dunkel and Hilbert, "Consistent thermostatistics forbids negative absolute temperatures," Nature Physics, {\bf 10}, 67 (2014), and Hilbert, H\"anggi, and Dunkel, "Thermodynamic laws in isolated systems," Phys. Rev. E {\bf 90}, 062116 (2014)…
The entropy of Boltzmann-Gibbs, as proved by Shannon and Khinchin, is based on four axioms, where the fourth one concerns additivity. The group theoretic entropies make use of formal group theory to replace this axiom with a more general…
We consider a Bayesian problem of estimating of probability of success in a series of conditionally independent trials with binary outcomes. We study the asymptotic behaviour of differential entropy for posterior probability density…
Understanding the way in which random entities interact is of key interest in numerous scientific fields. This can range from a full characterization of the joint distribution to single scalar summary statistics. In this work we identify a…
In classical Hamiltonian theories, entropy may be understood either as a statistical property of canonical systems, or as a mechanical property, that is, as a monotonic function of the phase space along trajectories. In classical mechanics,…
We obtain bounds on fluctuations of two entropy estimators for a class of one-dimensional Gibbs measures on the full shift. They are the consequence of a general exponential inequality for Lipschitz functions of n variables. The first…
The most useful measure of a bipartite entanglement is the von Neumann entropy of either of the reduced density matrices. For a particular class of continuous-variable states, the Gaussian states, the entropy of entanglement can be…
We discuss inertial effects in systems outside equilibrium within the framework of non-equilibrium thermodynamics. By introducing a Gibbs equation in which the entropy depends on the probability density, we are able to describe a system of…
The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…
Building upon work by Matsumoto, we show that the quantum relative entropy with full-rank second argument is determined by four simple axioms: i) Continuity in the first argument, ii) the validity of the data-processing inequality, iii)…
The long standing contrast between Boltzmann's and Gibbs' approach to statistical thermodynamics has been recently rekindled by Dunkel and Hilbert [1], who criticize the notion of negative absolute temperature (NAT), as a misleading…
When at equilibrium, large-scale systems obey conventional thermodynamics because they belong to microscopic configurations (or states) that are typical. Crucially, the typical states usually represent only a small fraction of the total…
Information entropic measures such as Fisher information, Shannon entropy, Onicescu energy and Onicescu Shannon entropy of a symmetric double-well potential are calculated in both position and momentum space. Eigenvalues and eigenvectors of…
The convex conjugate (i.e., the Legendre transform) of Type II error probability (volume) as a function of Type I error probability (volume) is determined for the hypothesis testing problem with randomized detectors. The derivation relies…
The thermodynamic maximum principle for the Boltzmann-Gibbs-Shannon (BGS) entropy is reconsidered by combining elements from group and measure theory. Our analysis starts by noting that the BGS entropy is a special case of relative entropy.…
The goal of this note is to show that some convolution type inequalities from Harmonic Analysis and Information Theory, such as Young's convolution inequality (with sharp constant), Nelson's hypercontractivity of the Hermite semi-group or…
A symmetric random variable is called a Gaussian mixture if it has the same distribution as the product of two independent random variables, one being positive and the other a standard Gaussian random variable. Examples of Gaussian mixtures…