Related papers: Duality Symmetry, Two Entropy Functions, and an Ei…
Thermodynamics as limiting behaviors of statistics is generalized to arbitrary system with probability {\it a priori} where thermodynamic infinite-size limit is replaced by multiple-measurement limit. A duality symmetry between Massieu's…
Counting ad infinitum is the holographic observable to a statistical dynamics with finite states under independent repeated sampling. Entropy provides the infinitesimal probability for an observed frequency $\hat{\boldsymbol{\nu}}$ w.r.t. a…
In this paper we discuss about the validity of the Shannon entropy functional in connection with the correct Gibbs-Hertz probability distribution function. We show that there is no contradiction in using the Shannon-Gibbs functional and…
We introduce an entropy analysis of time series, repeated measurements of statistical observables, based on an Eulerian homogeneous degree-one entropy function $\Phi(t,n)$ of time $t$ and number of events $n$. The duality of $\Phi$, in…
Shannon's Entropy Power Inequality can be viewed as characterizing the minimum differential entropy achievable by the sum of two independent random variables with fixed differential entropies. The entropy power inequality has played a key…
A statistical system is classically defined on a set of microstates $E$ by a global energy function $H : E \to \mathbb{R}$, yielding Gibbs probability measures (softmins) $\rho^\beta(H)$ for every inverse temperature $\beta = T^{-1}$. Gibbs…
We develop the argument that the Gibbs-von Neumann entropy is the appropriate statistical mechanical generalisation of the thermodynamic entropy, for macroscopic and microscopic systems, whether in thermal equilibrium or not, as a…
We derive the quantum Fisher information for entropy estimation in a Gibbs state and show that it equals the inverse of the heat capacity, which is dual to the temperature Fisher information given by the heat capacity divided by the square…
Generalization through novel interpretations of the inner logic of the century-old Gibbs' statistical thermodynamics is presented: i) Identifying $k_B\to 0$ as classical energetics, one directly derives a pair of thermodynamic variational…
We provide a simple physical interpretation, in the context of the second law of thermodynamics, to the information inequality (a.k.a. the Gibbs' inequality, which is also equivalent to the log-sum inequality), asserting that the relative…
Within the Tsallis thermodynamics' framework, and using scaling properties of the entropy, we derive a generalization of the Gibbs-Duhem equation. The analysis suggests a transformation of variables that allows standard thermodynamics to be…
The ``Gibbs Paradox'' refers to several related questions concerning entropy in thermodynamics and statistical mechanics: whether it is an extensive quantity or not, how it changes when identical particles are mixed, and the proper way to…
We study an entropy measure for quantum systems that generalizes the von Neumann entropy as well as its classical counterpart, the Gibbs or Shannon entropy. The entropy measure is based on hypothesis testing and has an elegant formulation…
We expand upon a natural analogy between Bayesian statistics and statistical physics in which sample size corresponds to inverse temperature. This analogy motivates the definition of two novel statistical quantities: a learning capacity and…
The Gibbs paradox is a conventional paradox in classical statistical mechanics, typically resolved by invoking quantum indistinguishability through the 1/N! correction. In this letter, we present a resolution within classical ensemble…
Information based thermodynamic logic is revisited. It consists of two parts: Part A applies the modern theory of probability in which an arbitrary convex function \phi is employed as an analytic "device" to express information as…
Gibbs' theorem, which is originally intended for canonical ensembles with complete statistics has been generalized to open systems with incomplete statistics. As a result of this generalization, it is shown that the stationary equilibrium…
The standard formulation of thermostatistics, being based on the Boltzmann-Gibbs distribution and logarithmic Shannon entropy, describes idealized uncorrelated systems with extensive energies and short-range interactions. In this letter, we…
Superstatistics generalizes Boltzmann statistics by assuming spatio-temporal fluctuations of the intensive variables. It has many applications in the analysis of experimental and simulated data. The fluctuation of the intensity variable is…
In this research paper, it is proved that an approximation to Gibbs-Shannon entropy measure naturally leads to Tsallis entropy for the real parameter q =2 . Several interesting measures based on the input as well as output of a discrete…