Related papers: Differential Entropy on Statistical Spaces
A strengthened version of the central limit theorem for discrete random variables is established, relying only on information-theoretic tools and elementary arguments. It is shown that the relative entropy between the standardised sum of…
A recently explored interesting quantity in AdS/CFT, dubbed 'residual entropy', characterizes the amount of collective ignorance associated with either boundary observers restricted to finite time duration, or bulk observers who lack access…
The geometric entanglement entropy of a quantum field in the vacuum state is known to be divergent and, when regularized, to scale as the area of the boundary of the region. Here we introduce an operational definition of the entropy of the…
The time decay of fully discrete finite-volume approximations of porous-medium and fast-diffusion equations with Neumann or periodic boundary conditions is proved in the entropy sense. The algebraic or exponential decay rates are computed…
Two identities in statistical mechanics involving entropy differences (or ratios of density of states) at constant energy are derived. The first provides a nontrivial extension of the Jarzynski equality to the microcanonical ensemble [C.…
We provide a quantum statistical basis for (a)a characterisation of a complete set of thermodynamic variables and (b) the differentiability of the entropy function of these variables
Entropy in thermodynamics is an extensive quantity, whereas standard methods in statistical mechanics give rise to a non-extensive expression for the entropy. This discrepancy is often seen as a sign that basic formulas of statistical…
This paper derives new bounds on the difference of the entropies of two discrete random variables in terms of the local and total variation distances between their probability mass functions. The derivation of the bounds relies on maximal…
This contribution reviews critically the existing entropy measures for probabilistic hesitant fuzzy sets (PHFSs), and demonstrates that these entropy measures fail to effectively distinguish a variety of different PHFSs in some cases. In…
In this paper we show that the existence of a primarily discrete space-time may be a fruitful assumption from which we may develop a new approach of statistical thermodynamics in pre-relativistic conditions. The discreetness of space-time…
The routine definitions of both entropy, and differential entropy show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that 1) they no longer show incongruities, 2)…
We introduce a concept of distance for a space-time where the notion of point is replaced by the notion of physical states e.g. probability distributions. We apply ideas of information theory and compute the Fisher information matrix on…
Differential Privacy (DP) has become a gold standard in privacy-preserving data analysis. While it provides one of the most rigorous notions of privacy, there are many settings where its applicability is limited. Our main contribution is in…
In classical physics, entropy quantifies the randomness of large systems, where the complete specification of the state, though possible in theory, is not possible in practice. In quantum physics, despite its inherently probabilistic…
Entropic dynamics is a framework in which quantum theory is derived as an application of entropic methods of inference. Entropic dynamics on flat spaces has been extensively studied. The objective of this paper is to extend the entropic…
The division by N! in the expression of statistical entropy is usually justified to students by the statement that classical particles should be counted as indistinguishable. Sometimes, quantum indistinguishability is invoked to explain it.…
Entropy can signify different things: For instance, heat transfer in thermodynamics or a measure of information in data analysis. Many entropies have been introduced and it can be difficult to ascertain their different importance and…
We argue from the point of view of statistical inference that the quantum relative entropy is a good measure for distinguishing between two quantum states (or two classes of quantum states) described by density matrices. We extend this…
The various entropy bounds that exist in the literature suggest that spacetime is fundamentally discrete, and hint at an underlying relationship between geometry and "information". The foundation of this relationship is yet to be uncovered,…
Entropy arises in strong interactions by a dynamical separation of ``partons'' from unobservable ``environment'' modes due to confinement. For interacting scalar fields we calculate the statistical entropy of the observable subsystem.…