Related papers: Relative entropy in diffusive relaxation
A fractional diffusion equation with advection term is rigorously derived from a kinetic transport model with a linear turning operator, featuring a fat-tailed equilibrium distribution and a small directional bias due to a given vector…
In 1997, Katok--Thouvenot and Ferenczi independently introduced a notion of ``slow entropy'' as a way to quantitatively compare measure-preserving systems with zero entropy. We develop a relative version of this theory for a…
In this paper, we derive exponential ergodicity in relative entropy for general kinetic SDEs under a partially dissipative condition. It covers non-equilibrium situations where the forces are not of gradient type and the invariant measure…
We presented a methodology to approximate the entropy production for Brownian motion in a tilted periodic potential. The approximation stems from the well known thermodynamic uncertainty relation. By applying a virial-like expansion, we…
We revisit the connection between index and relative entropy for an inclusion of finite von Neumann algebras. We observe that the Pimsner-Popa index connects to sandwiched Renyi $p$-relative entropy for all $1/2\le p\le \infty$, including…
We consider a kinetic model for a two component gas mixture without chemical reactions. Our goal is to study hypocoercivity for the linearized BGK model for gas mixtures in continuous phase space. By constructing an entropy functional, we…
Microscopic formula to describe the entropy of biomolecular solutions are derived based on the Gibbs formula of entropy, and the generalized Langevin theory combined with the RISM/3D-RISM theory. Two formula are derived: one is concerned…
Formalising the confrontation of opinions (models) to observations (data) is the task of Inferential Statistics. Information Theory provides us with a basic functional, the relative entropy (or Kullback-Leibler divergence), an asymmetrical…
The aim of this work is to analyze the entropy, entropy flux and entropy supply rate of granular fluids within the frameworks of the Boltzmann equation and continuum thermodynamics. It is shown that the entropy inequality for a granular gas…
A criterion of local continuity of the relative entropy of resource -- the relative entropy distance to the set of free states -- is obtained. Several basic corollaries of this criterion are presented. Applications to the relative entropy…
We obtain formulas for Petz-R\'enyi and Umegaki relative entropy from the idea of distribution of a positive selfadjoint operator. Classical results on R\'enyi and Kullback-Leibler divergences are applied to obtain new results and new…
Based on a characterization of the optimality of a feasible solution of a convex entropy minimization problem, one shows that the feasible solutions obtained using formally the Lagrange multipliers method are optimal.
In this paper we study the notion of estimation entropy recently established by Liberzon and Mitra. This quantity measures the smallest rate of information about the state of a dynamical system above which an exponential state estimation…
The specific relative entropy, introduced by N. Gantert, allows to quantify the discrepancy between the laws of potentially mutually singular measures. It appears naturally as the large deviations rate function in a randomized version of…
In most compressive sensing problems l1 norm is used during the signal reconstruction process. In this article the use of entropy functional is proposed to approximate the l1 norm. A modified version of the entropy functional is continuous,…
The entropy of an ergodic source is the limit of properly rescaled 1-block entropies of sources obtained applying successive non-sequential recursive pairs substitutions (see P. Grassberger 2002 ArXiv:physics/0207023 and D. Benedetto, E.…
We present a method of estimating the rate of entropy production in underdamped dynamics by decomposing it into contributions originating in different non-equilibrium effects. Specifically, a non-zero average velocity, a non-thermal width…
We demonstrate that the shallow water moment equations satisfy an auxiliary entropy conservation law, where the entropy function corresponds to the total energy. Additionally, we show that the classical Newtonian slip friction and Manning…
The rate of change of entropy $\dot S$ is measured for a system of particles floating on the surface of a fluid maintained in a turbulent steady state. The resulting coagulation of the floaters allows one to relate $\dot S$ to the velocity…
We show that for weakly dependent random variables the relative entropy functional satisfies an approximate version of the standard tensorization property which holds in the independent case. As a corollary we obtain a family of…