Related papers: Approximate tensorization of entropy at high tempe…
We adapt arguments concerning entropy-theoretic convergence from the independent case to the case of FKG random variables. FKG systems are chosen since their dependence structure is controlled through covariance alone, though in the sequel…
We consider systems of conservation laws endowed with a convex entropy. We show the contraction, up to a translation, to extremal entropic shocks, for a pseudo-distance based on the notion of relative entropy. The contraction holds for…
Various properties of relative entropy have led to its widespread use in information theory. These properties suggest that relative entropy has a role to play in systems that attempt to perform inference in terms of probability…
Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…
Renyi's "thinning" operation on a discrete random variable is a natural discrete analog of the scaling operation for continuous random variables. The properties of thinning are investigated in an information-theoretic context, especially in…
Similarity-sensitive entropy measures the uncertainty of a probability law relative to a similarity kernel that encodes the distinguishability between states. We develop a measure-theoretic treatment covering both finite similarity matrices…
We study long-time dynamical behaviors of weakly self-consistent Vlasov-Fokker-Planck equations. We introduce Hessian matrix conditions on mean-field kernel functions, which characterizes the exponential convergence of solutions in $L^1$…
We consider the problem of extracting entropy by sparse transformations, namely functions with a small number of overall input-output dependencies. In contrast to previous works, we seek extractors for essentially all the entropy without…
We study the relative entropy between the empirical estimate of a discrete distribution and the true underlying distribution. If the minimum value of the probability mass function exceeds an $\alpha > 0$ (i.e. when the true underlying…
We prove that every GNS-symmetric quantum Markov semigroup on a finite dimensional matrix algebra satisfies a modified log-Sobolev inequality. In the discrete time setting, we prove that every finite dimensional GNS-symmetric quantum…
Building on the inequalities for homogeneous tetrahedral polynomials in independent Gaussian variables due to R. Lata{\l}a we provide a concentration inequality for non-necessarily Lipschitz functions $f\colon \R^n \to \R$ with bounded…
General hyperbolic systems of balance laws with inhomogeneity in space and time in all constitutive functions are studied in the context of relative entropy. A framework is developed in this setting that contributes to a measure-valued weak…
We give rates of convergence in the almost sure invariance principle for sums of dependent random variables with semi exponential tails, whose coupling coefficients decrease at a subexponential rate. We show that the rates in the strong…
Based on our derivation of finite temperature reduced density matrix functional theory and the discussion of the performance of its first-order functional this work presents several different correlation-energy functionals and applies them…
Consistency constraints for low-energy theories, especially those lacking Lorentz invariance, have recently garnered attention. Building on results from black hole thermodynamics, we investigate the conjecture that leading irrelevant…
We show that under natural growth conditions on the entropy function, convergence in relative entropy is equivalent to $L_p$-convergence. The main tool is the theory of Young measures, in a form that accounts for the formation of…
Generic rotationally invariant random matrix models satisfy a simple relation: the probability distribution of off-diagonal elements and the one of half the difference between any two diagonal elements coincide. In the spirit of the…
We develop a theory based on relative entropy to show the uniqueness and L^2 stability (up to a translation) of extremal entropic Rankine-Hugoniot discontinuities for systems of conservation laws (typically 1-shocks, n-shocks, 1-contact…
In this paper we prove analogues of Korovkin's theorem in the context of weakly nonlinear and monotone operators acting on Banach lattices of functions of several variables. Our results concern the convergence almost everywhere, the…
We obtain entropy formulas for SRB measures with finite entropy given by inducing schemes. In the first part of the work, we obtain Pesin entropy formula for the class of noninvertible systems whose SRB measures are given by Gibbs-Markov…