English
Related papers

Related papers: Entropy and Information jump for log-concave vecto…

200 papers

We prove upper bounds on the $L^\infty$-Wasserstein distance from optimal transport between strongly log-concave probability densities and log-Lipschitz perturbations. In the simplest setting, such a bound amounts to a transport-information…

Probability · Mathematics 2025-08-04 Ksenia A. Khudiakova , Jan Maas , Francesco Pedrotti

We establish a general class of entropy inequalities that take the concise form of Gaussian comparisons. The main result unifies many classical and recent results, including the Shannon-Stam inequality, the Brunn-Minkowski inequality, the…

Information Theory · Computer Science 2022-06-29 Efe Aras , Thomas A. Courtade

Within its range of applicability, the Boltzmann equation seems unique in its capacity to accurately describe the transition from almost any initial state to a self-equilibrated thermal state. Using information-theoretic methods to rephrase…

Statistical Mechanics · Physics 2025-10-07 Jürgen T. Stockburger

Aim of this short note is to study Shannon's entropy power along entropic interpolations, thus generalizing Costa's concavity theorem. We shall provide two proofs of independent interest: the former by $\Gamma$-calculus, hence applicable to…

Information Theory · Computer Science 2020-12-23 Luca Tamanini

We study the relationship between information- and estimation-theoretic quantities in time-evolving systems. We focus on the Fokker-Planck channel defined by a general stochastic differential equation, and show that the time derivatives of…

Information Theory · Computer Science 2017-02-14 Andre Wibisono , Varun Jog , Po-Ling Loh

We prove that the (B) conjecture and the Gardner-Zvavitch conjecture are true for all log-concave measures that are rotationally invariant, extending previous results known for Gaussian measures. Actually, our result apply beyond the case…

Metric Geometry · Mathematics 2022-10-03 Dario Cordero-Erausquin , Liran Rotem

In this paper we apply the entropy principle to the relativistic version of the differential equations describing a standard fluid flow, that is, the equations for mass, momentum, and a system for the energy matrix. These are the second…

Mathematical Physics · Physics 2018-02-22 Hans Wilhelm Alt

We propose a new thermodynamic, relativistic relationship between information and entropy, which is closely analogous to the classic Maxwell electro-magnetic equations. Determination of whether information resides in points of…

General Physics · Physics 2007-05-23 Michael C. Parker , Stuart D. Walker

Many trace inequalities can be expressed either as concavity/convexity theorems or as monotonicity theorems. A classic example is the joint convexity of the quantum relative entropy which is equivalent to the Data Processing Inequality. The…

Functional Analysis · Mathematics 2022-10-25 Eric A. Carlen , Haonan Zhang

Shannon and Khinchin showed that assuming four information theoretic axioms the entropy must be of Boltzmann-Gibbs type, $S=-\sum_i p_i \log p_i$. Here we note that in physical systems one of these axioms may be violated. For non-ergodic…

Statistical Mechanics · Physics 2015-03-19 Stefan Thurner , Rudolf Hanel

The dissipation of general convex entropies for continuous time Markov processes can be described in terms of backward martingales with respect to the tail filtration. The relative entropy is the expected value of a backward submartingale.…

Probability · Mathematics 2015-01-27 Joaquin Fontbona , Benjamin Jourdain

Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…

Information Theory · Computer Science 2017-01-04 Günther Koliander , Georg Pichler , Erwin Riegler , Franz Hlawatsch

Dunkel and Trigger [Phys. Rev. A {71}, 052102 (2005)] show that the Leipnik's joint entropy monotonously increases for the initially maximally classical Gaussian wave packet for a free particle. After expressing the joint entropy of the…

Quantum Physics · Physics 2010-01-19 Kyoung Kon Kim , Sang Pyo Kim , Sok Kuh Kang

We consider Shannon entropy, Fisher information, R\'enyi entropy, and Tsallis entropy to study the quantum droplet phase in Bose-Einstein condensates. In the beyond mean-field description, the Gross-Pitaevskii equation with Lee-Huang-Yang…

Quantum Gases · Physics 2024-10-04 Sk Siddik , Golam Ali Sekh

Information inequalities govern the ultimate limitations in information theory and as such play an pivotal role in characterizing what values the entropy of multipartite states can take. Proving an information inequality, however, quickly…

Quantum Physics · Physics 2025-10-23 Shao-Lun Huang , Tobias Rippchen , Mario Berta

We deploy Shannon's information entropy to the distribution of branching fractions in a particle decay. This serves to quantify how important a given new reported decay channel is, from the point of view of the information that it adds to…

In information theory, the well-known log-sum inequality is a fundamental tool which indicates the non-negativity for the relative entropy. In this article, we establish a set of inequalities which are similar to the log-sum inequality…

Functional Analysis · Mathematics 2022-11-08 Supriyo Dutta , Shigeru Furuichi

The Ingleton inequality is a classical linear information inequality that holds for representable matroids but fails to be universally valid for entropic vectors. Understanding the extent to which this inequality can be violated has been a…

Information Theory · Computer Science 2026-05-19 Rostislav Matveev , Andrei Romashchenko

We establish a dimension-free improvement of Talagrand's Gaussian transport-entropy inequality, under the assumption that the measures satisfy a Poincar\'e inequality. We also study stability of the inequality, in terms of relative entropy,…

Probability · Mathematics 2021-04-27 Dan Mikulincer

We adapt arguments concerning information-theoretic convergence in the Central Limit Theorem to the case of dependent random variables under Rosenblatt mixing conditions. The key is to work with random variables perturbed by the addition of…

Probability · Mathematics 2008-10-06 Oliver Johnson