English
Related papers

Related papers: Entropy and Information jump for log-concave vecto…

200 papers

This paper presents self-contained proofs of the strong subadditivity inequality for quantum entropy and some related inequalities for the quantum relative entropy, most notably its convexity and its monotonicity under stochastic maps.…

Quantum Physics · Physics 2009-11-07 Mary Beth Ruskai

We prove an extended convexity for quantum Fisher information of a mixed state with a given convex decomposition. This convexity introduces a bound which has two parts: i. classical part associated to the Fisher information of the…

Quantum Physics · Physics 2015-04-09 S. Alipour , A. T. Rezakhani

Information concentration of probability measures have important implications in learning theory. Recently, it is discovered that the information content of a log-concave distribution concentrates around their differential entropy, albeit…

Machine Learning · Computer Science 2018-02-27 Ya-Ping Hsieh , Volkan Cevher

We review with a tutorial scope the information theory foundations of quantum statistical physics. Only a small proportion of the variables that characterize a system at the microscopic scale can be controlled, for both practical and…

Statistical Mechanics · Physics 2007-05-23 R. Balian

Within the framework of linear vector Gaussian channels with arbitrary signaling, closed-form expressions for the Jacobian of the minimum mean square error and Fisher information matrices with respect to arbitrary parameters of the system…

Information Theory · Computer Science 2009-03-12 M. Payaró , D. P. Palomar

We utilize a discrete version of the notion of degree of freedom to prove a sharp min-entropy-variance inequality for integer valued log-concave random variables. More specifically, we show that the geometric distribution minimizes the…

Probability · Mathematics 2023-09-08 Heshan Aravinda

We investigate the role of convexity in R\'enyi entropy power inequalities. After proving that a general R\'enyi entropy power inequality in the style of Bobkov-Chistyakov (2015) fails when the R\'enyi parameter $r\in(0,1)$, we show that…

Probability · Mathematics 2019-09-30 Jiange Li , Arnaud Marsiglietti , James Melbourne

We prove, using optimal transport tools, weighted Poincar'e inequalities for log-concave random vectors satisfying some centering conditions. We recover by this way similar results by Klartag and Barthe-Cordero-Erausquin for log-concave…

Probability · Mathematics 2014-07-14 Dario Cordero-Erausquin , Nathael Gozlan

Quantitative analysis of discontinuity of basic characteristics of quantum states and channels is presented. First we consider general estimates for discontinuity jump (loss) of the von Neumann entropy for a given converging sequence of…

Quantum Physics · Physics 2021-09-28 M. E. Shirokov

We have presented first an axiomatic derivation of Boltzmann entropy on the basis of two axioms consistent with two basic properties of thermodynamic entropy. We have then studied the relationship between Boltzmann entropy and information…

General Physics · Physics 2007-12-22 C. G. Chakrabarti , Indranil Chakrabarty

The de Bruijn identity states that Fisher information is equal to a half of the time-derivative of Shannon differential entropy along heat flow. In the same spirit, a generalized version of Fisher information, which we term the…

Information Theory · Computer Science 2025-06-12 Hao Wu , Lei Yu

We study the two dimensional system influenced by a non-central potential consisting of a Kratzer potential with a dipole moment, along with a vector potential of the Aharonov-Bohm (AB) effect. We explore various information theoretic…

Quantum Physics · Physics 2024-12-25 Ahmed Becir , Mustafa Moumni

We establish a discrete analog of the R\'enyi entropy comparison due to Bobkov and Madiman. For log-concave variables on the integers, the min entropy is within log e of the usual Shannon entropy. Additionally we investigate the entropic…

Probability · Mathematics 2021-06-01 James Melbourne , Tomasz Tkocz

Observational entropy -- a quantity that unifies Boltzmann's entropy, Gibbs' entropy, von Neumann's macroscopic entropy, and the diagonal entropy -- has recently been argued to play a key role in a modern formulation of statistical…

Quantum Physics · Physics 2026-03-24 Teruaki Nagasawa , Kohtaro Kato , Eyuri Wakakuwa , Francesco Buscemi

Markov Random Field models are powerful tools for the study of complex systems. However, little is known about how the interactions between the elements of such systems are encoded, especially from an information-theoretic perspective. In…

Information Theory · Computer Science 2015-03-19 Alexandre L. M. Levada

Complex systems that are characterized by strong correlations and fat-tailed distribution functions have been argued to be incompatible within the framework of Boltzmann-Gibbs entropy. As an alternative, so-called generalized entropies were…

Statistical Mechanics · Physics 2022-08-15 Rudolf Hanel , Stefan Thurner

We investigate quantitative implications of the notion of log-concavity through a probabilistic interpretation. In particular, we derive concentration inequalities, moment and entropy bounds for random variables satisfying a precise degree…

Probability · Mathematics 2026-02-19 Arnaud Marsiglietti , James Melbourne

We establish a reversal of Lyapunov's inequality for monotone log-concave sequences, settling a conjecture of Havrilla-Tkocz and Melbourne-Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also…

Information Theory · Computer Science 2021-11-16 James Melbourne , Gerardo Palafox-Castillo

Let $S(\rho)=- Tr (\rho \log\rho)$ be the von Neumann entropy of an $N$-dimensional quantum state $\rho$ and $e_2(\rho)$ the second elementary symmetric polynomial of the eigenvalues of $\rho$. We prove the inequality $S(\rho) \le c(N)…

Quantum Physics · Physics 2009-05-22 Meik Hellmund , Armin Uhlmann

We prove an exponential deviation inequality for the convex hull of a finite sample of i.i.d. random points with a density supported on an arbitrary convex body in $\R^d$, $d\geq 2$. When the density is uniform, our result yields rate…

Probability · Mathematics 2017-04-07 Victor-Emmanuel Brunel