English
Related papers

Related papers: On log-sum inequalities

200 papers

Divergences often play important roles for study in information science so that it is indispensable to investigate their fundamental properties. There is also a mathematical significance of such results. In this paper, we introduce some…

Statistical Mechanics · Physics 2011-10-19 S. Furuichi , F. -C. Mitroi

The matrix version of the entropy-power inequality for real or complex coefficients and variables is proved using a transportation argument that easily settles the equality case. An application to blind source extraction is given.

Information Theory · Computer Science 2019-06-04 Olivier Rioul , Ram Zamir

We present inequalities related to generalized matrix function for positive semidefinite block matrices. We introduce partial generalized matrix functions corresponding to partial traces, and then provide a unified extension of the recent…

Functional Analysis · Mathematics 2022-07-05 Yang Huang , Yongtao Li , Lihua Feng , Weijun Liu

We prove the \emph{sum of squared logarithms inequality} (SSLI) which states that for nonnegative vectors $x, y \in \mathbb{R}^n$ whose elementary symmetric polynomials satisfy $e_k(x)\le e_k(y)$ (for $1\le k < n$) and $e_n(x)=e_n(y)$, the…

Classical Analysis and ODEs · Mathematics 2015-11-03 Lev Borisov , Patrizio Neff , Suvrit Sra , Christian Thiel

We investigate quantitative implications of the notion of log-concavity through a probabilistic interpretation. In particular, we derive concentration inequalities, moment and entropy bounds for random variables satisfying a precise degree…

Probability · Mathematics 2026-02-19 Arnaud Marsiglietti , James Melbourne

Classical latent-score ranking models often fail to distinguish objects' intrinsic scores from contextual effects, which are typically nonlinear and can dominate the observed outcomes. To address this, we introduce a semiparametric ranking…

Methodology · Statistics 2026-04-22 Yuanhang Luo , Shuxing Fang , Ruijian Han , Yiming Xu

The exponential inequality of the maximum partial sums is a key to establish the law of the iterated logarithm of negatively associated random variables. In the one-indexed random sequence case, such inequalities for negatively associated…

Probability · Mathematics 2007-05-23 Li Xin Zhang

Integral representations of quantum relative entropy, and of the directional second and higher order derivatives of von Neumann entropy, are established, and used to give simple proofs of fundamental, known data processing inequalities: the…

Quantum Physics · Physics 2023-09-13 Péter E. Frenkel

Functional inequalities such as the Poincar\'e and log-Sobolev inequalities quantify convergence to equilibrium in continuous-time Markov chains by linking generator properties to variance and entropy decay. However, many applications,…

Probability · Mathematics 2026-02-20 Bastian Hilder , Patrick van Meurs , Upanshu Sharma

New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Andrew Barron

The asymptotic log-Harnack inequality is established for several different models of stochastic differential systems with infinite memory: non-degenerate SDEs, Neutral SDEs, semi-linear SPDEs, and stochastic Hamiltonian systems. As…

Probability · Mathematics 2018-09-10 Jianhai Bao , Feng-Yu Wang , Chenggui Yuan

The conditional entropy power inequality is a fundamental inequality in information theory, stating that the conditional entropy of the sum of two conditionally independent vector-valued random variables each with an assigned conditional…

Quantum Physics · Physics 2019-02-01 Giacomo De Palma

We are concerned with log-majorization for matrices in connection with the multivariate Golden--Thompson trace inequality and the Karcher mean (i.e., a multivariate extension of the weighted geometric mean). We show an extension of Araki's…

Functional Analysis · Mathematics 2024-05-17 Fumio Hiai

We establish a quantum version of the classical isoperimetric inequality relating the Fisher information and the entropy power of a quantum state. The key tool is a Fisher information inequality for a state which results from a certain…

Quantum Physics · Physics 2017-02-16 Stefan Huber , Robert Koenig , Anna Vershynina

We establish a reversal of Lyapunov's inequality for monotone log-concave sequences, settling a conjecture of Havrilla-Tkocz and Melbourne-Tkocz. A strengthened version of the same conjecture is disproved through counter example. We also…

Information Theory · Computer Science 2021-11-16 James Melbourne , Gerardo Palafox-Castillo

We prove inequalities on non-integer powers of products of generalized matrices functions on the sum of positive semi-definite matrices. For example, for any real number $r \in \{1\} \cup [2, \infty)$, positive semi-definite matrices $A_i,\…

Functional Analysis · Mathematics 2016-09-01 Shaowu Huang , Chi-Kwong Li , Yiu-Tung Poon , Qing-Wen Wang

The R{\'e}nyi entropy is one of the important information measures that generalizes Shannon's entropy. The quantum R{\'e}nyi entropy has a fundamental role in quantum information theory, therefore, bounding this quantity is of vital…

Mathematical Physics · Physics 2016-09-26 Hadi Reisizadeh , S. Mahmoud Manjegani

In this work, conditional entropy is used to quantify the information loss induced by passing a continuous random variable through a memoryless nonlinear input-output system. We derive an expression for the information loss depending on the…

Information Theory · Computer Science 2012-02-03 Bernhard C. Geiger , Christian Feldbauer , Gernot Kubin

It is known that differences of symmetric functions corresponding to various bases are nonnegative on the nonnegative orthant exactly when the partitions defining them are comparable in dominance order. The only exception is the case of…

Combinatorics · Mathematics 2020-11-18 Alexander Heaton , Isabelle Shankar

The number of non-negative integer matrices with given row and column sums appears in a variety of problems in mathematics and statistics but no closed-form expression for it is known, so we rely on approximations of various kinds. Here we…

Computation · Statistics 2024-01-25 Maximilian Jerdee , Alec Kirkley , M. E. J. Newman