English
Related papers

Related papers: Metric Properties: From $S$-Divergence to Quantum …

200 papers

We study metric properties of symmetric divergences on Hermitian positive definite matrices. In particular, we prove that the square root of these divergences is a distance metric. As a corollary we obtain a proof of the metric property for…

Information Theory · Computer Science 2019-12-17 Suvrit Sra

In this short note, we prove that the square root of the quantum Jensen-Shannon divergence is a true metric on the cone of positive matrices, and hence in particular on the quantum state space.

Mathematical Physics · Physics 2021-01-25 Dániel Virosztek

Jensen-Shannon divergence is a well known multi-purpose measure of dissimilarity between probability distributions. It has been proven that the square root of this quantity is a true metric in the sense that, in addition to the basic…

Mathematical Physics · Physics 2018-01-17 Tristán M. Osán , Diego G. Bussandri , Pedro W. Lamberti

Motivated by a recent result on finite-dimensional Hilbert spaces, we prove a Jensen's inequality for partial traces in semifinite von Neumann algebras. We also prove a similar inequality in the framework of general (non-tracial) von…

Operator Algebras · Mathematics 2026-03-11 Mizanur Rahaman , Lyudmila Turowska

Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback divergence it determines in a very direct way a metric; indeed,…

Quantum Physics · Physics 2009-05-14 Jop Briët , Peter Harremoës

This work studies the Geometric Jensen-Shannon divergence, based on the notion of geometric mean of probability measures, in the setting of Gaussian measures on an infinite-dimensional Hilbert space. On the set of all Gaussian measures…

Probability · Mathematics 2025-06-13 Minh Ha Quang , Frank Nielsen

Positive definite matrices abound in a dazzling variety of applications. This ubiquity can be in part attributed to their rich geometric structure: positive definite matrices form a self-dual convex cone whose strict interior is a…

Functional Analysis · Mathematics 2013-12-31 Suvrit Sra

We introduce a divergence measure between data distributions based on operators in reproducing kernel Hilbert spaces defined by kernels. The empirical estimator of the divergence is computed using the eigenvalues of positive definite Gram…

Machine Learning · Computer Science 2023-05-31 Jhoan Keider Hoyos Osorio , Oscar Skean , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

The Jensen-Shannon divergence is a renown bounded symmetrization of the unbounded Kullback-Leibler divergence which measures the total Kullback-Leibler divergence to the average mixture distribution. However the Jensen-Shannon divergence…

Information Theory · Computer Science 2022-09-21 Frank Nielsen

Jensen's trace inequality is established for every multivariable, convex function and every trace or trace-like functional on a C*-algebra.

Operator Algebras · Mathematics 2007-05-23 Frank Hansen , Gert K. Pedersen

We first introduce the class of strictly quasiconvex and strictly quasiconcave Jensen divergences which are oriented (asymmetric) distances, and study some of their properties. We then define the strictly quasiconvex Bregman divergences as…

Information Theory · Computer Science 2019-10-08 Frank Nielsen , Gaëtan Hadjeres

This is a continuation of our previous paper. We consider a certain order-like relation for positive operators on a Hilbert space. This relation is defined by using the Jensen inequality with respect to the square-root function. We show…

Functional Analysis · Mathematics 2012-03-07 Tomohiro Hayashi

In this paper we study the metric geometry of the space $\Sigma$ of positive invertible elements of a von Neumann algebra ${\mathcal A}$ with a finite, normal and faithful tracial state $\tau$. The trace induces an incomplete Riemannian…

Differential Geometry · Mathematics 2008-08-14 Esteban Andruchow , Gabriel Larotonda

In this paper we shall consider one parametric generalization of some non-symmetric divergence measures. The \textit{non-symmetric divergence measures} are such as: Kullback-Leibler \textit{relative information}, $\chi…

Statistics Theory · Mathematics 2007-06-13 Pranesh Kumar , Inder Jeet Taneja

Motivated by the geometrical structures of quantum mechanics, we introduce an almost-complex structure $J$ on the product $M\times M$ of any parallelizable statistical manifold $M$. Then, we use $J$ to extract a pre-symplectic form and a…

Quantum Physics · Physics 2020-05-19 Florio M. Ciaglia , Fabio Di Cosmo , Armando Figueroa , Giuseppe Marmo , Luca Schiavone

We prove a matrix inequality for convex functions of a Hermitian matrix on a bipartite space. As an application we reprove and extend some theorems about eigenvalue asymptotics of Schr\"odinger operators with homogeneous potentials. The…

Mathematical Physics · Physics 2025-02-14 Eric A. Carlen , Rupert L. Frank , Simon Larson

In this paper we point out a converse result of the celebrated Jensen inequality for differentiable convex mappings of several variables and apply it to counterpart well-known analytic inequalities. Applications to Shannon's and Renyi's…

Classical Analysis and ODEs · Mathematics 2007-05-23 Sever Silvestru Dragomir

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leibler (1951) relative information and Jeffreys (1951) J-divergence. Sibson (1969)…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

Convexity is a key concept in information theory, namely via the many implications of Jensen's inequality, such as the non-negativity of the Kullback-Leibler divergence (KLD). Jensen's inequality also underlies the concept of Jensen-Shannon…

Information Theory · Computer Science 2008-04-11 Andre Martins , Pedro Aguiar , Mario Figueiredo

Recently, Taneja studied two one parameter generalizations of J-divergence, Jensen-Shannon divergence and Arithmetic-Geometric divergence. These two generalizations in particular contain measures like: Hellinger discrimination, symmetric…

Information Theory · Computer Science 2011-05-16 G. A. T. F. da Costa , Inder Jeet Taneja
‹ Prev 1 2 3 10 Next ›