English
Related papers

Related papers: Properties of Classical and Quantum Jensen-Shannon…

200 papers

We discuss an alternative to relative entropy as a measure of distance between mixed quantum states. The proposed quantity is an extension to the realm of quantum theory of the Jensen-Shannon divergence (JSD) between probability…

Quantum Physics · Physics 2009-11-11 A. P. Majtey , P. W. Lamberti , D. P. Prato

The notion of distance in Hilbert space is relevant in many scenarios. In particular, distances between quantum states play a central role in quantum information theory. An appropriate measure of distance is the quantum Jensen Shannon…

Quantum Physics · Physics 2008-04-24 A. P. Majtey , A. Borras , M. Casas , P. W. Lamberti , A. Plastino

In a recent paper, the generalization of the Jensen Shannon divergence (JSD) in the context of quantum theory has been studied (Phys. Rev. A 72, 052310 (2005)). This distance between quantum states has shown to verify several of the…

Quantum Physics · Physics 2009-11-13 P. W. Lamberti , A. P. Majtey , A. Borras , M. Casas , A. Plastino

The Jensen-Shannon divergence is a renown bounded symmetrization of the unbounded Kullback-Leibler divergence which measures the total Kullback-Leibler divergence to the average mixture distribution. However the Jensen-Shannon divergence…

Information Theory · Computer Science 2022-09-21 Frank Nielsen

Convexity is a key concept in information theory, namely via the many implications of Jensen's inequality, such as the non-negativity of the Kullback-Leibler divergence (KLD). Jensen's inequality also underlies the concept of Jensen-Shannon…

Information Theory · Computer Science 2008-04-11 Andre Martins , Pedro Aguiar , Mario Figueiredo

We study metric properties of symmetric divergences on Hermitian positive definite matrices. In particular, we prove that the square root of these divergences is a distance metric. As a corollary we obtain a proof of the metric property for…

Information Theory · Computer Science 2019-12-17 Suvrit Sra

The Jensen-Shannon divergence is a renown bounded symmetrization of the Kullback-Leibler divergence which does not require probability densities to have matching supports. In this paper, we introduce a vector-skew generalization of the…

Information Theory · Computer Science 2020-10-01 Frank Nielsen

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leibler (1951) relative information and Jeffreys (1951) J-divergence. Sibson (1969)…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

The notion of distinguishability between quantum states has shown to be fundamental in the frame of quantum information theory. In this paper we present a new distinguishability criterium by using a information theoretic quantity: the…

Quantum Physics · Physics 2016-09-08 A. P. Majtey , P. W. Lamberti , M. T. Martin , A. Plastino

Jensen-Shannon divergence is a well known multi-purpose measure of dissimilarity between probability distributions. It has been proven that the square root of this quantity is a true metric in the sense that, in addition to the basic…

Mathematical Physics · Physics 2018-01-17 Tristán M. Osán , Diego G. Bussandri , Pedro W. Lamberti

Quantifying the difference between probability distributions is crucial in machine learning. However, estimating statistical divergences from empirical samples is challenging due to unknown underlying distributions. This work proposes the…

Machine Learning · Computer Science 2024-10-25 Jhoan K. Hoyos-Osorio , Luis G. Sanchez-Giraldo

In this short note, we prove that the square root of the quantum Jensen-Shannon divergence is a true metric on the cone of positive matrices, and hence in particular on the quantum state space.

Mathematical Physics · Physics 2021-01-25 Dániel Virosztek

We discuss different statistical distances in probability space, with emphasis on the Jensen-Shannon divergence, vis-a-vis {\it metrics} in Hilbert space and their relationship with Fisher's information measure. This study provides further…

Quantum Physics · Physics 2007-05-23 M. Casas , P. W. Lamberti , A. Plastino , A. R. Plastino

There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber J-divergence. Sibson-Burbea-Rao Jensen-Shannon divegernce and Taneja Arithmetic-Geometric…

Information Theory · Computer Science 2011-04-01 Inder Jeet Taneja

We extend the trace-logarithmic $S$-divergence from matrices to tracial $C^*$-algebras and finite von Neumann algebras, and show that its square root defines a metric on the invertible positive cone. We also prove an integral representation…

Operator Algebras · Mathematics 2026-02-10 Teng Zhang

There are three classical divergence measures in the literature on information theory and statistics, namely, Jeffryes-Kullback-Leiber's J-divergence, Sibson-Burbea-Rao's Jensen-Shannon divegernce and Taneja's arithemtic-geometric mean…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja

This work studies the Geometric Jensen-Shannon divergence, based on the notion of geometric mean of probability measures, in the setting of Gaussian measures on an infinite-dimensional Hilbert space. On the set of all Gaussian measures…

Probability · Mathematics 2025-06-13 Minh Ha Quang , Frank Nielsen

Recently, Taneja studied two one parameter generalizations of J-divergence, Jensen-Shannon divergence and Arithmetic-Geometric divergence. These two generalizations in particular contain measures like: Hellinger discrimination, symmetric…

Information Theory · Computer Science 2011-05-16 G. A. T. F. da Costa , Inder Jeet Taneja

The measure of Jensen-Fisher divergence between probability distributions is introduced and its theoretical grounds set up. This quantity, in contrast to the remaining Jensen divergences, is very sensitive to the fluctuations of the…

Information Theory · Computer Science 2013-01-08 P. Sánchez-Moreno , A. Zarzo , J. S. Dehesa

In this paper we shall consider one parametric generalization of some non-symmetric divergence measures. The \textit{non-symmetric divergence measures} are such as: Kullback-Leibler \textit{relative information}, $\chi…

Statistics Theory · Mathematics 2007-06-13 Pranesh Kumar , Inder Jeet Taneja
‹ Prev 1 2 3 10 Next ›