English
Related papers

Related papers: Inequalities Among Symmetric Divergence Measures a…

200 papers

There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber J-divergence. Sibson-Burbea-Rao Jensen-Shannon divegernce and Taneja arithemtic-geometric…

Information Theory · Computer Science 2011-09-27 Inder Jeet Taneja

There are three classical divergence measures known in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber \cite{jef} \cite{kul} \textit{J-divergence}. Sibson-Burbea-Rao \cite{sib} \cite{bur1,…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja

There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber J-divergence. Sibson-Burbea-Rao Jensen-Shannon divegernce and Taneja Arithmetic-Geometric…

Information Theory · Computer Science 2011-04-01 Inder Jeet Taneja

In this paper we have considered two one parametric generalizations. These two generalizations have in articular the well known measures such as: J-divergence, Jensen-Shannon divergence and Arithmetic-Geometric mean divergence. These three…

Information Theory · Computer Science 2011-05-02 Inder Jeet Taneja

In this paper we have considered a single inequality having 11 known divergence measures. This inequality include measures like: Jeffryes-Kullback-Leiber J-divergence, Jensen-Shannon divergence (Burbea-Rao, 1982), arithmetic-geometric mean…

Information Theory · Computer Science 2012-05-08 Inder Jeet Taneja

Arithmetic, geometric and harmonic means are the three classical means famous in the literature. Another mean such as square-root mean is also known. In this paper, we have constructed divergence measures based on nonnegative differences…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leibler (1951) relative information and Jeffreys (1951) J-divergence. Sibson (1969)…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leiber's (1951)relative information and Jeffreys (1946) J-divergence, Information…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leiber relative information and Jeffreys J-divergence. The measures like, Bhattacharya…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

Recently, Taneja studied two one parameter generalizations of J-divergence, Jensen-Shannon divergence and Arithmetic-Geometric divergence. These two generalizations in particular contain measures like: Hellinger discrimination, symmetric…

Information Theory · Computer Science 2011-05-16 G. A. T. F. da Costa , Inder Jeet Taneja

In this paper we shall consider one parametric generalization of some non-symmetric divergence measures. The \textit{non-symmetric divergence measures} are such as: Kullback-Leibler \textit{relative information}, $\chi…

Statistics Theory · Mathematics 2007-06-13 Pranesh Kumar , Inder Jeet Taneja

In this paper we consider one parameter generalizations of some non - symmetric divergence measures. Measures are \textit{relative information}, $\chi ^2 - $\textit{divergence}, \textit{relative J-divergence}, \textit{relative…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja , Pranesh Kumar

This paper extends the asymmetric Kullback-Leibler divergence and symmetric Jensen-Shannon divergence from two probability measures to the case of two sets of probability measures. We establish some fundamental properties of these…

Probability · Mathematics 2025-10-31 Xinpeng Li , Miao Yu

The Jensen-Shannon divergence is a renown bounded symmetrization of the unbounded Kullback-Leibler divergence which measures the total Kullback-Leibler divergence to the average mixture distribution. However the Jensen-Shannon divergence…

Information Theory · Computer Science 2022-09-21 Frank Nielsen

Jensen-Shannon divergence (JD) is a symmetrized and smoothed version of the most important divergence measure of information theory, Kullback divergence. As opposed to Kullback divergence it determines in a very direct way a metric; indeed,…

Quantum Physics · Physics 2009-05-14 Jop Briët , Peter Harremoës

We introduce a divergence measure between data distributions based on operators in reproducing kernel Hilbert spaces defined by kernels. The empirical estimator of the divergence is computed using the eigenvalues of positive definite Gram…

Machine Learning · Computer Science 2023-05-31 Jhoan Keider Hoyos Osorio , Oscar Skean , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

In this paper we have considered a difference of Jensen's inequality for convex functions and proved some of its properties. In particular, we have obtained results for Csisz\'{a}r \cite{csi1} $f-$divergence. A result is established that…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja

This work studies the Geometric Jensen-Shannon divergence, based on the notion of geometric mean of probability measures, in the setting of Gaussian measures on an infinite-dimensional Hilbert space. On the set of all Gaussian measures…

Probability · Mathematics 2025-06-13 Minh Ha Quang , Frank Nielsen

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler…

Statistics Theory · Mathematics 2013-10-16 Adityanand Guntuboyina , Sujayam Saha , Geoffrey Schiebinger

In this paper, we introduce new classes of divergences by extending the definitions of the Bregman divergence and the skew Jensen divergence. These new divergence classes (g-Bregman divergence and skew g-Jensen divergence) satisfy some…

Statistics Theory · Mathematics 2018-09-21 Tomohiro Nishiyama
‹ Prev 1 2 3 10 Next ›