English
Related papers

Related papers: Metrization of powers of the Jensen-Shannon diverg…

200 papers

We study metric properties of symmetric divergences on Hermitian positive definite matrices. In particular, we prove that the square root of these divergences is a distance metric. As a corollary we obtain a proof of the metric property for…

Information Theory · Computer Science 2019-12-17 Suvrit Sra

Denote by {$\times$} the fractional part. We establish several new metrical results on the distribution properties of the sequence ({x n }) n$\ge$1. Many of them are presented in a more general framework, in which the sequence of functions…

Number Theory · Mathematics 2017-10-11 Yann Bugeaud , Lingmin Liao , Michal Rams

Jensen-Shannon divergence is a well known multi-purpose measure of dissimilarity between probability distributions. It has been proven that the square root of this quantity is a true metric in the sense that, in addition to the basic…

Mathematical Physics · Physics 2018-01-17 Tristán M. Osán , Diego G. Bussandri , Pedro W. Lamberti

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leibler (1951) relative information and Jeffreys (1951) J-divergence. Sibson (1969)…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

We investigate fractional moments and expectations of power means of complex-valued random variables by using fractional calculus. We deal with both negative and positive orders of the fractional derivatives. The one-dimensional…

Probability · Mathematics 2024-10-07 Kazuki Okamura , Yoshiki Otobe

It is often necessary to make sampling-based statistical inference about many probability distributions in parallel. Given a finite computational resource, this article addresses how to optimally divide sampling effort between the samplers…

Methodology · Statistics 2015-02-18 Nicholas Heard , Melissa Turcotte

Divergence measures have a long association with statistical inference, machine learning and information theory. The density power divergence and related measures have produced many useful (and popular) statistical procedures, which provide…

Statistics Theory · Mathematics 2022-09-07 Souvik Ray , Subrata Pal , Sumit Kumar Kar , Ayanendranath Basu

We introduce a divergence measure between data distributions based on operators in reproducing kernel Hilbert spaces defined by kernels. The empirical estimator of the divergence is computed using the eigenvalues of positive definite Gram…

Machine Learning · Computer Science 2023-05-31 Jhoan Keider Hoyos Osorio , Oscar Skean , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

Two semimetrics on probability distributions are proposed, given as the sum of differences of expectations of analytic functions evaluated at spatial or frequency locations (i.e, features). The features are chosen so as to maximize the…

Machine Learning · Statistics 2016-10-31 Wittawat Jitkrittum , Zoltan Szabo , Kacper Chwialkowski , Arthur Gretton

We discuss different statistical distances in probability space, with emphasis on the Jensen-Shannon divergence, vis-a-vis {\it metrics} in Hilbert space and their relationship with Fisher's information measure. This study provides further…

Quantum Physics · Physics 2007-05-23 M. Casas , P. W. Lamberti , A. Plastino , A. R. Plastino

In this paper we consider one parameter generalizations of some non - symmetric divergence measures. Measures are \textit{relative information}, $\chi ^2 - $\textit{divergence}, \textit{relative J-divergence}, \textit{relative…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja , Pranesh Kumar

Recently, Taneja studied two one parameter generalizations of J-divergence, Jensen-Shannon divergence and Arithmetic-Geometric divergence. These two generalizations in particular contain measures like: Hellinger discrimination, symmetric…

Information Theory · Computer Science 2011-05-16 G. A. T. F. da Costa , Inder Jeet Taneja

This paper extends the asymmetric Kullback-Leibler divergence and symmetric Jensen-Shannon divergence from two probability measures to the case of two sets of probability measures. We establish some fundamental properties of these…

Probability · Mathematics 2025-10-31 Xinpeng Li , Miao Yu

In this paper, the concept of the classical $f$-divergence for a pair of measures is extended to the mixed $f$-divergence for multiple pairs of measures. The mixed $f$-divergence provides a way to measure the difference between multiple…

Probability · Mathematics 2016-06-29 Elisabeth M. Werner , Deping Ye

In this paper, the concept of the classical $f$-divergence (for a pair of measures) is extended to the mixed $f$-divergence (for multiple pairs of measures). The mixed $f$-divergence provides a way to measure the difference between multiple…

Information Theory · Computer Science 2013-04-26 Elisabeth M. Werner , Deping Ye

In this paper we prove exponential inequalities (also called Bernstein's inequality) for fractional martingales. As an immediate corollary, we will discuss weak law of large numbers for fractional martingales under divergence assumption on…

Probability · Mathematics 2012-04-20 Bruno Saussereau

This paper is concerned with the asymptotic behavior of sums of terms which are a test function f evaluated at successive increments of a discretely sampled semimartingale. Typically the test function is a power function (when the power is…

Probability · Mathematics 2007-05-23 Jean Jacod

Divergence functions play a key role as to measure the discrepancy between two points in the field of machine learning, statistics and signal processing. Well-known divergences are the Bregman divergences, the Jensen divergences and the…

Methodology · Statistics 2018-10-09 Tomohiro Nishiyama

We study the well-posedness of a semilinear fractional diffusion equation and formulate an associated inverse problem. We determine fractional power type nonlinearities from the exterior partial measurements of the Dirichlet-to-Neumann map.…

Analysis of PDEs · Mathematics 2022-03-30 Li Li

This paper considers derivation of $f$-divergence inequalities via the approach of functional domination. Bounds on an $f$-divergence based on one or several other $f$-divergences are introduced, dealing with pairs of probability measures…

Information Theory · Computer Science 2016-10-31 Igal Sason , Sergio Verdú
‹ Prev 1 2 3 10 Next ›