English
Related papers

Related papers: On $f$-divergences between Cauchy distributions

200 papers

By calculating the Kullback-Leibler divergence between two probability measures belonging to different exponential families, we end up with a formula that generalizes the ordinary Fenchel-Young divergence. Inspired by this formula, we…

Information Theory · Computer Science 2024-12-20 Frank Nielsen

We prove that the sequence of cones of metric measure spaces converges if the sequence of base spaces converges in Gromov's box, concentration, and weak topologies. As an application, we show that the generalized Cauchy distribution with…

Metric Geometry · Mathematics 2024-02-23 Syota Esaki , Daisuke Kazukawa , Ayato Mitsuishi

In previous work the authors defined the k-th order simplicial distance between probability distributions which arises naturally from a measure of dispersion based on the squared volume of random simplices of dimension k. This theory is…

Statistics Theory · Mathematics 2018-09-06 Luc Pronzato , Henry Wynn , Anatoly Zhigljavsky

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko

In this short note, we extend the linear convergence result of the Cauchy algorithm, derived recently by E. Klerk, F. Glineur, and A. Taylor, from the case of smooth strongly convex functions to the case of restricted strongly convex…

Optimization and Control · Mathematics 2016-11-02 Hui Zhang

This work establishes computable bounds between f-divergences for probability measures within a generalized quasi-$\varepsilon_{(M,m)}$-neighborhood framework. We make the following key contributions. (1) a unified characterization of local…

Information Theory · Computer Science 2025-08-12 Xinchun Yu , Shuangqing Wei , Xiao-Ping Zhang

It is well-known that each statistic in the family of power divergence statistics, across $n$ trials and $r$ classifications with index parameter $\lambda\in\mathbb{R}$ (the Pearson, likelihood ratio and Freeman-Tukey statistics correspond…

Statistics Theory · Mathematics 2021-12-28 Robert E. Gaunt

We report closed-form formula for calculating the Chi square and higher-order Chi distances between statistical distributions belonging to the same exponential family with affine natural space, and instantiate those formula for the Poisson…

Information Theory · Computer Science 2015-06-17 Frank Nielsen , Richard Nock

In this work we introduce a family of transformations, named \textit{divergence transformations}, interpolating between any pair of probability density functions sharing the same support. We prove the remarkable property that the whole…

Mathematical Physics · Physics 2025-12-15 Razvan Gabriel Iagar , David Puertas-Centeno , Elio V. Toranzo

In the field of statistics, many kind of divergence functions have been studied as an amount which measures the discrepancy between two probability distributions. In the differential geometrical approach in statistics (information…

Methodology · Statistics 2018-09-11 Tomohiro Nishiyama

Estimating the Kullback-Leibler (KL) divergence between two distributions given samples from them is well-studied in machine learning and information theory. Motivated by considerations of multi-group fairness, we seek KL divergence…

Machine Learning · Computer Science 2022-03-01 Parikshit Gopalan , Nina Narodytska , Omer Reingold , Vatsal Sharan , Udi Wieder

In this paper we consider one parameter generalizations of some non - symmetric divergence measures. Measures are \textit{relative information}, $\chi ^2 - $\textit{divergence}, \textit{relative J-divergence}, \textit{relative…

Statistics Theory · Mathematics 2007-06-13 Inder Jeet Taneja , Pranesh Kumar

We introduce a new transformation called \emph{relative differential-escort}, which extends the usual differential-escort transformation by relating the change of variable to a reference probability density. As an application of it, we…

Mathematical Physics · Physics 2025-07-24 Razvan Gabriel Iagar , David Puertas-Centeno , Elio V. Toranzo

In this work, a mode of convergence for measurable functions is introduced. A related notion of Cauchy sequence is given and it is proved that this notion of convergence is complete in the sense that Cauchy sequences converge. Moreover, the…

Classical Analysis and ODEs · Mathematics 2024-04-17 Nuno J. Alves , João Paulos

In this paper we provide the asymptotic theory of the general of $\phi$-divergences measures, which include the most common divergence measures : Renyi and Tsallis families and the Kullback-Leibler measure. We are interested in divergence…

Statistics Theory · Mathematics 2019-04-01 Ba Amadou Diadie , Gane Samb Lo

In this paper, we consider the problem of estimating the density function of a Chi-squared variable on the basis of observations of another Chi-squared variable and a normal variable under the Kullback-Leibler divergence. We assume that…

Statistics Theory · Mathematics 2021-07-22 Yasuyuki Hamura , Tatsuya Kubokawa

Exact expressions are given for the distribution function of the ratio of a weighted sum of independent chi-squared variables to a single chi-square variable, scaled appropriately. This distribution is the generalization of the classical F…

Classical Analysis and ODEs · Mathematics 2011-03-30 Charles F. Dunkl , Donald E. Ramirez

\cite{tsagris2025a} proposed the generalized circular projected Cauchy (GCPC) distribution, whose special case is the wrapped Cauchy distribution. In this paper we first derive the relationship with the wrapped Cauchy distribution, and then…

Statistics Theory · Mathematics 2026-03-26 Omar Alzeley , Michail Tsagris

Parabolic integro-differential model Cauchy problem is considered in the scale of Lp -spaces of functions whose regularity is defined by a scalable Levy measure. Existence and uniqueness of a solution is proved by deriving apriori…

Probability · Mathematics 2017-05-26 R. Mikulevicius , C. Phonsom

To ensure stability of learning, state-of-the-art generalized policy iteration algorithms augment the policy improvement step with a trust region constraint bounding the information loss. The size of the trust region is commonly determined…

Machine Learning · Computer Science 2018-04-05 Boris Belousov , Jan Peters