English
Related papers

Related papers: Asymmetric Topologies on Statistical Manifolds

200 papers

This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution $U$ which maximizes the KL…

Machine Learning · Computer Science 2020-12-11 Vincenzo Bonnici

We study a differential geometric construction, the warped product, on the background geometry for information theory. Divergences, dual structures and symmetric 3-tensor are studied under this construction, and we show that warped product…

Differential Geometry · Mathematics 2024-10-28 Nicolás Martínez Alba , Olga Garatejo Escobar

There are many information and divergence measures exist in the literature on information theory and statistics. The most famous among them are Kullback-Leibler (1951) relative information and Jeffreys (1951) J-divergence. Sibson (1969)…

Probability · Mathematics 2007-05-23 Inder Jeet Taneja

Here I present the analytic form of two common distance metrics, the symmetrised Kullback-Leibler Divergence and the Kolmogorov-Smirnov statistic, as well as an extension of the Kolmogorov-Smirnov statistic for comparing theoretical gamma…

Statistics Theory · Mathematics 2018-02-06 Colin M. McCrimmon

We introduce the notion of a topological symmetry as a quantum mechanical symmetry involving a certain topological invariant. We obtain the underlying algebraic structure of the Z_2-graded uniform topological symmetries of type (1,1) and…

High Energy Physics - Theory · Physics 2009-10-31 A. Mostafazadeh , K. Aghababaei Samani

We prove various inequalities measuring how far from an isometry a local map from a manifold of high curvature to a manifold of low curvature must be. We consider the cases of volume-preserving, conformal and quasi-conformal maps. The…

Differential Geometry · Mathematics 2014-03-18 Benoît Kloeckner

Information geometry is a study of statistical manifolds, that is, spaces of probability distributions from a geometric perspective. Its classical information-theoretic applications relate to statistical concepts such as Fisher information,…

Information Theory · Computer Science 2023-10-09 Kumar Vijay Mishra , M. Ashok Kumar , Ting-Kam Leonard Wong

Errors quoted on results are often given in asymmetric form. An account is given of the two ways these can arise in an analysis, and the combination of asymmetric errors is discussed. It is shown that the usual method has no basis and is…

Data Analysis, Statistics and Probability · Physics 2014-11-18 Roger Barlow

The Kullback-Leibler (KL) divergence is a foundational measure for comparing probability distributions. Yet in multivariate settings, its single value often obscures the underlying reasons for divergence, conflating mismatches in individual…

Other Computer Science · Computer Science 2025-05-06 William Cook

Topological phases are generally characterized by topological invariants denoted by integer numbers. However, different topological systems often require different topological invariants to measure, and theses definition usually fail at…

Strongly Correlated Electrons · Physics 2025-01-09 ZhaoXiang Fang , Ming Gong , Guang-Can Guo , Yongxu Fu , Long Xiong

The Kullback-Leibler divergence or relative entropy is an information-theoretic measure between statistical models that play an important role in measuring a distance between random variables. In the study of complex systems, random fields…

Information Theory · Computer Science 2022-03-25 Alexandre L. M. Levada

In this paper, we study the statistical and geometrical properties of the Kullback-Leibler divergence with kernel covariance operators (KKL) introduced by Bach [2022]. Unlike the classical Kullback-Leibler (KL) divergence that involves…

Machine Learning · Statistics 2025-03-12 Clémentine Chazal , Anna Korba , Francis Bach

In information geometry, one of the basic problem is to study the geomet-ric properties of statistical manifold. In this paper, we study the geometricstructure of the generalized normal distribution manifold and show that it has constant…

Differential Geometry · Mathematics 2019-04-05 Mingao Yuan

We present statistical biharmonic maps, a new class of mappings between statistical manifolds naturally derived from a variation problem. We give the Euler-Lagrange equation of this problem and prove that improper affine hyperspheres induce…

Differential Geometry · Mathematics 2026-04-14 Hitoshi Furuhata , Ryu Ueno

In this paper we shall consider one parametric generalization of some non-symmetric divergence measures. The \textit{non-symmetric divergence measures} are such as: Kullback-Leibler \textit{relative information}, $\chi…

Statistics Theory · Mathematics 2007-06-13 Pranesh Kumar , Inder Jeet Taneja

We study quasiisometries between negatively curved homogeneous manifolds associated with diagonalizable derivations on Heisenberg algebras. We classify these manifolds up to quasiisometry, and show that all quasiisometries between such…

Group Theory · Mathematics 2015-06-12 Xiangdong Xie

We study quasi-Newton methods from the viewpoint of information geometry induced associated with Bregman divergences. Fletcher has studied a variational problem which derives the approximate Hessian update formula of the quasi-Newton…

Computation · Statistics 2010-10-15 Takafumi Kanamori , Atsumi Ohara

We derive a deterministic, non-asymptotic upper bound on the Kullback-Leibler (KL) divergence of the flow-matching distribution approximation. In particular, if the $L_2$ flow-matching loss is bounded by $\epsilon^2 > 0$, then the KL…

Machine Learning · Computer Science 2025-11-10 Maojiang Su , Jerry Yao-Chieh Hu , Sophia Pi , Han Liu

The Kullback-Leibler (KL) divergence is frequently used in data science. For discrete distributions on large state spaces, approximations of probability vectors may result in a few small negative entries, rendering the KL divergence…

This paper is a strongly geometrical approach to the Fisher distance, which is a measure of dissimilarity between two probability distribution functions. The Fisher distance, as well as other divergence measures, are also used in many…

Methodology · Statistics 2014-01-13 Sueli I. R. Costa , Sandra A. Santos , João E. Strapasson