English
Related papers

Related papers: Geometry of escort distributions

200 papers

Modern applications of Bayesian inference involve models that are sufficiently complex that the corresponding posterior distributions are intractable and must be approximated. The most common approximation is based on Markov chain Monte…

Machine Learning · Statistics 2019-05-15 Yue Yang , Ryan Martin , Howard Bondell

In the present work, we show how the generalized Cram\'er-Rao inequality for the estimation of a parameter, presented in a recent paper, can be extended to the mutidimensional case with general norms on $\mathbb{R}^{n}$, and to a wider…

Mathematical Physics · Physics 2013-02-26 J. -F. Bercher

We study quasi-Newton methods from the viewpoint of information geometry induced associated with Bregman divergences. Fletcher has studied a variational problem which derives the approximate Hessian update formula of the quasi-Newton…

Computation · Statistics 2010-10-15 Takafumi Kanamori , Atsumi Ohara

This is a review of the ideas behind the Fisher--Rao metric on classical probability distributions, and how they generalize to metrics on density matrices. As is well known, the unique Fisher--Rao metric then becomes a large family of…

Quantum Physics · Physics 2015-06-26 Ingemar Bengtsson

I define a natural measure of the complexity of a parametric distribution relative to a given true distribution called the {\it razor} of a model family. The Minimum Description Length principle (MDL) and Bayesian inference are shown to…

adap-org · Physics 2008-02-03 Vijay Balasubramanian

The task of parametric model selection is cast in terms of a statistical mechanics on the space of probability distributions. Using the techniques of low-temperature expansions, we arrive at a systematic series for the Bayesian posterior…

Condensed Matter · Physics 2008-02-03 Vijay Balasubramanian

The Fisher's information metric is introduced in order to find the real meaning of the probability distribution in classical and quantum systems described by Riemaniann non-degenerated superspaces. In particular, the physical r\^{o}le…

High Energy Physics - Theory · Physics 2012-12-04 Diego Julio Cirilo-Lombardo , Victor I. Afonso

The space of probability densities is an infinite-dimensional Riemannian manifold, with Riemannian metrics in two flavors: Wasserstein and Fisher--Rao. The former is pivotal in optimal mass transport (OMT), whereas the latter occurs in…

Differential Geometry · Mathematics 2017-11-21 Klas Modin

In the world of generalized entropies---which, for example, play a role in physical systems with sub- and super-exponential phasespace growth per degree of freedom---there are two ways for implementing constraints in the maximum entropy…

Mathematical Physics · Physics 2019-02-20 Jan Korbel , Rudolf Hanel , Stefan Thurner

A statistical model M is a family of probability distributions, characterised by a set of continuous parameters known as the parameter space. This possesses natural geometrical properties induced by the embedding of the family of…

General Relativity and Quantum Cosmology · Physics 2009-10-30 Dorje C. Brody , Lane P. Hughston

In this paper, we study the geometry induced by the Fisher-Rao metric on the parameter space of Dirichlet distributions. We show that this space is geodesically complete and has everywhere negative sectional curvature. An important…

Differential Geometry · Mathematics 2020-11-20 Alice Le Brigant , Stephen Preston , Stéphane Puechmorel

The Fisher information metric or the Fisher-Rao metric corresponds to a natural Riemannian metric defined on a parameterized family of probability density functions. As in the case of Riemannian geometry, we can define a distance in terms…

Differential Geometry · Mathematics 2024-05-30 Emmanuel Gnandi

We present a simple method to approximate Rao's distance between multivariate normal distributions based on discretizing curves joining normal distributions and approximating Rao's distances between successive nearby normal distributions on…

Information Theory · Computer Science 2023-04-20 Frank Nielsen

We conduct a KL-divergence based procedure for testing elliptical distributions. The procedure simultaneously takes into account the two defining properties of an elliptically distributed random vector: independence between length and…

Methodology · Statistics 2025-11-04 Yin Tang , Yanyuan Ma , Bing Li

Variance and Fisher information are ingredients of the Cramer-Rao inequality. We regard Fisher information as a Riemannian metric on a quantum statistical manifold and choose monotonicity under coarse graining as the fundamental property of…

Quantum Physics · Physics 2009-11-07 Denes Petz

The Fisher-Rao distance between two probability distributions of a statistical model is defined as the Riemannian geodesic distance induced by the Fisher information metric. In order to calculate the Fisher-Rao distance in closed-form, we…

Information Theory · Computer Science 2025-01-08 Frank Nielsen

In information geometry, statistical models are considered as differentiable manifolds, where each probability distribution represents a unique point on the manifold. A Riemannian metric can be systematically obtained from a divergence…

Statistics Theory · Mathematics 2025-07-29 Satyajit Dhadumia , M. Ashok Kumar

Escort mean values (or $q$-moments) constitute useful theoretical tools for describing basic features of some probability densities such as those which asymptotically decay like {\it power laws}. They naturally appear in the study of many…

Statistical Mechanics · Physics 2015-05-13 Constantino Tsallis , Angel R. Plastino , Ramon F. Alvarez-Estrada

Wasserstein geometry and information geometry are two important structures to be introduced in a manifold of probability distributions. Wasserstein geometry is defined by using the transportation cost between two distributions, so it…

Statistics Theory · Mathematics 2021-01-01 Shun-ichi Amari , Takeru Matsuda

We study the statistical geometry of random chords on n-dimensional spheres by deriving explicit analytical expressions for the chord length distribution and its associated structural properties. A critical threshold emerges at dimension…

Probability · Mathematics 2025-06-25 Masoud Ataei