English
Related papers

Related papers: Information Geometry for the Working Information T…

200 papers

In this survey, we describe the fundamental differential-geometric structures of information manifolds, state the fundamental theorem of information geometry, and illustrate some use cases of these information manifolds in information…

Machine Learning · Computer Science 2020-10-01 Frank Nielsen

This paper is about Information Geometry, a relatively new subject within mathematical statistics that attempts to study the problem of inference by using tools from modern differential geometry. This paper provides an overview of some of…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Carlos C. Rodriguez

This paper lays the foundations for a unified framework for numerically and computationally applying methods drawn from a range of currently distinct geometrical approaches to statistical modelling. In so doing, it extends information…

Statistics Theory · Mathematics 2012-09-11 Karim Anaya-Izquierdo , Frank Critchley , Paul Marriott , Paul W. Vos

We review basic notions in the field of information geometry such as Fisher metric on statistical manifold, $\alpha$-connection and corresponding curvature following Amari's work . We show application of information geometry to asymptotic…

Statistics Theory · Mathematics 2014-10-14 Mashbat Suzuki

Information geometry is used to quantify the amount of information integration within multiple terminals of a causal dynamical system. Integrated information quantifies how much information is lost when a system is split into parts and…

Information Theory · Computer Science 2017-09-08 Shun-ichi Amari , Naotsugu Tsuchiya , Masafumi Oizumi

The manifold of empirical mean values of statistical data ad infinitum has a geometric shape that depends on the probability measure that governs the generating model. Large deviation theory produces entropy functions that depend on both…

Information Theory · Computer Science 2026-05-07 Viswa Virinchi Muppirala , Hong Qian

This introductory text arises from a lecture given in G\"oteborg, Sweden, given by the first author and is intended for undergraduate students, as well as for any mathematically inclined reader wishing to explore a synthesis of ideas…

Differential Geometry · Mathematics 2025-02-18 Noémie C. Combe , Philippe G. Combe , Hanna K. Nencka

In this article, we present recent developments of information geometry, namely, geometry of the Fisher metric, dualistic structures and divergences on the space of probability measures, particularly the theory of geodesics of the Fisher…

Differential Geometry · Mathematics 2022-08-29 Mitsuhiro Itoh , Hiroyasu Satoh

To what extent can we distinguish one probability distribution from another? Are there quantitative measures of distinguishability? The goal of this tutorial is to approach such questions by introducing the notion of the "distance" between…

Data Analysis, Statistics and Probability · Physics 2015-06-23 Ariel Caticha

Information geometry provides differential geometric concepts like a Riemannian metric, connections and covariant derivatives on spaces of probability distributions. We discuss here how these concepts apply to quantum field theories in the…

High Energy Physics - Theory · Physics 2023-04-11 Stefan Floerchinger

In order to analyze and extract different structural properties of distributions, one can introduce different coordinate systems over the manifold of distributions. In Evolutionary Computation, the Walsh bases and the Building Block Bases…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Marc Toussaint

We use the method of maximum entropy to model physical space as a curved statistical manifold. It is then natural to use information geometry to explain the geometry of space. We find that the resultant information metric does not describe…

General Relativity and Quantum Cosmology · Physics 2015-12-31 Ariel Caticha

Wasserstein geometry and information geometry are two important structures introduced in a manifold of probability distributions. The former is defined by using the transportation cost between two distributions, so it reflects the metric…

Statistics Theory · Mathematics 2020-03-13 Shun-ichi Amari

Statistical inference more often than not involves models which are non-linear in the parameters thus leading to non-Gaussian posteriors. Many computational and analytical tools exist that can deal with non-Gaussian distributions, and…

General Relativity and Quantum Cosmology · Physics 2021-01-20 Eileen Giesel , Robert Reischke , Björn Malte Schäfer , Dominic Chia

Information geometry provides a geometric approach to families of statistical models. The key geometric structures are the Fisher quadratic form and the Amari-Chentsov tensor. In statistics, the notion of sufficient statistic expresses the…

Statistics Theory · Mathematics 2015-05-27 Nihat Ay , Jürgen Jost , Hông Vân Lê , Lorenz Schwachhöfer

In this dissertation, an abstract formalism extending information geometry is introduced. This framework encompasses a broad range of modelling problems, including possible applications in machine learning and in the information theoretical…

Mathematical Physics · Physics 2015-01-06 Ben Anthonis

The methods of Information geometry have been glowing up to develop various subjects of theoretical physics, including quantum information systems. The present article has two purposes. The first one is to develop general theory of…

Differential Geometry · Mathematics 2024-08-06 Jun-ichi Inoguchi , Yu Ohno

The introduction of a metric onto the space of parameters in models in Statistical Mechanics and beyond gives an alternative perspective on their phase structure. In such a geometrization, the scalar curvature, R, plays a central role. A…

Statistical Mechanics · Physics 2009-11-10 W. Janke , D. A. Johnston , R. Kenna

Information Geometry has been used to inspire efficient algorithms for stochastic optimization, both in the combinatorial and the continuous case. We give an overview of the authors' research program and some specific contributions to the…

Statistics Theory · Mathematics 2014-03-18 Luigi Malagò , Giovanni Pistone

Choosing the Fisher information as the metric tensor for a Riemannian manifold provides a powerful yet fundamental way to understand statistical distribution families. Distances along this manifold become a compelling measure of statistical…

Statistics Theory · Mathematics 2023-06-05 Brodie A. J. Lawson , Kevin Burrage , Kerrie Mengersen , Rodrigo Weber dos Santos
‹ Prev 1 2 3 10 Next ›