English
Related papers

Related papers: The Information-Geometric Perspective of Compositi…

200 papers

When dealing with a parametric statistical model, a Riemannian manifold can naturally appear by endowing the parameter space with the Fisher information metric. The geometry induced on the parameters by this metric is then referred to as…

Machine Learning · Statistics 2023-10-03 Florent Bouchard , Arnaud Breloy , Antoine Collas , Alexandre Renaux , Guillaume Ginolhac

Wasserstein geometry and information geometry are two important structures introduced in a manifold of probability distributions. The former is defined by using the transportation cost between two distributions, so it reflects the metric…

Statistics Theory · Mathematics 2020-03-13 Shun-ichi Amari

In this paper and a companion paper, we show how the framework of information geometry, a geometry of discrete probability distributions, can form the basis of a derivation of the quantum formalism. The derivation rests upon a few…

Quantum Physics · Physics 2010-02-14 Philip Goyal

Information geometry promotes an investigation of the geometric structure of statistical manifolds, providing a series of elucidations in various areas of scientific knowledge. In the physical sciences, especially in quantum theory, this…

Quantum Physics · Physics 2020-12-08 Gabriel F. Magno , Carlos H. Grossi , Gerardo Adesso , Diogo O. Soares-Pinto

In this article, we present recent developments of information geometry, namely, geometry of the Fisher metric, dualistic structures and divergences on the space of probability measures, particularly the theory of geodesics of the Fisher…

Differential Geometry · Mathematics 2022-08-29 Mitsuhiro Itoh , Hiroyasu Satoh

Choosing the Fisher information as the metric tensor for a Riemannian manifold provides a powerful yet fundamental way to understand statistical distribution families. Distances along this manifold become a compelling measure of statistical…

Statistics Theory · Mathematics 2023-06-05 Brodie A. J. Lawson , Kevin Burrage , Kerrie Mengersen , Rodrigo Weber dos Santos

In this paper, we leverage the properties of non-Euclidean Geometry to define the Geodesic distance (GD) on the space of statistical manifolds. The Geodesic distance is a real and intuitive similarity measure that is a good alternative to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Zakariae Abbad , Ahmed Drissi El Maliani , Said Ouatik El Alaoui , Mohammed El Hassouni

We propose a unified theoretical framework for quantifying spatio-temporal interactions in a stochastic dynamical system based on information geometry. In the proposed framework, the degree of interactions is quantified by the divergence…

Neurons and Cognition · Quantitative Biology 2016-12-08 Masafumi Oizumi , Naotsugu Tsuchiya , Shun-ichi Amari

Physical systems behave according to their underlying dynamical equations which, in turn, can be identified from experimental data. Explaining data requires selecting mathematical models that best capture the data regularities. Identifying…

Data Analysis, Statistics and Probability · Physics 2014-03-18 Carlo Cafaro

Optimal transport and information geometry both study geometric structures on spaces of probability distributions. Optimal transport characterizes the cost-minimizing movement from one distribution to another, while information geometry…

Differential Geometry · Mathematics 2021-05-07 Ting-Kam Leonard Wong , Jiaowen Yang

Let (M,g) be a compact, connected and oriented Riemannian manifold. We denote D the space of smooth probability density functions on M. In this paper, we show that the Frechet manifold D is equipped with a Riemannian metric g^{D} and an…

Differential Geometry · Mathematics 2012-04-04 Mathieu Molitor

Information geometry provides a tool to systematically investigate parameter sensitivity of the state of a system. If a physical system is described by a linear combination of eigenstates of a complex (that is, non-Hermitian) Hamiltonian,…

Quantum Physics · Physics 2013-08-26 Dorje C. Brody , Eva-Maria Graefe

Technology of data collection and information transmission is based on various mathematical models of encoding. The words "Geometry of information" refer to such models, whereas the words "Moufang patterns" refer to various sophisticated…

Information Theory · Computer Science 2022-03-03 Noemie Combe , Yuri I. Manin , Matilde Marcolli

Dimensionality reduction is critical across various domains of science including neuroscience. Probabilistic Principal Component Analysis (PPCA) is a prominent dimensionality reduction method that provides a probabilistic approach unlike…

Machine Learning · Computer Science 2025-09-24 Han-Lin Hsieh , Maryam M. Shanechi

In this paper a class of dynamical systems describing expectation variables exactly derived from continuous-time master equations is introduced and studied from the viewpoint of differential geometry, where such master equations consist of…

Mathematical Physics · Physics 2018-11-05 Shin-Itiro Goto , Hideitsu Hino

High-dimensional data with intrinsic low-dimensional structure is ubiquitous in machine learning and data science. While various approaches allow one to learn a data manifold with a Riemannian structure from finite samples, performing…

Optimization and Control · Mathematics 2026-05-07 Willem Diepeveen , Melanie Weber

In this work we: (1) review likelihood-based inference for parameter estimation and the construction of confidence regions; and, (2) explore the use of techniques from information geometry, including geodesic curves and Riemann scalar…

Methodology · Statistics 2022-04-01 Jesse A Sharp , Alexander P Browning , Kevin Burrage , Matthew J Simpson

The manifold of coupling constants parametrizing a quantum Hamiltonian is equipped with a natural Riemannian metric with an operational distinguishability content. We argue that the singularities of this metric are in correspondence with…

Quantum Physics · Physics 2007-05-23 P. Zanardi , P. Giorda , M. Cozzini

It is known that statistical model selection as well as identification of dynamical equations from available data are both very challenging tasks. Physical systems behave according to their underlying dynamical equations which, in turn, can…

Mathematical Physics · Physics 2017-10-11 Sean Alan Ali , Carlo Cafaro

Information theoretic quantities play an important role in various settings in machine learning, including causality testing, structure inference in graphical models, time-series problems, feature selection as well as in providing privacy…

Information Theory · Computer Science 2018-10-30 Arman Rahimzamani , Himanshu Asnani , Pramod Viswanath , Sreeram Kannan