English
Related papers

Related papers: Information Geometry on the $\ell^2$-Simplex via t…

200 papers

Information geometry and optimal transport are two distinct geometric frameworks for modeling families of probability measures. During the recent years, there has been a surge of research endeavors that cut across these two areas and…

Optimization and Control · Mathematics 2022-07-01 Gabriel Khan , Jun Zhang

The geometric approach to optimal transport and information theory has triggered the interpretation of probability densities as an infinite-dimensional Riemannian manifold. The most studied Riemannian structures are Otto's metric, yielding…

Analysis of PDEs · Mathematics 2018-07-20 Martin Bauer , Sarang Joshi , Klas Modin

This paper investigates the geometry of a completely integrable gradient system defined on the three parameter bivariate beta statistical manifold of the first kind. We prove that the associated vector field is Hamiltonian and admits a Lax…

Differential Geometry · Mathematics 2025-08-07 Prosper Rosaire Mama Assandje , Joseph Dongho , Thomas Bouetou Bouetou

A common framework for quantum mechanics, thermodynamics and information theory is presented. It is accomplished by reinterpreting the mathematical formalism of Everett's many-worlds theory of quantum mechanics and augmenting it to include…

Quantum Physics · Physics 2007-05-23 I. Devetak , A. E. Staples

The information geometry of the 2-manifold of gamma probability density functions provides a framework in which pseudorandom number generators may be evaluated using a neighbourhood of the curve of exponential density functions. The process…

Computation · Statistics 2009-07-13 C. T. J. Dodson

This paper develops information geometric representations for nonlinear filters in continuous time. The posterior distribution associated with an abstract nonlinear filtering problem is shown to satisfy a stochastic differential equation on…

Probability · Mathematics 2015-07-28 Nigel J. Newton

The region of entropic vectors is a convex cone that has been shown to be at the core of many fundamental limits for problems in multiterminal data compression, network coding, and multimedia transmission. This cone has been shown to be…

Information Theory · Computer Science 2015-12-11 Yunshu Liu , John MacLaren Walsh

Information geometry provides a geometric approach to families of statistical models. The key geometric structures are the Fisher quadratic form and the Amari-Chentsov tensor. In statistics, the notion of sufficient statistic expresses the…

Statistics Theory · Mathematics 2015-05-27 Nihat Ay , Jürgen Jost , Hông Vân Lê , Lorenz Schwachhöfer

The maximum entropy principle (MEP) is one of the most prominent methods to investigate and model complex systems. Despite its popularity, the standard form of the MEP can only generate Boltzmann-Gibbs distributions, which are ill-suited…

Statistical Mechanics · Physics 2022-03-30 Pablo A. Morales , Fernando E. Rosas

We consider the problems of clustering, classification, and visualization of high-dimensional data when no straightforward Euclidean representation exists. Typically, these tasks are performed by first reducing the high-dimensional data to…

Machine Learning · Statistics 2009-09-29 Kevin M. Carter , Raviv Raich , William G. Finn , Alfred O. Hero

A number of recent studies have estimated the inter-galactic void probability function and investigated its departure from various random models. We study a family of parametric statistical models based on gamma distributions, which do give…

Mathematical Physics · Physics 2008-11-27 C. T. J. Dodson

A full-rank lattice in the Euclidean space is a discrete set formed by all integer linear combinations of a basis. Given a probability distribution on $\mathbb{R}^n$, two operations can be induced by considering the quotient of the space by…

Information Theory · Computer Science 2024-05-15 Fábio C. C. Meneghetti , Henrique K. Miyamoto , Sueli I. R. Costa

We discuss the Pistone-Sempi exponential manifold on the finite-dimensional Gaussian space. We consider the role of the entropy, the continuity of translations, Poincar\'e-type inequalities, the generalized differentiability of probability…

Probability · Mathematics 2018-03-23 Giovanni Pistone

The purpose of this thesis is to convey the basic concepts of information geometry and its applications to non-specialists and those in applied fields, assuming only a first-year undergraduate background in calculus, linear algebra, and…

History and Overview · Mathematics 2024-06-25 Sammy Suliman

We study the geometry of the space of densities $\VolM$, which is the quotient space $\Diff(M)/\Diff_\mu(M)$ of the diffeomorphism group of a compact manifold $M$ by the subgroup of volume-preserving diffemorphisms, endowed with a…

Differential Geometry · Mathematics 2011-05-04 Boris Khesin , Jonatan Lenells , Gerard Misiolek , Stephen C. Preston

In this paper we consider the space of those probability distributions which maximize the $q$-R\'enyi entropy. These distributions have the same parameter space for every $q$, and in the $q=1$ case these are the normal distributions. Some…

Probability · Mathematics 2017-08-24 Attila Andai

We give a notion of entropy for general gemetric structures, which generalizes well-known notions of topological entropy of vector fields and geometric entropy of foliations, and which can also be applied to singular objects, e.g. singular…

Differential Geometry · Mathematics 2011-09-27 Nguyen Tien Zung

Information geometry is a study of statistical manifolds, that is, spaces of probability distributions from a geometric perspective. Its classical information-theoretic applications relate to statistical concepts such as Fisher information,…

Information Theory · Computer Science 2023-10-09 Kumar Vijay Mishra , M. Ashok Kumar , Ting-Kam Leonard Wong

Scientific and engineering processes deliver massive high-dimensional data sets that are generated as non-linear transformations of an initial state and few process parameters. Mapping such data to a low-dimensional manifold facilitates…

Machine Learning · Statistics 2018-08-07 Frank Schoeneman , Varun Chandola , Nils Napp , Olga Wodo , Jaroslaw Zola

This article elaborates on entanglement entropy and quantum information theory of geometric flows of (relativistic) Lagrange--Hamilton mechanical systems. A set of basic geometric and quantum mechanics and probability concepts together with…

General Physics · Physics 2020-01-31 Sergiu I. Vacaru , Laurenţiu Bubuianu