English
Related papers

Related papers: The exponential family in abstract information the…

200 papers

The exponential family of models is defined in a general setting, not relying on probability theory. Some results of information geometry are shown to remain valid. Exponential families both of classical and of quantum mechanical…

Mathematical Physics · Physics 2015-06-03 Jan Naudts , Ben Anthonis

We consider natural and general exponential families $(Q_m)_{m\in M}$ on $\mathbb{R}^d$ parametrized by the means. We study the submodels $(Q_{\theta m_1+(1-\theta)m_2})_{\theta\in[0,1]}$ parametrized by a segment in the means domain,…

Probability · Mathematics 2014-02-07 Piotr Graczyk , Salha Mamane

The Fisher information matrix summarizes the amount of information in a set of data relative to the quantities of interest. There are many applications of the information matrix in statistical modeling, system identification and parameter…

Computation · Statistics 2014-05-08 Xumeng Cao

This paper extends the idea of a generalized estimator for a scalar parameter (Vos, 2022) to multi-dimensional parameters both with and without nuisance parameters. The title reflects the fact that generalized estimators provide more than…

Statistics Theory · Mathematics 2024-08-26 Paul Vos , Qiang Wu

An Edgeworth-type expansion is established for the relative Fisher information distance to the class of normal distributions of sums of i.i.d. random variables, satisfying moment conditions. The validity of the central limit theorem is…

Probability · Mathematics 2012-05-01 S. G. Bobkov , G. P. Chistyakov , F. Götze

This document describes concisely the ubiquitous class of exponential family distributions met in statistics. The first part recalls definitions and summarizes main properties and duality with Bregman divergences (all proofs are skipped).…

Machine Learning · Computer Science 2011-05-16 Frank Nielsen , Vincent Garcia

This paper mainly contributes to a classification of statistical Einstein manifolds, namely statistical manifolds at the same time are Einstein manifolds. A statistical manifold is a Riemannian manifold, each of whose points is a…

Mathematical Physics · Physics 2019-08-30 Linyu Peng , Zhenning Zhang

In this dissertation, an abstract formalism extending information geometry is introduced. This framework encompasses a broad range of modelling problems, including possible applications in machine learning and in the information theoretical…

Mathematical Physics · Physics 2015-01-06 Ben Anthonis

We study a general factor analysis framework where the $n$-by-$p$ data matrix is assumed to follow a general exponential family distribution entry-wise. While this model framework has been proposed before, we here further relax its…

Methodology · Statistics 2025-12-02 Liang Wang , Luis Carvalho

We propose the generalised Fisher information or the one-parameter extended class of the Fisher information for the case of one random variable. This new form of the Fisher information is obtained from the intriguing connection between the…

Statistics Theory · Mathematics 2022-08-25 Worachet Bukaew , Sikarin Yoo-Kong

The {\lambda}-exponential family has recently been proposed to generalize the exponential family. While the exponential family is well-understood and widely used, this it not the case of the {\lambda}-exponential family. However, many…

Statistics Theory · Mathematics 2024-06-21 Thomas Guilmeau , Emilie Chouzenoux , Víctor Elvira

The problem to maximize the information divergence from an exponential family is generalized to the setting of Bregman divergences and suitably defined Bregman families.

Information Theory · Computer Science 2021-11-02 Johannes Rauh , František Matúš

We consider the design of prediction market mechanisms known as automated market makers. We show that we can design these mechanisms via the mold of \emph{exponential family distributions}, a popular and well-studied probability…

Artificial Intelligence · Computer Science 2014-02-25 Jacob Abernethy , Sindhu Kutty , Sébastien Lahaie , Rahul Sami

Exponential family extensions of principal component analysis (EPCA) have received a considerable amount of attention in recent years, demonstrating the growing need for basic modeling tools that do not assume the squared loss or Gaussian…

Machine Learning · Computer Science 2012-03-19 Arto Klami , Seppo Virtanen , Samuel Kaski

Diffusion models have emerged as powerful tools for solving inverse problems, yet prior work has primarily focused on observations with Gaussian measurement noise, restricting their use in real-world scenarios. This limitation persists due…

Machine Learning · Statistics 2025-02-11 Alessandro Micheli , Mélodie Monod , Samir Bhatt

Fisher matrices play an important role in experimental design and in data analysis. Their primary role is to make predictions for the inference of model parameters - both their errors and covariances. In this short review, I outline a…

Cosmology and Nongalactic Astrophysics · Physics 2016-08-24 Alan Heavens

A generalised one-dimensional Fisher-Wright diffusion process with mutations is considered. This is a well-known model in population genetics. An exponential recurrence is established for the process, which also implies an exponential rate…

Probability · Mathematics 2025-03-27 Roman Sineokiy , Alexander Veretennikov

It is shown that a consistent application of Bayesian updating from a prior probability density to a posterior using evidence in the form of expectation constraints leads to exactly the same results as the application of the maximum entropy…

Data Analysis, Statistics and Probability · Physics 2016-05-02 Sergio Davis

In this paper we propose a new lifetime model, called the odd generalized exponential gompertz distribution, We obtain some of its mathematical properties. Some structural properties of the new distribution are studied. The method of…

Statistics Theory · Mathematics 2015-10-28 M. A. El-Damcese , Abdelfattah Mustafa , B. S. El-Desouky , M. E. Mustafa

In this brief note we compute the Fisher information of a family of generalized normal distributions. Fisher information is usually defined for regular distributions, i.e. continuously differentiable (log) density functions whose support…

Information Theory · Computer Science 2020-11-18 Precious Ugo Abara , Sandra Hirche
‹ Prev 1 2 3 10 Next ›