English
Related papers

Related papers: The exponential family of Markov chains and its in…

200 papers

The two-parameter Macdonald polynomials are a central object of algebraic combinatorics and representation theory. We give a Markov chain on partitions of k with eigenfunctions the coefficients of the Macdonald polynomials when expanded in…

Probability · Mathematics 2010-07-28 Persi Diaconis , Arun Ram

There has been an explosion of interest in statistical models for analyzing network data, and considerable interest in the class of exponential random graph (ERG) models, especially in connection with difficulties in computing maximum…

Machine Learning · Statistics 2009-01-05 Stephen E. Fienberg , Alessandro Rinaldo , Yi Zhou

This document describes concisely the ubiquitous class of exponential family distributions met in statistics. The first part recalls definitions and summarizes main properties and duality with Bregman divergences (all proofs are skipped).…

Machine Learning · Computer Science 2011-05-16 Frank Nielsen , Vincent Garcia

It has been well known for some time that for strictly stationary Markov chains that are ``reversible'', that special symmetry provides special extra features in the mathematical theory. This paper here is primarily a purely expository…

Probability · Mathematics 2019-10-04 Richard C. Bradley

Markov categories are a novel framework to describe and treat problems in probability and information theory. In this work we combine the categorical formalism with the traditional quantitative notions of entropy, mutual information, and…

Information Theory · Computer Science 2024-04-15 Paolo Perrone

Staged tree models are a discrete generalization of Bayesian networks. We show that these form curved exponential families and derive their natural parameters, sufficient statistic, and cumulant-generating function as functions of their…

Statistics Theory · Mathematics 2022-01-31 Christiane Görgen , Manuele Leonelli , Orlando Marigliano

A new family of tree-structured Markov random fields for a vector of discrete counting random variables is introduced. According to the characteristics of the family, the marginal distributions of the Markov random fields are all Poisson…

Methodology · Statistics 2025-01-20 Benjamin Côté , Hélène Cossette , Etienne Marceau

The limiting probability distribution is one of the key characteristics of a Markov chain since it shows its long-term behavior. In this paper, for a higher order Markov chain, we establish some properties related to its exact limiting…

Probability · Mathematics 2026-03-20 Lixing Han , Jianhong Xu

The kernel exponential family is a rich class of distributions, which can be fit efficiently and with statistical guarantees by score matching. Being required to choose a priori a simple kernel such as the Gaussian, however, limits its…

Machine Learning · Statistics 2021-01-15 Li Wenliang , Danica J. Sutherland , Heiko Strathmann , Arthur Gretton

We introduce Markov substitute processes, a new model at the crossroad of statistics and formal grammars, and prove its main property : Markov substitute processes with a given support form an exponential family.

Machine Learning · Statistics 2016-03-28 Olivier Catoni , Thomas Mainguy

Random walks on simple graphs in connection with electrical resistor networks lead to the definition of Markov chains with transition probability matrix in terms of electrical conductances. We extend this definition to an effective…

Physics and Society · Physics 2007-09-20 Nelson Augusto Alves

This paper mainly contributes to a classification of statistical Einstein manifolds, namely statistical manifolds at the same time are Einstein manifolds. A statistical manifold is a Riemannian manifold, each of whose points is a…

Mathematical Physics · Physics 2019-08-30 Linyu Peng , Zhenning Zhang

A method of constructing Markov chains on finite state spaces is provided. The chain is specified by three constraints: stationarity, dependence and marginal distributions. The generalized Pythagorean theorem in information geometry plays a…

Statistics Theory · Mathematics 2024-07-26 Tomonari Sei

Markov chain Monte Carlo algorithms play a key role in the Bayesian approach to phylogenetic inference. In this paper, we present the first theoretical work analyzing the rate of convergence of several Markov chains widely used in…

Populations and Evolution · Quantitative Biology 2007-05-23 Elchanan Mossel , Eric Vigoda

Exponential families are a particular class of statistical manifolds which are particularly important in statistical inference, and which appear very frequently in statistics. For example, the set of normal distributions, with mean {\mu}…

Differential Geometry · Mathematics 2015-06-04 Mathieu Molitor

Exponential family extensions of principal component analysis (EPCA) have received a considerable amount of attention in recent years, demonstrating the growing need for basic modeling tools that do not assume the squared loss or Gaussian…

Machine Learning · Computer Science 2012-03-19 Arto Klami , Seppo Virtanen , Samuel Kaski

Markov chains are convenient means of generating realizations of networks with a given (joint or otherwise) degree distribution, since they simply require a procedure for rewiring edges. The major challenge is to find the right number of…

Social and Information Networks · Computer Science 2012-11-01 J. Ray , A. Pinar , C. Seshadhri

We use the $f-divergence$ also called relative entropy as a measure of diversity between probability densities and review its basic properties. In the sequence we define a few objects which capture relevant information from the sample of a…

Statistics Theory · Mathematics 2012-06-20 A. R. Baigorri , C. R. Goncalves , P. A. A. Resende

Exponential random graph models are a class of widely used exponential family models for social networks. The topological structure of an observed network is modelled by the relative prevalence of a set of local sub-graph configurations…

Computation · Statistics 2013-01-21 Alberto Caimo , Nial Friel

Shared information is a measure of mutual dependence among multiple jointly distributed random variables with finite alphabets. For a Markov chain on a tree with a given joint distribution, we give a new proof of an explicit…

Information Theory · Computer Science 2024-01-23 Sagnik Bhattacharya , Prakash Narayan