English
Related papers

Related papers: Characterization of Exponential Families of Lumpab…

200 papers

We introduce a new definition of exponential family of Markov chains, and show that many characteristic properties of the usual exponential family of probability distributions are properly extended to Markov chains. The method of…

Information Theory · Computer Science 2017-01-24 Hiroshi Nagaoka

We consider the parameter estimation of Markov chain when the unknown transition matrix belongs to an exponential family of transition matrices. Then, we show that the sample mean of the generator of the exponential family is an…

Statistics Theory · Mathematics 2016-09-28 Masahito Hayashi , Shun Watanabe

Consider longitudinal networks whose edges turn on and off according to a discrete-time Markov chain with exponential-family transition probabilities. We characterize when their joint distributions are also exponential families with the…

Methodology · Statistics 2024-03-12 William K. Schwartz , Sonja Petrović , Hemanshu Kaul

The exponential family of models is defined in a general setting, not relying on probability theory. Some results of information geometry are shown to remain valid. Exponential families both of classical and of quantum mechanical…

Mathematical Physics · Physics 2015-06-03 Jan Naudts , Ben Anthonis

This article considers exponential families of truncated multivariate normal distributions with one-sided truncation for some or all coordinates. We observe that if all components are one-sided truncated then this family is not full. The…

Statistics Theory · Mathematics 2025-07-02 Michael Levine , Donald Richards , Jianxi Su

In any Markov chain with finite state space the distribution of transition records always belongs to the exponential family. This observation is used to prove a fluctuation theorem, and to show that the dynamical entropy of a stationary…

Statistical Mechanics · Physics 2009-11-11 Jan Naudts , Erik Van der Straeten

A lumping of a Markov chain is a coordinate-wise projection of the chain. We characterise the entropy rate preservation of a lumping of an aperiodic and irreducible Markov chain on a finite state space by the random growth rate of the…

Information Theory · Computer Science 2015-04-21 Bernhard C. Geiger , Christoph Temmel

Staged tree models are a discrete generalization of Bayesian networks. We show that these form curved exponential families and derive their natural parameters, sufficient statistic, and cumulant-generating function as functions of their…

Statistics Theory · Mathematics 2022-01-31 Christiane Görgen , Manuele Leonelli , Orlando Marigliano

Maximum likelihood learning with exponential families leads to moment-matching of the sufficient statistics, a classic result. This can be generalized to conditional exponential families and/or when there are hidden data. This document…

Machine Learning · Computer Science 2020-01-28 Justin Domke

This article studies exponential families $\mathcal{E}$ on finite sets such that the information divergence $D(P\|\mathcal{E})$ of an arbitrary probability distribution from $\mathcal{E}$ is bounded by some constant $D>0$. A particular…

Statistics Theory · Mathematics 2014-06-18 Johannes Rauh

Necessary and sufficient conditions for identifying strong lumpability in Markov chains are presented. We show that the states in a lump necessarily correspond to identical elements in eigenvectors of the dual transition matrix. If there…

Probability · Mathematics 2008-04-09 Martin Nilsson Jacobi , Olof Goernerup

Exponential families are the workhorses of parametric modelling theory. One reason for their popularity is their associated inference theory, which is very clean, both from a theoretical and a computational point of view. One way in which…

Statistics Theory · Mathematics 2007-09-14 Karim Anaya-Izquierdo , Paul Marriott

Generation of deviates from random graph models with non-trivial edge dependence is an increasingly important problem. Here, we introduce a method which allows perfect sampling from random graph models in exponential family form…

Computation · Statistics 2020-01-07 Carter T. Butts

We investigate the properties of uniform doubly stochastic random matrices, that is non-negative matrices conditioned to have their rows and columns sum to 1. The rescaled marginal distributions are shown to converge to exponential…

Probability · Mathematics 2010-11-01 Sourav Chatterjee , Persi Diaconis , Allan Sly

We construct different classes of lumpings for a family of Markov chain products which reflect the structure of a given finite poset. We use essentially combinatorial methods. We prove that, for such a product, every lumping can be obtained…

Combinatorics · Mathematics 2013-10-15 Daniele D'Angeli , Alfredo Donno

This work is concerned with the stability properties of linear stochastic differential equations with random (drift and diffusion) coefficient matrices, and the stability of a corresponding random transition matrix (or exponential…

Probability · Mathematics 2019-05-02 Adrian N. Bishop , Pierre Del Moral

We develop a class of exponential-family point processes based on a latent social space to model the coevolution of social structure and behavior over time. Temporal dynamics are modeled as a discrete Markov process specified through…

Other Statistics · Statistics 2016-10-04 Joshua D. EmBree , Mark S. Handcock

The versatility of exponential families, along with their attendant convexity properties, make them a popular and effective statistical model. A central issue is learning these models in high-dimensions, such as when there is some sparsity…

Machine Learning · Computer Science 2015-05-19 Sham M. Kakade , Ohad Shamir , Karthik Sridharan , Ambuj Tewari

We give a complete classification of 1-dimensional exponential families $\mathcal{E}$ defined over a finite space $\Omega=\{x_{0}, ...,x_{n}\}$ whose Hessian scalar curvature is constant. We observe an interesting phenomenon: if…

Differential Geometry · Mathematics 2019-06-07 Mathieu Molitor

Phylogenetic trees constitute an interesting class of objects for stochastic processes due to the non-standard nature of the space they inhabit. In particular, many statistical applications require the construction of Markov processes on…

Probability · Mathematics 2024-10-24 Rodrigo B. Alves , Yuri F. Saporito , Luiz M. Carvalho
‹ Prev 1 2 3 10 Next ›