English
Related papers

Related papers: Existence of maximum likelihood estimates in expon…

200 papers

The maximum likelihood threshold (MLT) of a graph $G$ is the minimum number of samples to almost surely guarantee existence of the maximum likelihood estimate in the corresponding Gaussian graphical model. Recently a new characterization of…

Much of the theory of estimation for exponential family models, which include exponential-family random graph models (ERGMs) as a special case, is well-established and maximum likelihood estimates in particular enjoy many desirable…

Computation · Statistics 2020-09-07 Christian S. Schmid , David R. Hunter

The minimum number of observations such that the maximum likelihood estimator in a Gaussian graphical model exists with probability one is called the maximum likelihood threshold of the underlying graph G. The natural algebraic relaxation…

Combinatorics · Mathematics 2017-05-24 Grigoriy Blekherman , Rainer Sinn

A hidden Markov model with trends is a hidden Markov model whose emission distributions are translated by a trend that depends on the current hidden state and on the current time. Contrary to standard hidden Markov models, such processes…

Statistics Theory · Mathematics 2021-12-17 Luc Lehéricy , Augustin Touron

We study the problem of parameter estimation based on infection data from an epidemic outbreak on a graph. We assume that successive infections occur via contagion; i.e., transmissions can only spread across existing directed edges in the…

Statistics Theory · Mathematics 2018-06-15 Justin Khim , Po-Ling Loh

This paper rigorously establishes that the existence of the maximum likelihood estimate (MLE) in high-dimensional logistic regression models with Gaussian covariates undergoes a sharp `phase transition'. We introduce an explicit boundary…

Methodology · Statistics 2018-04-27 Emmanuel J. Candes , Pragya Sur

Exponential random graph models have attracted significant research attention over the past decades. These models are maximum-entropy ensembles under the constraints that the expected values of a set of graph observables are equal to given…

Statistics Theory · Mathematics 2015-10-30 Konstantin Zuev , Or Eisenberg , Dmitri Krioukov

A major line of contemporary research on complex networks is based on the development of statistical models that specify the local motifs associated with macro-structural properties observed in actual networks. This statistical approach…

Methodology · Statistics 2018-08-02 Maksym Byshkin , Alex Stivala , Antonietta Mira , Garry Robins , Alessandro Lomi

A fundamental problem with nonlinear models is that maximum likelihood estimates are not guaranteed to exist. Though nonexistence is a well known problem in the binary response model literature, it presents significant challenges for other…

Econometrics · Economics 2026-05-07 Sergio Correia , Paulo Guimarães , Thomas Zylkin

We develop approximate estimation methods for exponential random graph models (ERGMs), whose likelihood is proportional to an intractable normalizing constant. The usual approach approximates this constant with Monte Carlo simulations,…

Methodology · Statistics 2023-01-11 Angelo Mele , Lingjiong Zhu

A fundamental problem arising in many areas of machine learning is the evaluation of the likelihood of a given observation under different nominal distributions. Frequently, these nominal distributions are themselves estimated from data,…

Optimization and Control · Mathematics 2019-10-18 Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh , Man-Chung Yue , Daniel Kuhn , Wolfram Wiesemann

Maximum likelihood estimation is a common method of estimating the parameters of the probability distribution from a given sample. This paper aims to introduce the maximum likelihood estimation in the framework of sublinear expectation. We…

Probability · Mathematics 2023-01-16 Xinpeng Li , Yue Liu , Jiaquan Lu

The $\lambda$-exponential family generalizes the standard exponential family via a generalized convex duality motivated by optimal transport. It is the constant-curvature analogue of the exponential family from the information-geometric…

Statistics Theory · Mathematics 2025-05-07 Xiwei Tian , Ting-Kam Leonard Wong , Jiaowen Yang , Jun Zhang

Analyzing multi-layered graphical models provides insight into understanding the conditional relationships among nodes within layers after adjusting for and quantifying the effects of nodes from other layers. We obtain the penalized maximum…

Methodology · Statistics 2016-01-06 Jiahe Lin , Sumanta Basu , Moulinath Banerjee , George Michailidis

We systematically study a natural problem in extremal graph theory, to minimize the number of edges in a graph with a fixed number of vertices, subject to a certain local condition: each vertex must be in a copy of a fixed graph $H$. We…

Combinatorics · Mathematics 2020-06-24 Debsoumya Chakraborti , Po-Shen Loh

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

Necessary and sufficient conditions for the square-integrability of recently proposed unbiased estimators are established. A geometric characterization of a distribution that optimizes the performance of these estimators is given. An…

Statistics Theory · Mathematics 2019-09-09 Nabil Kahale

There has been an explosion of interest in statistical models for analyzing network data, and considerable interest in the class of exponential random graph (ERG) models, especially in connection with difficulties in computing maximum…

Machine Learning · Statistics 2009-01-05 Stephen E. Fienberg , Alessandro Rinaldo , Yi Zhou

Maximum-likelihood estimation (MLE) is arguably the most important tool for statisticians, and many methods have been developed to find the MLE. We present a new inequality involving posterior distributions of a latent variable that holds…

Statistics Theory · Mathematics 2019-12-10 Niels Lundtorp Olsen

A key problem in structured output prediction is direct optimization of the task reward function that matters for test evaluation. This paper presents a simple and computationally efficient approach to incorporate task reward into a maximum…

Machine Learning · Computer Science 2017-01-05 Mohammad Norouzi , Samy Bengio , Zhifeng Chen , Navdeep Jaitly , Mike Schuster , Yonghui Wu , Dale Schuurmans