English
Related papers

Related papers: The Asymptotic Distribution of the MLE in High-dim…

200 papers

If the log likelihood is approximately quadratic with constant Hessian, then the maximum likelihood estimator (MLE) is approximately normally distributed. No other assumptions are required. We do not need independent and identically…

Statistics Theory · Mathematics 2012-07-06 Charles J. Geyer

This paper deals with Elliptical Wishart distributions - which generalize the Wishart distribution - in the context of signal processing and machine learning. Two algorithms to compute the maximum likelihood estimator (MLE) are proposed: a…

Machine Learning · Statistics 2024-11-06 Imen Ayadi , Florent Bouchard , Frédéric Pascal

Delattre et al. (2013) considered n independent stochastic differential equations (SDEs), where in each case the drift term is associated with a random effect, the distribution of which depends upon unknown parameters. Assuming the…

Statistics Theory · Mathematics 2016-05-12 Trisha Maitra , Sourabh Bhattacharya

The edges in networks are not only binary, either present or absent, but also take weighted values in many scenarios (e.g., the number of emails between two users). The covariate-$p_0$ model has been proposed to model binary directed…

Statistics Theory · Mathematics 2021-07-24 MengXu , Qiuping Wang

In this work, we revisit the estimation of the model parameters of a Weibull distribution based on iid observations, using the maximum likelihood estimation (MLE) method which does not yield closed expressions of the estimators. Among other…

Computation · Statistics 2025-01-22 Buu-Chau Truong , Peter Mphekgwana , Nabendu Pal

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

We obtain explicit $p$-Wasserstein distance error bounds between the distribution of the multi-parameter MLE and the multivariate normal distribution. Our general bounds are given for possibly high-dimensional, independent and identically…

Statistics Theory · Mathematics 2021-12-28 Andreas Anastasiou , Robert E. Gaunt

Suppose we are given observations, where each observation is drawn independently from one of $k$ known distributions. The goal is to match each observation to the distribution from which it was drawn. We observe that the maximum likelihood…

Data Structures and Algorithms · Computer Science 2019-10-01 Sinho Chewi , Forest Yang , Avishek Ghosh , Abhay Parekh , Kannan Ramchandran

Delattre et al. (2013) considered a system of stochastic differential equations (SDEs) in a random effects setup. Under the independent and identical (iid) situation, and assuming normal distribution of the random effects, they established…

Statistics Theory · Mathematics 2020-05-04 Trisha Maitra , Sourabh Bhattacharya

It is well known that, under standard regularity conditions, the maximum likelihood estimator (MLE) satisfies a central limit theorem and converges in distribution to a Gaussian random variable as the sample size grows. This paper…

Information Theory · Computer Science 2026-05-26 Leighton P. Barnes , Alex Dytso

We revisit the problem of mean estimation in the Gaussian sequence model with $\ell_p$ constraints for $p \in [0, \infty]$. We demonstrate two phenomena for the behavior of the maximum likelihood estimator (MLE), which depend on the noise…

Statistics Theory · Mathematics 2025-07-02 Liviu Aolaritei , Michael I. Jordan , Reese Pathak , Annie Ulichney

This paper discusses asymptotic distributions of various estimators of the underlying parameters in some regression models with long memory (LM) Gaussian design and nonparametric heteroscedastic LM moving average errors. In the simple…

Statistics Theory · Mathematics 2008-12-18 Hongwen Guo , Hira L. Koul

We give a thorough description of the asymptotic property of the maximum likelihood estimator (MLE) of the skewness parameter of a Skew Brownian Motion (SBM). Thanks to recent results on the Central Limit Theorem of the rate of convergence…

Statistics Theory · Mathematics 2023-02-07 Antoine Lejay , Sara Mazzonetto

This paper considers the nonparametric maximum likelihood estimator (MLE) for the joint distribution function of an interval censored survival time and a continuous mark variable. We provide a new explicit formula for the MLE in this…

Statistics Theory · Mathematics 2012-01-12 Marloes H. Maathuis , Jon A. Wellner

In this paper we study the asymptotic normality in high-dimensional linear regression. We focus on the case where the covariance matrix of the regression variables has a KMS structure, in asymptotic settings where the number of predictors,…

Statistics Theory · Mathematics 2022-05-17 Saulius Jokubaitis , Remigijus Leipus

The assumption of log-concavity is a flexible and appealing nonparametric shape constraint in distribution modelling. In this work, we study the log-concave maximum likelihood estimator (MLE) of a probability mass function (pmf). We show…

Methodology · Statistics 2023-04-17 Fadoua Balabdaoui , Hanna Jankowski , Kaspar Rufibach , Marios Pavlides

Maximum likelihood estimation (MLE) is a statistical method used to estimate the parameters of a probability distribution that best explain the observed data. In the context of text generation, MLE is often used to train generative language…

Computation and Language · Computer Science 2023-10-27 Chenze Shao , Zhengrui Ma , Min Zhang , Yang Feng

Maximum-likelihood estimation (MLE) is arguably the most important tool for statisticians, and many methods have been developed to find the MLE. We present a new inequality involving posterior distributions of a latent variable that holds…

Statistics Theory · Mathematics 2019-12-10 Niels Lundtorp Olsen

This paper considers the maximum likelihood estimation of factor models of high dimension, where the number of variables (N) is comparable with or even greater than the number of observations (T). An inferential theory is developed. We…

Statistics Theory · Mathematics 2012-05-31 Jushan Bai , Kunpeng Li

We show that the mean-model parameter is always orthogonal to the error distribution in generalized linear models. Thus, the maximum likelihood estimator of the mean-model parameter will be asymptotically efficient regardless of whether the…

Methodology · Statistics 2020-10-08 Alan Huang , Paul J. Rathouz