English
Related papers

Related papers: Minimax Optimal Rate for Parameter Estimation in M…

200 papers

We study maximum likelihood estimation in Gaussian graphical models from a geometric point of view. An algebraic elimination criterion allows us to find exact lower bounds on the number of observations needed to ensure that the maximum…

Statistics Theory · Mathematics 2012-05-30 Caroline Uhler

Distributional regression aims to find the best candidate in a given parametric family of conditional distributions to model a given dataset. As each candidate in the distribution family can be identified by the corresponding distribution…

Statistics Theory · Mathematics 2026-05-18 Gitte Kremling , Gerhard Dikta

The Multi-Reference Alignment (MRA) problem aims at the recovery of an unknown signal from repeated observations under the latent action of a group of cyclic isometries, in the presence of additive noise of high intensity $\sigma$. It is a…

Statistics Theory · Mathematics 2023-12-14 Subhro Ghosh , Soumendu Sundar Mukherjee , Jing Bin Pan

The inherent bias pathology of the maximum likelihood (ML) estimation method is confirmed for models with unknown parameters $\theta$ and $\psi$ when MLE $\hat \psi$ is function of MLE $\hat \theta.$ To reduce $\hat \psi$'s bias the…

Statistics Theory · Mathematics 2014-09-11 Yannis G. Yatracos

We give a thorough description of the asymptotic property of the maximum likelihood estimator (MLE) of the skewness parameter of a Skew Brownian Motion (SBM). Thanks to recent results on the Central Limit Theorem of the rate of convergence…

Statistics Theory · Mathematics 2023-02-07 Antoine Lejay , Sara Mazzonetto

This paper deals with nonparametric maximum likelihood estimation for Gaussian locally stationary processes. Our nonparametric MLE is constructed by minimizing a frequency domain likelihood over a class of functions. The asymptotic behavior…

Statistics Theory · Mathematics 2011-11-10 Rainer Dahlhaus , Wolfgang Polonik

Estimating the unconstrained mean and covariance matrix is a popular topic in statistics. However, estimation of the parameters of $N_p(\mu,\Sigma)$ under joint constraints such as $\Sigma\mu = \mu$ has not received much attention. It can…

Methodology · Statistics 2023-01-25 Anupam Kundu , Mohsen Pourahmadi

We study multivariate Gaussian statistical models whose maximum likelihood estimator (MLE) is a rational function of the observed data. We establish a one-to-one correspondence between such models and the solutions to a nonlinear…

Algebraic Geometry · Mathematics 2025-09-04 Carlos Améndola , Lukas Gustafsson , Kathlén Kohn , Orlando Marigliano , Anna Seigal

Maximum likelihood estimation (MLE) is a fundamental problem in statistics. Characteristics of the MLE problem for discrete algebraic statistical models are reflected in the geometry of the $\textit{likelihood correspondence}$, a variety…

Statistics Theory · Mathematics 2024-11-19 David Barnhill , John Cobb , Matthew Faust

We study the uniform convergence rate of the nonparametric maximum likelihood estimator (MLE) for the sub-distribution functions in the current status data with competing risks model. It is known that the MLE have $L^2$-norm convergence…

Statistics Theory · Mathematics 2019-09-16 Sergey V. Malov

Statistical modeling of monthly, seasonal, or annual rainfall data is an important research area in meteorology. These models play a crucial role in rainfed agriculture, where a proper assessment of the future availability of rainwater is…

Applications · Statistics 2024-03-05 Arnab Hazra , Abhik Ghosh

In this paper, we study the nonparametric maximum likelihood estimator (MLE) of a convex hazard function. We show that the MLE is consistent and converges at a local rate of $n^{2/5}$ at points $x_0$ where the true hazard function is…

Statistics Theory · Mathematics 2010-01-14 Hanna K. Jankowski , Jon A. Wellner

We revisit the problem of the existence of the maximum likelihood estimate for multi-class logistic regression. We show that one method of ensuring its existence is by assigning positive probability to every class in the sample dataset. The…

Machine Learning · Computer Science 2024-05-09 Dwight Nwaigwe , Marek Rychlik

In this paper, we study the log-likelihood function and Maximum Likelihood Estimate (MLE) for the matrix normal model for both real and complex models. We describe the exact number of samples needed to achieve (almost surely) three…

Representation Theory · Mathematics 2020-07-21 Harm Derksen , Visu Makam

Due to its heavy-tailed and fully parametric form, the multivariate generalized Gaussian distribution (MGGD) has been receiving much attention for modeling extreme events in signal and image processing applications. Considering the…

Applications · Statistics 2017-02-27 F. Pascal , L. Bombrun , J. Y. Tourneret , Y. Berthoumieu

The maximum likelihood degree (ML degree) measures the algebraic complexity of a fundamental optimization problem in statistics: maximum likelihood estimation. In this problem, one maximizes the likelihood function over a statistical model.…

Algebraic Geometry · Mathematics 2017-02-13 Jose Israel Rodriguez , Botong Wang

We study the maximum smoothed likelihood estimator (MSLE) for interval censoring, case 2, in the so-called separated case. Characterizations in terms of convex duality conditions are given and strong consistency is proved. Moreover, we show…

Statistics Theory · Mathematics 2014-10-16 Piet Groeneboom

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

f-divergence estimation is an important problem in the fields of information theory, machine learning, and statistics. While several divergence estimators exist, relatively few of their convergence rates are known. We derive the MSE…

Information Theory · Computer Science 2015-03-16 Kevin R. Moon , Alfred O. Hero

We study the classical problem of deriving minimax rates for density estimation over convex density classes. Building on the pioneering work of Le Cam (1973), Birge (1983, 1986), Wong and Shen (1995), Yang and Barron (1999), we determine…

Statistics Theory · Mathematics 2023-10-24 Shamindra Shrotriya , Matey Neykov