English
Related papers

Related papers: Uniform convergence rate of nonparametric maximum …

200 papers

This work makes two advances in the study of the (approximate) nonparametric maximum likelihood estimator (NPMLE) for exponential family mixture models. First, we develop a data-compression strategy that reduces the cost of repeated…

Statistics Theory · Mathematics 2026-04-22 Yan Zhang

Maximum likelihood (ML) estimation is widely used in statistics. The h-likelihood has been proposed as an extension of Fisher's likelihood to statistical models including unobserved latent variables of recent interest. Its advantage is that…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee , Jae Kwang Kim

This paper investigates the asymptotic distribution of the maximum-likelihood estimate (MLE) in multinomial logistic models in the high-dimensional regime where dimension and sample size are of the same order. While classical large-sample…

Statistics Theory · Mathematics 2023-05-30 Kai Tan , Pierre C. Bellec

A new likelihood based AR approximation is given for ARMA models. The usual algorithms for the computation of the likelihood of an ARMA model require $O(n)$ flops per function evaluation. Using our new approximation, an algorithm is…

Statistics Theory · Mathematics 2016-11-04 A. Ian McLeod , Ying Zhang

This paper studies minimax rates of convergence for nonparametric location-scale models, which include mean, quantile and expectile regression settings. Under Hellinger differentiability on the error distribution and other mild conditions,…

Statistics Theory · Mathematics 2023-07-06 Bingxin Zhao , Yuhong Yang

The problem of nonlinear functional of parameters, such as differential entropy, has received much attention in information theory and statistics. In many situations, prior information about the parameters is available in the form of order…

Statistics Theory · Mathematics 2026-03-10 Somnath Mandal , Lakshmi Kanta Patra

The maximum likelihood degree (ML degree) measures the algebraic complexity of a fundamental optimization problem in statistics: maximum likelihood estimation. In this problem, one maximizes the likelihood function over a statistical model.…

Algebraic Geometry · Mathematics 2017-02-13 Jose Israel Rodriguez , Botong Wang

Strong consistency of the maximum likelihood estimator (MLE) for parametric Gibbs point process models is established. The setting is very general. It includes pairwise pair potentials, finite and infinite multibody interactions and…

Statistics Theory · Mathematics 2016-01-27 David Dereudre , Frédéric Lavancier

The inherent bias pathology of the maximum likelihood (ML) estimation method is confirmed for models with unknown parameters $\theta$ and $\psi$ when MLE $\hat \psi$ is function of MLE $\hat \theta.$ To reduce $\hat \psi$'s bias the…

Statistics Theory · Mathematics 2014-09-11 Yannis G. Yatracos

Maximum likelihood estimation (MLE) is the most common approach to quantum state tomography. In this letter, we investigate whether it is also optimal in any sense. We show that MLE is an inadmissible estimator for most of the commonly used…

Quantum Physics · Physics 2018-08-06 Christopher Ferrie , Robin Blume-Kohout

The problem of Offline Policy Evaluation (OPE) in Reinforcement Learning (RL) is a critical step towards applying RL in real-life applications. Existing work on OPE mostly focus on evaluating a fixed target policy $\pi$, which does not…

Machine Learning · Computer Science 2020-12-02 Ming Yin , Yu Bai , Yu-Xiang Wang

We consider a jump-type Cox--Ingersoll--Ross (CIR) process driven by a standard Wiener process and a subordinator, and we study asymptotic properties of the maximum likelihood estimator (MLE) for its growth rate. We distinguish three cases:…

Statistics Theory · Mathematics 2018-06-08 Matyas Barczy , Mohamed Ben Alaya , Ahmed Kebaier , Gyula Pap

Probabilistic regression models trained with maximum likelihood estimation (MLE), can sometimes overestimate variance to an unacceptable degree. This is mostly problematic in the multivariate domain. While univariate models often optimize…

Artificial Intelligence · Computer Science 2024-09-24 Daan Roordink , Sibylle Hess

We consider a one dimensional sub-ballistic random walk evolving in a parametric i.i.d. random environment. We study the asymptotic properties of the maximum likelihood estimator (MLE) of the parameter based on a single observation of the…

Probability · Mathematics 2014-05-13 Mikael Falconnet , Dasha Loukianova , Arnaud Gloter

The paper offers a novel unified approach to studying the accuracy of parameter estimation by the quasi likelihood method. Important features of the approach are: (1) The underlying model {is not assumed to be parametric}. (2) No conditions…

Statistics Theory · Mathematics 2009-03-11 V. Spokoiny

When fitting the learning data of an individual to algorithm-like learning models, the observations are so dependent and non-stationary that one may wonder what the classical Maximum Likelihood Estimator (MLE) could do, even if it is the…

Machine Learning · Computer Science 2023-05-12 Julien Aubert , Luc Lehéricy , Patricia Reynaud-Bouret

The Laplace approximation (LA) has been proposed as a method for approximating the marginal likelihood of statistical models with latent variables. However, the approximate maximum likelihood estimators (MLEs) based on the LA are often…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee

Let $M_n=\max \left(X_1, X_2, \ldots, X_n \right)$ denote the partial maximum of an independent and identically distributed skew-normal random sequence. In this paper, the rate of uniform convergence of skew-normal extremes is derived. It…

Probability · Mathematics 2023-02-20 Qian Xiong , Zuoxiang Peng , Saralees Nadarajah

In certain privacy-sensitive scenarios within fields such as clinical trial simulations, federated learning, and distributed learning, researchers often face the challenge of estimating correlations between variables without access to…

Methodology · Statistics 2025-08-05 Longwen Shang , Min Tsao , Xuekui Zhang

Motivated by studying asymptotic properties of the maximum likelihood estimator (MLE) in stochastic volatility (SV) models, in this paper we investigate likelihood estimation in state space models. We first prove, under some regularity…

Statistics Theory · Mathematics 2010-11-15 Cheng-Der Fuh