English
Related papers

Related papers: Asymptotics of Maximum Likelihood without the LLN …

200 papers

In a finite mixture of location-scale distributions maximum likelihood estimator does not exist because of the unboundedness of the likelihood function when the scale parameter of some mixture component approaches zero. In order to study…

Statistics Theory · Mathematics 2007-06-13 Kentaro Tanaka , Akimichi Takemura

Anomaly estimation, or the problem of finding a subset of a dataset that differs from the rest of the dataset, is a classic problem in machine learning and data mining. In both theoretical work and in applications, the anomaly is assumed to…

Machine Learning · Computer Science 2021-06-14 Uthsav Chitra , Kimberly Ding , Jasper C. H. Lee , Benjamin J. Raphael

Many statistical models have likelihoods which are intractable: it is impossible or too expensive to compute the likelihood exactly. In such settings, a common approach is to replace the likelihood with an approximation, and proceed with…

Statistics Theory · Mathematics 2016-11-23 Helen Ogden

The least trimmed squares (LTS) estimator is a renowned robust alternative to the classic least squares estimator and is popular in location, regression, machine learning, and AI literature. Many studies exist on LTS, including its…

Machine Learning · Statistics 2025-01-10 Yijun Zuo

Graphical models with bi-directed edges (<->) represent marginal independence: the absence of an edge between two vertices indicates that the corresponding variables are marginally independent. In this paper, we consider maximum likelihood…

Methodology · Statistics 2012-12-12 Mathias Drton , Thomas S. Richardson

We develop an asymptotic theory for $L^2$ norms of sample mean vectors of high-dimensional data. An invariance principle for the $L^2$ norms is derived under conditions that involve a delicate interplay between the dimension $p$, the sample…

Statistics Theory · Mathematics 2015-03-13 Mengyu Xu , Danna Zhang , Wei Biao Wu

This paper establishes the asymptotic independence between the quadratic form and maximum of a sequence of independent random variables. Based on this theoretical result, we find the asymptotic joint distribution for the quadratic form and…

Methodology · Statistics 2023-08-03 Dachuan Chen , Decai Liang , Long Feng

Modern data sets in various domains often include units that were sampled non-randomly from the population and have a latent correlation structure. Here we investigate a common form of this setting, where every unit is associated with a…

Methodology · Statistics 2019-07-25 Omer Weissbrod , Shachar Kaufman , David Golan , Saharon Rosset

The advent of data science has spurred interest in estimating properties of distributions over large alphabets. Fundamental symmetric properties such as support size, support coverage, entropy, and proximity to uniformity, received most…

Information Theory · Computer Science 2016-11-29 Jayadev Acharya , Hirakendu Das , Alon Orlitsky , Ananda Theertha Suresh

The multivariate normal density is a monotonic function of the distance to the mean, and its ellipsoidal shape is due to the underlying Euclidean metric. We suggest to replace this metric with a locally adaptive, smoothly changing…

Machine Learning · Statistics 2016-09-26 Georgios Arvanitidis , Lars Kai Hansen , Søren Hauberg

There are several ways to establish the asymptotic normality of $L$-statistics, which depend on the choice of the weights-generating function and the cumulative distribution selection of the underlying model. In this study, we focus on…

Statistics Theory · Mathematics 2024-07-23 Chudamani Poudyal

We compute the leading asymptotics as $N\to\infty$ of the maximum of the field $Q_N(q)= \log\det|q- A_N|$, $q\in \mathbb{C}$, for any unitarily invariant Hermitian random matrix $A_N$ associated to a non-critical real-analytic potential.…

Probability · Mathematics 2021-04-13 Gaultier Lambert , Elliot Paquette

Let $\mathbf {x}_1,\ldots,\mathbf {x}_n$ be a random sample from a $p$-dimensional population distribution, where $p=p_n\to\infty$ and $\log p=o(n^{\beta})$ for some $0<\beta\leq1$, and let $L_n$ be the coherence of the sample correlation…

Probability · Mathematics 2014-02-26 Qi-Man Shao , Wen-Xin Zhou

In this paper we study asymptotic properties of the maximum likelihood estimator (MLE) for the speed of a stochastic wave equation. We follow a well-known spectral approach to write the solution as a Fourier series, then we project the…

Statistics Theory · Mathematics 2021-08-09 F. Delgado-Vences , J. J. Pavon-Español

In probability theory and statistics, the IID model represents a single population, and a large, potentially infinite sample from this population. Main theorems, in particular the central limit theorem and laws of large number (LLN) assure…

Statistics Theory · Mathematics 2017-10-02 Uwe Saint-Mont

This paper studies robust estimation in the dynamic Tobit model under local-to-unity (LUR) asymptotics. We show that both Gaussian maximum likelihood (ML) and censored least absolute deviations (CLAD) estimators are consistent, extending…

Econometrics · Economics 2025-12-16 Anna Bykhovskaya , James A. Duffy

In this paper we study the computation of the nonparametric maximum likelihood estimator (NPMLE) in multivariate mixture models. Our first approach discretizes this infinite dimensional convex optimization problem by fixing the support…

Methodology · Statistics 2024-02-20 Yangjing Zhang , Ying Cui , Bodhisattva Sen , Kim-Chuan Toh

The transition density of a diffusion process does not admit an explicit expression in general, which prevents the full maximum likelihood estimation (MLE) based on discretely observed sample paths. A\"{\i}t-Sahalia [J. Finance 54 (1999)…

Statistics Theory · Mathematics 2012-03-12 Jinyuan Chang , Song Xi Chen

We consider signal source localization from range-difference measurements. First, we give some readily-checked conditions on measurement noises and sensor deployment to guarantee the asymptotic identifiability of the model and show the…

Signal Processing · Electrical Eng. & Systems 2023-09-26 Guangyang Zeng , Biqiang Mu , Ling Shi , Jiming Chen , Junfeng Wu

We obtain an asymptotic normality result that reveals the precise asymptotic behavior of the maximum likelihood estimators of parameters for a very general class of linear mixed models containing cross random effects. In achieving the…

Statistics Theory · Mathematics 2026-02-10 Jiming Jiang , Matt P. Wand , Swarnadip Ghosh