English
Related papers

Related papers: The Asymptotic Distribution of the MLE in High-dim…

200 papers

The $\boldsymbol{\beta}$-model for random graphs is commonly used for representing pairwise interactions in a network with degree heterogeneity. Going beyond pairwise interactions, Stasi et al. (2014) introduced the hypergraph…

Statistics Theory · Mathematics 2024-06-07 Sagnik Nandy , Bhaswar B. Bhattacharya

Max-stable distributions and processes are important models for extreme events and the assessment of tail risks. The full, multivariate likelihood of a parametric max-stable distribution is complicated and only recent advances enable its…

Statistics Theory · Mathematics 2017-08-08 Clement Dombry , Sebastian Engelke , Marco Oesting

Accurate statistical inference in logistic regression models remains a critical challenge when the ratio between the number of parameters and sample size is not negligible. This is because approximations based on either classical asymptotic…

Methodology · Statistics 2022-08-19 Qian Zhao , Emmanuel J. Candes

We establish some new non-asymptotical lower bounds for deviation of regular unbiased estimation of unknown parameter from its true value in different norms, alike the classical Rao-Kramer's inequality. We show that if the new norm is…

Statistics Theory · Mathematics 2014-07-17 E. Ostrovsky , L. Sirota

Capturing aleatoric uncertainty is a critical part of many machine learning systems. In deep learning, a common approach to this end is to train a neural network to estimate the parameters of a heteroscedastic Gaussian distribution by…

Machine Learning · Computer Science 2022-04-04 Maximilian Seitzer , Arash Tavakoli , Dimitrije Antic , Georg Martius

Maximum likelihood estimators are used extensively to estimate unknown parameters of stochastic trait evolution models on phylogenetic trees. Although the MLE has been proven to converge to the true value in the independent-sample case, we…

Populations and Evolution · Quantitative Biology 2019-11-26 Lam Si Tung Ho , Vu Dinh , Frederick A. Matsen , Marc A. Suchard

We study multivariate Gaussian models that are described by linear conditions on the concentration matrix. We compute the maximum likelihood (ML) degrees of these models. That is, we count the critical points of the likelihood function over…

Algebraic Geometry · Mathematics 2021-02-23 Carlos Améndola , Lukas Gustafsson , Kathlén Kohn , Orlando Marigliano , Anna Seigal

Regression trees and random forests are popular and effective non-parametric estimators in practical applications. A recent paper by Athey and Wager shows that the random forest estimate at any point is asymptotically Gaussian; in this…

Econometrics · Economics 2021-02-02 Kevin Li

Consider a parametrized family of general hidden Markov models, where both the observed and unobserved components take values in a complete separable metric space. We prove that the maximum likelihood estimator (MLE) of the parameter is…

Statistics Theory · Mathematics 2011-03-10 Randal Douc , Eric Moulines , Jimmy Olsson , Ramon van Handel

A novel yet simple extension of the symmetric logistic distribution is proposed by introducing a skewness parameter. It is shown how the three parameters of the ensuing skew logistic distribution may be estimated using maximum likelihood.…

Physics and Society · Physics 2022-05-06 Mark Levene

The saddlepoint approximation gives an approximation to the density of a random variable in terms of its moment generating function. When the underlying random variable is itself the sum of $n$ unobserved i.i.d. terms, the basic classical…

Statistics Theory · Mathematics 2022-01-25 Jesse Goodman

Let $\mathbf {x}_1,\ldots,\mathbf {x}_n$ be a random sample from a $p$-dimensional population distribution, where $p=p_n\to\infty$ and $\log p=o(n^{\beta})$ for some $0<\beta\leq1$, and let $L_n$ be the coherence of the sample correlation…

Probability · Mathematics 2014-02-26 Qi-Man Shao , Wen-Xin Zhou

We consider the problem of estimating functionals of discrete distributions, and focus on tight nonasymptotic analysis of the worst case squared error risk of widely used estimators. We apply concentration inequalities to analyze the random…

Information Theory · Computer Science 2017-08-11 Jiantao Jiao , Kartik Venkat , Yanjun Han , Tsachy Weissman

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on…

Statistics Theory · Mathematics 2018-12-06 Timothy Carpenter , Ilias Diakonikolas , Anastasios Sidiropoulos , Alistair Stewart

We study the uniform convergence rate of the nonparametric maximum likelihood estimator (MLE) for the sub-distribution functions in the current status data with competing risks model. It is known that the MLE have $L^2$-norm convergence…

Statistics Theory · Mathematics 2019-09-16 Sergey V. Malov

With contemporary data sets becoming too large to analyze the data directly, various forms of aggregated data are becoming common. The original individual data are points, but after aggregation, the observations are interval-valued (e.g.).…

Methodology · Statistics 2023-09-21 S. Yaser Samadi , L. Billard , Jiin-Huarng Guo , Wei Xu

The $\beta$-model is a powerful tool for modeling large and sparse networks driven by degree heterogeneity, where many network models become infeasible due to computational challenge and network sparsity. However, existing estimation…

Methodology · Statistics 2025-06-27 Meijia Shao , Yu Zhang , Qiuping Wang , Yuan Zhang , Jing Luo , Ting Yan

The max-stable H\"usler-Reiss distribution which arises as the limit distribution of maxima of bivariate Gaussian triangular arrays has been shown to be useful in various extreme value models. For such triangular arrays, this paper…

Probability · Mathematics 2014-02-25 E. Hashorva , Z. Peng , Z. Weng

This paper develops several interesting, significant, and interconnected approaches to nonparametric or semi-parametric statistical inferences. The overwhelmingly favoured maximum likelihood estimator (MLE) under parametric model is…

Statistics Theory · Mathematics 2023-03-30 Haodi Liang , Jiahua Chen

In this article, we introduce a two-way factor model for a high-dimensional data matrix and study the properties of the maximum likelihood estimation (MLE). The proposed model assumes separable effects of row and column attributes and…

Methodology · Statistics 2021-03-17 Gao Zhigen , Yuan Chaofeng , Jing Bingyi , Huang Wei , Guo Jianhua