English
Related papers

Related papers: Asymptotic accuracy of the saddlepoint approximati…

200 papers

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

We study approximate maximum likelihood estimators (MLEs) for the parameters of the widely used Heston stock and volatility stochastic differential equations (SDEs). We compute explicit closed form estimators maximizing the discretized…

Probability · Mathematics 2015-06-19 Robert Azencott , Yutheeka Gadhyan

Skew normal model suffers from inferential drawbacks, namely singular Fisher information in the vicinity of symmetry and diverging of maximum likelihood estimation. To address the above drawbacks, Azzalini and Arellano-Valle (2013)…

Methodology · Statistics 2024-01-25 Jian Zhang , Tong Wang

Consider a setting with $N$ independent individuals, each with an unknown parameter, $p_i \in [0, 1]$ drawn from some unknown distribution $P^\star$. After observing the outcomes of $t$ independent Bernoulli trials, i.e., $X_i \sim…

Statistics Theory · Mathematics 2019-02-13 Ramya Korlakai Vinayak , Weihao Kong , Gregory Valiant , Sham M. Kakade

The asymptotic normality of the Maximum Likelihood Estimator (MLE) is a cornerstone of statistical theory. In the present paper, we provide sharp explicit upper bounds on Zolotarev-type distances between the exact, unknown distribution of…

Statistics Theory · Mathematics 2016-04-19 Andreas Anastasiou , Christophe Ley

In this paper, we study the nonparametric maximum likelihood estimator (MLE) of a convex hazard function. We show that the MLE is consistent and converges at a local rate of $n^{2/5}$ at points $x_0$ where the true hazard function is…

Statistics Theory · Mathematics 2010-01-14 Hanna K. Jankowski , Jon A. Wellner

We revisit the problem of mean estimation in the Gaussian sequence model with $\ell_p$ constraints for $p \in [0, \infty]$. We demonstrate two phenomena for the behavior of the maximum likelihood estimator (MLE), which depend on the noise…

Statistics Theory · Mathematics 2025-07-02 Liviu Aolaritei , Michael I. Jordan , Reese Pathak , Annie Ulichney

The Laplace approximation (LA) has been proposed as a method for approximating the marginal likelihood of statistical models with latent variables. However, the approximate maximum likelihood estimators (MLEs) based on the LA are often…

Methodology · Statistics 2022-07-21 Jeongseop Han , Youngjo Lee

In nonlinear deterministic parameter estimation, the maximum likelihood estimator (MLE) is unable to attain the Cramer-Rao lower bound at low and medium signal-to-noise ratios (SNR) due the threshold and ambiguity phenomena. In order to…

Applications · Statistics 2015-06-19 Achraf Mallat , Sinan Gezici , Davide Dardari , Christophe Craeye , Luc Vandendorpe

It is well known that under general regularity conditions the distribution of the maximum likelihood estimator (MLE) is asymptotically normal. Very recently, bounds of the optimal order $O(1/\sqrt n)$ on the closeness of the distribution of…

Statistics Theory · Mathematics 2016-12-15 Iosif Pinelis

We study statistical estimators computed using iterative optimization methods that are not run until completion. Classical results on maximum likelihood estimators (MLEs) assert that a one-step estimator (OSE), in which a single…

Optimization and Control · Mathematics 2021-06-28 Robert Bassett , Julio Deride

The aim of this note is to state a couple of general results about the properties of the penalized maximum likelihood estimators (pMLE) and of the posterior distribution for parametric models in a non-asymptotic setup and for possibly large…

Statistics Theory · Mathematics 2022-12-13 Vladimir Spokoiny

An asymptotic analytical approach is proposed for bosonic probability amplitudes in unitary linear networks, such as the optical multiport devices for photons. The asymptotic approach applies for large number of bosons $N\gg M$ in the…

Quantum Physics · Physics 2014-01-24 V. S. Shchesnovich

A statistical model is said to be un-normalised when its likelihood function involves an intractable normalising constant. Two popular methods for parameter inference for these models are MC-MLE (Monte Carlo maximum likelihood estimation),…

Statistics Theory · Mathematics 2018-02-01 Lionel Riou-Durand , Nicolas Chopin

Randomized approximation algorithms for many #P-complete problems (such as the partition function of a Gibbs distribution, the volume of a convex body, the permanent of a $\{0,1\}$-matrix, and many others) reduce to creating random…

Computation · Statistics 2017-06-30 Mark Huber

The asymptotic normality of the Maximum Likelihood Estimator (MLE) is a long established result. Explicit bounds for the distributional distance between the distribution of the MLE and the normal distribution have recently been obtained for…

Statistics Theory · Mathematics 2016-09-20 Andreas Anastasiou

We are concerned here with unrestricted maximum likelihood estimation in a sparse $p_0$ model with covariates for directed networks. The model has a density parameter $\nu$, a $2n$-dimensional node parameter $\bs{\eta}$ and a fixed…

Statistics Theory · Mathematics 2021-06-08 Qiuping Wang

We use the delta method and Stein's method to derive, under regularity conditions, explicit upper bounds for the distributional distance between the distribution of the maximum likelihood estimator (MLE) of a $d$-dimensional parameter and…

Statistics Theory · Mathematics 2020-02-04 Andreas Anastasiou , Robert E. Gaunt

We revisit the problem of estimating the center of symmetry $\theta$ of an unknown symmetric density $f$. Although Stone (1975), Van Eden (1970), and Sacks (1975) constructed adaptive estimators of $\theta$ in this model, their estimators…

Statistics Theory · Mathematics 2019-11-15 Nilanjana Laha

Maximum likelihood estimation of linear functionals in the inverse problem of deconvolution is considered. Given observations of a random sample from a distribution $P_0\equiv P_{F_0}$ indexed by a (potentially infinite-dimensional)…

Statistics Theory · Mathematics 2019-02-05 Catia Scricciolo