English
Related papers

Related papers: Maximum Likelihood Estimation of Functionals of Di…

200 papers

The asymptotic normality of the maximum likelihood estimator (MLE) under regularity conditions is a cornerstone of statistical theory. In this paper, we give explicit upper bounds on the distributional distance between the distribution of…

Statistics Theory · Mathematics 2018-07-23 Andreas Anastasiou

In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…

Methodology · Statistics 2023-03-01 Shan Wang , Hanxiang Peng

The exact maximum likelihood estimate (MLE) provides a test statistic for the unit root test that is more powerful \citep[p. 577]{Fuller96} than the usual least squares approach. In this paper a new derivation is given for the asymptotic…

Statistics Theory · Mathematics 2016-11-04 Ying Zhang , H. Yu , A. I. McLeod

Although deep learning models have driven state-of-the-art performance on a wide array of tasks, they are prone to spurious correlations that should not be learned as predictive clues. To mitigate this problem, we propose a causality-based…

Machine Learning · Computer Science 2021-10-27 Xinyi Wang , Wenhu Chen , Michael Saxon , William Yang Wang

We develop and analyze $M$-estimation methods for divergence functionals and the likelihood ratios of two probability distributions. Our method is based on a non-asymptotic variational characterization of $f$-divergences, which allows the…

Statistics Theory · Mathematics 2016-11-18 XuanLong Nguyen , Martin J. Wainwright , Michael I. Jordan

In the current paper, the estimation of the probability density function and the cumulative distribution function of the Topp-Leone distribution is considered. We derive the following estimators: maximum likelihood estimator, uniformly…

Methodology · Statistics 2017-01-17 Lazhar Benkhelifa

The problem of Shannon entropy estimation in countable infinite alphabets is addressed from the study and use of convergence results of the entropy functional, which is known to be discontinuous with respect to the total variation distance…

Information Theory · Computer Science 2018-04-03 Jorge F. Silva

We propose a novel targeted maximum likelihood estimator (TMLE) for quantiles in semiparametric missing data models. Our proposed estimator is locally efficient, $\sqrt{n}$-consistent, asymptotically normal, and doubly robust, under…

Methodology · Statistics 2016-08-23 Iván Díaz

We address the problem of signal denoising via transform-domain shrinkage based on a novel $\textit{risk}$ criterion called the minimum probability of error (MPE), which measures the probability that the estimated parameter lies outside an…

Applications · Statistics 2020-02-19 Jishnu Sadasivan , Subhadip Mukherjee , Chandra Sekhar Seelamantula

The primary objective of this scholarly work is to develop two estimation procedures - maximum likelihood estimator (MLE) and method of trimmed moments (MTM) - for the mean and variance of lognormal insurance payment severity data sets…

Methodology · Statistics 2024-02-22 Chudamani Poudyal

Maximum likelihood estimation problems are, in general, intractable optimization problems. As a result, it is common to approximate the maximum likelihood estimator (MLE) using convex relaxations. In some cases, the relaxation is tight: it…

Optimization and Control · Mathematics 2016-08-15 Afonso S. Bandeira , Nicolas Boumal , Amit Singer

The paper studies large sample asymptotic properties of the Maximum Likelihood Estimator (MLE) for the parameter of a continuous time Markov chain, observed in white noise. Using the method of weak convergence of likelihoods due to…

Probability · Mathematics 2009-06-18 Pavel Chigansky

In this paper, we study the functional linear multiplicative model based on the least product relative error criterion. Under some regularization conditions, we establish the consistency and asymptotic normality of the estimator. Further,…

Statistics Theory · Mathematics 2023-01-04 Qian Yan , Hanyu Li

Finite state space hidden Markov models are flexible tools to model phenomena with complex time dependencies: any process distribution can be approximated by a hidden Markov model with enough hidden states.We consider the problem of…

Statistics Theory · Mathematics 2021-02-16 Luc Lehéricy

Targeted maximum likelihood estimation (TMLE) is a general method for estimating parameters in semiparametric and nonparametric models. Each iteration of TMLE involves fitting a parametric submodel that targets the parameter of interest. We…

Methodology · Statistics 2014-06-03 Iván Díaz , Michael Rosenblum

Principal stratification is a widely used framework for addressing post-randomization complications. After using principal stratification to define causal effects of interest, researchers are increasingly turning to finite mixture models to…

Methodology · Statistics 2019-08-20 Avi Feller , Evan Greif , Nhat Ho , Luke Miratrix , Natesh Pillai

Maximum likelihood estimation (MLE) is the most common approach to quantum state tomography. In this letter, we investigate whether it is also optimal in any sense. We show that MLE is an inadmissible estimator for most of the commonly used…

Quantum Physics · Physics 2018-08-06 Christopher Ferrie , Robin Blume-Kohout

We explore the possibility of evaluating flow harmonics by employing the maximum likelihood estimator (MLE). For a given finite multiplicity, the MLE simultaneously furnishes estimations for all the parameters of the underlying distribution…

High Energy Physics - Phenomenology · Physics 2023-08-16 Chong Ye , Wei-Liang Qian , Rui-Hong Yue , Yogiro Hama , Takeshi Kodama

We study the asymptotic behavior of the Maximum Likelihood and Least Squares Estimators of a $k$-monotone density $g_0$ at a fixed point $x_0$ when $k>2$. We find that the $j$th derivative of the estimators at $x_0$ converges at the rate…

Statistics Theory · Mathematics 2009-09-29 Fadoua Balabdaoui , Jon A. Wellner

Research in NLP is often supported by experimental results, and improved reporting of such results can lead to better understanding and more reproducible science. In this paper we analyze three statistical estimators for expected validation…

Computation and Language · Computer Science 2021-10-05 Jesse Dodge , Suchin Gururangan , Dallas Card , Roy Schwartz , Noah A. Smith