English
Related papers

Related papers: Maximum Approximated Likelihood Estimation

200 papers

Linear mixed models (LMMs) are used as an important tool in the data analysis of repeated measures and longitudinal studies. The most common form of LMMs utilize a normal distribution to model the random effects. Such assumptions can often…

Methodology · Statistics 2016-02-16 Hien D. Nguyen , Geoffrey J. McLachlan

The L1-regularized Gaussian maximum likelihood estimator (MLE) has been shown to have strong statistical guarantees in recovering a sparse inverse covariance matrix, or alternatively the underlying graph structure of a Gaussian Markov…

Machine Learning · Computer Science 2013-06-14 Cho-Jui Hsieh , Matyas A. Sustik , Inderjit S. Dhillon , Pradeep Ravikumar

This paper introduces a new version of the smoothly trimmed mean with a more general version of weights, which can be used as an alternative to the classical trimmed mean. We derive its asymptotic variance and to further investigate its…

Statistics Theory · Mathematics 2024-09-10 Elina Kresse , Emils Silins , Janis Valeinis

Model averaging (MA) and ensembling play a crucial role in statistical and machine learning practice. When multiple candidate models are considered, MA techniques can be used to weight and combine them, often resulting in improved…

Statistics Theory · Mathematics 2025-05-06 Jingfu Peng

This paper proposes a closed-form optimal estimator based on the theory of estimating functions for a class of linear ARCH models. The estimating function (EF) estimator has the advantage over the widely used maximum likelihood (ML) and…

Statistics Theory · Mathematics 2008-12-05 Ajay Chandra

Theoretical guarantees are established for a standard estimator in a semi-parametric finite mixture model, where each component density is modeled as a product of univariate densities under a conditional independence assumption. The focus…

Statistics Theory · Mathematics 2025-11-07 Marie Du Roy de Chaumaray , Michael Levine , Matthieu Marbac

The generalized Laplace (GL) distribution, which falls in the larger family of generalized hyperbolic distributions, provides a versatile model to deal with a variety of applications thanks to its shape parameters. The elliptically…

Methodology · Statistics 2025-04-15 Marco Geraci

Consider the problem of estimating a weighted average of the means of $n$ strata, based on a random sample with realized $K_i$ observations from stratum $i, \; i=1,...,n$. This task is non-trivial in cases where for a significant portion of…

Statistics Theory · Mathematics 2019-11-21 Eitan Greenshtein , Ya'acov Ritov

The maximum product of spacings (MPS) is employed in the estimation of the Generalized Extreme Value Distribution (GEV) and the Generalized Pareto Distribution (GPD). Efficient estimators are obtained by the MPS for all $\gamma$. This…

Statistics Theory · Mathematics 2007-06-13 T. S. T. Wong , W. K. Li

With larger data at their disposal, scientists are emboldened to tackle complex questions that require sophisticated statistical models. It is not unusual for the latter to have likelihood functions that elude analytical formulations. Even…

Computation · Statistics 2019-05-17 Evgeny Levi , Radu V. Craiu

Accurately estimating high quantiles beyond the largest observed value is crucial for risk assessment and devising effective adaptation strategies to prevent a greater disaster. The generalized extreme value distribution is widely used for…

Methodology · Statistics 2026-02-24 Yonggwan Shin , Yire Shin , Jeong-Soo Park

Complex scientific models where the likelihood cannot be evaluated present a challenge for statistical inference. Over the past two decades, a wide range of algorithms have been proposed for learning parameters in computationally feasible…

Computation · Statistics 2021-12-16 Aden Forrow , Ruth E. Baker

Motivated by studying asymptotic properties of the maximum likelihood estimator (MLE) in stochastic volatility (SV) models, in this paper we investigate likelihood estimation in state space models. We first prove, under some regularity…

Statistics Theory · Mathematics 2010-11-15 Cheng-Der Fuh

We study three fundamental statistical-learning problems: distribution estimation, property estimation, and property testing. We establish the profile maximum likelihood (PML) estimator as the first unified sample-optimal approach to a wide…

Machine Learning · Statistics 2019-07-12 Yi Hao , Alon Orlitsky

We study mixed models with a single grouping factor, where inference about unknown parameters requires optimizing a marginal likelihood defined by an intractable integral. Low-dimensional numerical integration techniques are regularly used…

Methodology · Statistics 2025-01-22 Alex Stringer , Blair Bilodeau , Yanbo Tang

It is well known that, under standard regularity conditions, the maximum likelihood estimator (MLE) satisfies a central limit theorem and converges in distribution to a Gaussian random variable as the sample size grows. This paper…

Information Theory · Computer Science 2026-05-26 Leighton P. Barnes , Alex Dytso

Nonuniform subsampling methods are effective to reduce computational burden and maintain estimation efficiency for massive data. Existing methods mostly focus on subsampling with replacement due to its high computational efficiency. If the…

Methodology · Statistics 2021-07-06 Jun Yu , HaiYing Wang , Mingyao Ai , Huiming Zhang

We undertake a detailed study of the performance of maximum likelihood (ML) estimators of the density matrix of finite-dimensional quantum systems, in order to interrogate generic properties of frequentist quantum state estimation. Existing…

Quantum Physics · Physics 2011-11-16 Raj Chakrabarti , Anisha Ghosh

We consider the problem of estimating the joint distribution function of the event time and a continuous mark variable based on censored data. More specifically, the event time is subject to current status censoring and the continuous mark…

Statistics Theory · Mathematics 2011-09-07 Piet Groeneboom , Geurt Jongbloed , Birgit Witte

Continuous-time Markov processes over finite state-spaces are widely used to model dynamical processes in many fields of natural and social science. Here, we introduce an maximum likelihood estimator for constructing such models from data…

Data Analysis, Statistics and Probability · Physics 2015-07-01 Robert T. McGibbon , Vijay S. Pande