English
Related papers

Related papers: Consistency of the MLE under a two-parameter gamma…

200 papers

In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the…

Signal Processing · Electrical Eng. & Systems 2020-01-10 Nitesh Sahu , Prabhu Babu

Robust estimation under multivariate normal (MVN) mixture model is always a computational challenge. A recently proposed maximum pseudo \b{eta}-likelihood estimator aims to estimate the unknown parameters of a MVN mixture model in the…

Statistics Theory · Mathematics 2023-02-14 Soumya Chakraborty , Ayanendranath Basu , Abhik Ghosh

Markov regime switching models have been widely used in numerous empirical applications in economics and finance. However, the asymptotic distribution of the maximum likelihood estimator (MLE) has not been proven for some empirically…

Statistics Theory · Mathematics 2018-06-29 Hiroyuki Kasahara , Katsumi Shimotsu

In this paper we develop an Expectation Maximization(EM) algorithm to estimate the parameter of a Yule-Simon distribution. The Yule-Simon distribution exhibits the "rich get richer" effect whereby an 80-20 type of rule tends to dominate.…

Computation · Statistics 2020-11-17 Lucas Roberts , Denisa Roberts

Maximum likelihood estimators are used extensively to estimate unknown parameters of stochastic trait evolution models on phylogenetic trees. Although the MLE has been proven to converge to the true value in the independent-sample case, we…

Populations and Evolution · Quantitative Biology 2019-11-26 Lam Si Tung Ho , Vu Dinh , Frederick A. Matsen , Marc A. Suchard

An important question in health services research is the estimation of the proportion of medical expenditures that exceed a given threshold. Typically, medical expenditures present highly skewed, heavy tailed distributions, for which (a)…

Applications · Statistics 2008-07-30 Sergio Venturini , Francesca Dominici , Giovanni Parmigiani

One of the most common methods for statistical inference is the maximum likelihood estimator (MLE). The MLE needs to compute the normalization constant in statistical models, and it is often intractable. Using unnormalized statistical…

Statistics Theory · Mathematics 2016-04-26 Takafumi Kanamori , Takashi Takenouchi

In this study, we propose a mixture logistic regression model with a Markov structure, and consider the estimation of model parameters using maximum likelihood estimation. We also provide a forward type variable selection algorithm to…

Methodology · Statistics 2025-08-28 Yu-Hsiang Cheng , Tzee-Ming Huang

In this work, we propose a new estimation method of a Structural Equation Model. Our method is based on the EM likelihood-maximization algorithm. We show that this method provides estimators, not only of the coefficients of the model, but…

Statistics Theory · Mathematics 2015-10-02 Xavier Bry , Christian Lavergne , Myriam Tami

Normal mean-variance mixture distributions are widely applied to simplify a model's implementation and improve their computational efficiency under the Maximum Likelihood (ML) approach. Especially for distributions with normal mean-variance…

Methodology · Statistics 2015-06-18 Thanakorn Nitithumbundit , Jennifer S. K. Chan

Mixture models have been widely used in modeling of continuous observations. For the possibility to estimate the parameters of a mixture model consistently on the basis of observations from the mixture, identifiability is a necessary…

Probability · Mathematics 2014-07-02 ZiQiang Shi , TieRan Zheng , JiQing Han

To avoid specification of the error distribution in a regression model, we propose a general nonparametric scale mixture model for the error distribution. For fitting such mixtures, the predictive recursion method is a simple and…

Methodology · Statistics 2015-09-03 Ryan Martin , Zhen Han

The article concerns hybrid combinations of empirical and parametric likelihood functions. Combining the two allows classical parametric likelihood to be crucially modified via the nonparametric counterpart, making possible model…

Statistics Theory · Mathematics 2024-09-25 Ingrid Dæhlen , Nils Lid Hjort

The estimation of asset return distributions is crucial for determining optimal trading strategies. In this paper we describe the constrained mixture model, based on a mixture of Gamma and Gaussian distributions, to provide an accurate…

Machine Learning · Statistics 2011-03-15 Iead Rezek

In a mixture of linear regression model, the regression coefficients are treated as random vectors that may follow either a continuous or discrete distribution. We propose two Expectation-Maximization (EM) algorithms to estimate this prior…

Methodology · Statistics 2025-10-17 Andrew Welbaum , Wanli Qiao

We consider a finite mixture of regressions (FMR) model for high-dimensional inhomogeneous data where the number of covariates may be much larger than sample size. We propose an l1-penalized maximum likelihood estimator in an appropriate…

Methodology · Statistics 2012-02-28 Nicolas Städler , Peter Bühlmann , Sara van de Geer

We consider two connected aspects of maximum likelihood estimation of the parameter for high-dimensional discrete graphical models: the existence of the maximum likelihood estimate (mle) and its computation. When the data is sparse, there…

Machine Learning · Statistics 2015-04-22 Helene Massam , Nanwei Wang

We propose a general approach to construct weighted likelihood estimating equations with the aim of obtaining robust parameter estimates. We modify the standard likelihood equations by incorporating a weight that reflects the statistical…

Statistics Theory · Mathematics 2025-07-24 Claudio Agostinelli , Ayanendranath Basu , Giulia Bertagnolli , Arun Kumar Kuchibhotla

Multivariate extreme value statistical analysis is concerned with observations on several variables which are thought to possess some degree of tail-dependence. In areas such as the modeling of financial and insurance risks, or as the…

Applications · Statistics 2014-12-31 Alexis Bienvenüe , Christian Y. Robert

We provide two fundamental results on the population (infinite-sample) likelihood function of Gaussian mixture models with $M \geq 3$ components. Our first main result shows that the population likelihood function has bad local maxima even…

Machine Learning · Statistics 2016-09-06 Chi Jin , Yuchen Zhang , Sivaraman Balakrishnan , Martin J. Wainwright , Michael Jordan