English
Related papers

Related papers: An expectation-maximization algorithm for estimati…

200 papers

We show that a large class of Estimation of Distribution Algorithms, including, but not limited to, Covariance Matrix Adaption, can be written as a Monte Carlo Expectation-Maximization algorithm, and as exact EM in the limit of infinite…

Machine Learning · Computer Science 2022-06-14 David H. Brookes , Akosua Busia , Clara Fannjiang , Kevin Murphy , Jennifer Listgarten

In this letter, we revisit the problem of maximum likelihood estimation (MLE) of parameters of Gaussian Mixture Model (GMM) and show a new derivation for its parameters. The new derivation, unlike the classical approach employing the…

Signal Processing · Electrical Eng. & Systems 2020-01-10 Nitesh Sahu , Prabhu Babu

We propose a new method for the Maximum Likelihood Estimator (MLE) of nonlinear mixed effects models when the variance matrix of Gaussian random effects has a prescribed pattern of zeros (PPZ). The method consists in coupling the recently…

Methodology · Statistics 2009-02-11 Djalil Chafai , Didier Concordet

Modern machine learning uses more and more advanced optimization techniques to find optimal hyper parameters. Whenever the objective function is non-convex, non continuous and with potentially multiple local minima, standard gradient…

Machine Learning · Computer Science 2019-02-13 Eric Benhamou , Jamal Atif , Rida Laraki

The classical mixture of linear experts (MoE) model is one of the widespread statistical frameworks for modeling, classification, and clustering of data. Built on the normality assumption of the error terms for mathematical and…

Methodology · Statistics 2020-07-15 Elham Mirfarah , Mehrdad Naderi , Ding-Geng Chen

Skew normal mixture models provide a more flexible framework than the popular normal mixtures for modelling heterogeneous data with asymmetric behaviors. Due to the unboundedness of likelihood function and the divergency of shape…

Methodology · Statistics 2016-08-05 Libin Jin , Wangli Xu , Liping Zhu , Lixing Zhu

Online variants of the Expectation Maximization (EM) algorithm have recently been proposed to perform parameter inference with large data sets or data streams, in independent latent models and in hidden Markov models. Nevertheless, the…

Statistics Theory · Mathematics 2012-06-01 Sylvain Le Corff , Gersende Fort

In this article, we consider the estimation of unknown parameters of Weibull distribution when the lifetime data are observed in the presence of progressively type-I hybrid censoring scheme. The Newton-Raphson algorithm,…

Statistics Theory · Mathematics 2019-11-12 Yasin Asar , R. Arabi Belaghi

This paper develops a unified estimation framework, the Maximum Ideal Likelihood Estimation (MILE), for general parametric models with latent variables. Unlike traditional approaches relying on the marginal likelihood of the observed data,…

Statistics Theory · Mathematics 2025-10-08 Yizhou Cai , Ting Fung Ma

Mixtures of shifted asymmetric Laplace distributions were introduced as a tool for model-based clustering that allowed for the direct parameterization of skewness in addition to location and scale. Following common practices, an…

Methodology · Statistics 2023-03-28 Yuan Fang , Brian C. Franczak , Sanjeena Subedi

Nonparametric maximum likelihood (NPML) for mixture models is a technique for estimating mixing distributions that has a long and rich history in statistics going back to the 1950s, and is closely related to empirical Bayes methods.…

Methodology · Statistics 2018-01-15 Long Feng , Lee H. Dicker

The problem of monotone missing data has been broadly studied during the last two decades and has many applications in different fields such as bioinformatics or statistics. Commonly used imputation techniques require multiple iterations…

Machine Learning · Computer Science 2020-09-25 Thu Nguyen , Duy H. M. Nguyen , Huy Nguyen , Binh T. Nguyen , Bruce A. Wade

Handling missing values plays an important role in the analysis of survival data, especially, the ones marked by cure fraction. In this paper, we discuss the properties and implementation of stochastic approximations to the…

Methodology · Statistics 2021-07-22 Sandip Barui , Suvra Pal , Nutan Mishra , Katherine Davies

We propose an efficient algorithm for approximate computation of the profile maximum likelihood (PML), a variant of maximum likelihood maximizing the probability of observing a sufficient statistic rather than the empirical sample. The PML…

Machine Learning · Computer Science 2017-12-21 Dmitri S. Pavlichin , Jiantao Jiao , Tsachy Weissman

The Expectation--Maximization (EM) algorithm is a simple meta-algorithm that has been used for many years as a methodology for statistical inference when there are missing measurements in the observed data or when the data is composed of…

Machine Learning · Statistics 2022-11-15 Hideitsu Hino , Shotaro Akaho , Noboru Murata

We consider the system identification problem of estimating a dynamical parameter of a Markovian quantum open system (the atom maser), by performing continuous time measurements in the system's output (outgoing atoms). Two estimation…

Quantum Physics · Physics 2015-06-17 Catalin Catana , Theodore Kypraios , Madalin Guta

The Expectation-Maximization (EM) algorithm is one of the most popular methods used to solve the problem of parametric distribution-based clustering in unsupervised learning. In this paper, we propose to analyze a generalized EM (GEM)…

Optimization and Control · Mathematics 2021-05-19 Sarthak Chatterjee , Orlando Romero , Sérgio Pequito

Finite mixture models have been widely used for the modelling and analysis of data from heterogeneous populations. Maximum likelihood estimation of the parameters is typically carried out via the Expectation-Maximization (EM) algorithm. The…

Computation · Statistics 2016-06-08 Sharon X Lee , Kaleb L Lee , Geoffrey J McLachlan

We introduce a new approach to a linear-circular regression problem that relates multiple linear predictors to a circular response. We follow a modeling approach of a wrapped normal distribution that describes angular variables and angular…

Methodology · Statistics 2019-09-17 Ali Esmaieeli Sikaroudi , Chiwoo Park
‹ Prev 1 3 4 5 6 7 10 Next ›