English
Related papers

Related papers: Mixture of segmentation for heterogeneous function…

200 papers

We study the convergence behavior of the Expectation Maximization (EM) algorithm on Gaussian mixture models with an arbitrary number of mixture components and mixing weights. We show that as long as the means of the components are separated…

Statistics Theory · Mathematics 2018-10-10 Ruofei Zhao , Yuanzhi Li , Yuekai Sun

In a mixture of linear regression model, the regression coefficients are treated as random vectors that may follow either a continuous or discrete distribution. We propose two Expectation-Maximization (EM) algorithms to estimate this prior…

Methodology · Statistics 2025-10-17 Andrew Welbaum , Wanli Qiao

Gaussian mixture models (GMMs) are fundamental statistical tools for modeling heterogeneous data. Due to the nonconcavity of the likelihood function, the Expectation-Maximization (EM) algorithm is widely used for parameter estimation of…

Statistics Theory · Mathematics 2025-11-10 Xin Bing , Dehan Kong , Bingqing Li

In a regression analysis, suppose we suspect that there are several heterogeneous groups in the population that a sample represents. Mixture regression models have been applied to address such problems. By modeling the conditional…

Methodology · Statistics 2013-07-02 Toshiya Hoshikawa

We show how the expectation-maximization (EM) algorithm can be applied exactly for the fitting of mixtures of general multivariate skew t (MST) distributions, eliminating the need for computationally expensive Monte Carlo estimation. Finite…

Methodology · Statistics 2012-09-06 S. X. Lee , G. J. McLachlan

The family of Expectation-Maximization (EM) algorithms provides a general approach to fitting flexible models for large and complex data. The expectation (E) step of EM-type algorithms is time-consuming in massive data applications because…

Computation · Statistics 2018-06-21 Sanvesh Srivastava , Glen DePalma , Chuanhai Liu

We study a class of weakly identifiable location-scale mixture models for which the maximum likelihood estimates based on $n$ i.i.d. samples are known to have lower accuracy than the classical $n^{- \frac{1}{2}}$ error. We investigate…

Statistics Theory · Mathematics 2021-11-17 Raaz Dwivedi , Nhat Ho , Koulik Khamaru , Martin J. Wainwright , Michael I. Jordan , Bin Yu

This paper tackles the problem of missing data imputation for noisy and non-Gaussian data. A classical imputation method, the Expectation Maximization (EM) algorithm for Gaussian mixture models, has shown interesting properties when…

Machine Learning · Statistics 2023-05-23 Florian Mouret , Alexandre Hippert-Ferrer , Frédéric Pascal , Jean-Yves Tourneret

(Neal and Hinton, 1998) recast maximum likelihood estimation of any given latent variable model as the minimization of a free energy functional $F$, and the EM algorithm as coordinate descent applied to $F$. Here, we explore alternative…

Computation · Statistics 2023-02-21 Juan Kuntz , Jen Ning Lim , Adam M. Johansen

Identification of charged particles in a multilayer detector by the energy loss technique may also be achieved by the use of a neural network. The performance of the network becomes worse when a large fraction of information is missing, for…

Methodology · Statistics 2020-04-14 S. Riggi , D. Riggi , F. Riggi

This study presents a semi-nonparametric Latent Class Choice Model (LCCM) with a flexible class membership component. The proposed model formulates the latent classes using mixture models as an alternative approach to the traditional random…

Data clustering has received a lot of attention and numerous methods, algorithms and software packages are available. Among these techniques, parametric finite-mixture models play a central role due to their interesting mathematical…

Computer Vision and Pattern Recognition · Computer Science 2017-01-31 Israel D. Gebru , Xavier Alameda-Pineda , Florence Forbes , Radu Horaud

This paper proposes a method of segmenting temporal data into ordered classes. It is based on mixture models and a discrete latent process, which enables to successively activates the classes. The classification can be performed by…

Machine Learning · Statistics 2013-12-30 Faicel Chamroukhi , Allou Samé , Gérard Govaert , Patrice Aknin

The finite Gamma mixture model is often used to describe randomness in income data, insurance data, and data from other applications. The popular likelihood approach, however, does not work for this model because the likelihood function is…

Statistics Theory · Mathematics 2020-11-10 Mingxing He , Jiahua Chen

Recommender Systems have proliferated as general-purpose approaches to model a wide variety of consumer interaction data. Specific instances make use of signals ranging from user feedback, item relationships, geographic locality, social…

Information Retrieval · Computer Science 2018-08-31 Wang-Cheng Kang , Mengting Wan , Julian McAuley

Analysis of multivariate healthcare time series data is inherently challenging: irregular sampling, noisy and missing values, and heterogeneous patient groups with different dynamics violating exchangeability. In addition, interpretability…

Machine Learning · Computer Science 2023-11-15 Onur Poyraz , Pekka Marttinen

In many applications, data can be heterogeneous in the sense of spanning latent groups with different underlying distributions. When predictive models are applied to such data the heterogeneity can affect both predictive performance and…

Machine Learning · Statistics 2022-05-04 Thomas Lartigue , Sach Mukherjee

Human microbiome studies based on genetic sequencing techniques produce compositional longitudinal data of the relative abundances of microbial taxa over time, allowing to understand, through mixed-effects modeling, how microbial…

Methodology · Statistics 2025-12-23 John Barrera , Cristian Meza , Ana Arribas-Gil

Complex biological processes are usually experimented along time among a collection of individuals. Longitudinal data are then available and the statistical challenge is to better understand the underlying biological mechanisms. The…

Statistics Theory · Mathematics 2015-06-11 Pierre Barbillon , Célia Barthélémy , Adeline Samson

In this paper, we consider the task of clustering a set of individual time series while modeling each cluster, that is, model-based time series clustering. The task requires a parametric model with sufficient flexibility to describe the…

Machine Learning · Computer Science 2023-02-23 Ryohei Umatani , Takashi Imai , Kaoru Kawamoto , Shutaro Kunimasa