English
Related papers

Related papers: Robustly Clustering a Mixture of Gaussians

200 papers

We consider the problem of estimating means of two Gaussians in a 2-Gaussian mixture, which is not balanced and is corrupted by noise of an arbitrary distribution. We present a robust algorithm to estimate the parameters, together with…

Statistics Theory · Mathematics 2019-07-23 Jing Xu , Jakub Marecek

We propose an approach to construction of robust non-Euclidean iterative algorithms for convex composite stochastic optimization based on truncation of stochastic gradients. For such algorithms, we establish sub-Gaussian confidence bounds…

Statistics Theory · Mathematics 2019-07-08 Anatoli Juditsky , Alexander Nazin , Arkadi Nemirovsky , Alexandre Tsybakov

We propose a Fourier-based approach for optimization of several clustering algorithms. Mathematically, clusters data can be described by a density function represented by the Dirac mixture distribution. The density function can be smoothed…

Machine Learning · Computer Science 2019-09-24 Soheil Mehrabkhani

Accurate platform localization is an integral component of most robotic systems. As these robotic systems become more ubiquitous, it is necessary to develop robust state estimation algorithms that are able to withstand novel and…

Robotics · Computer Science 2019-10-15 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

In this paper, we study convergence properties of the gradient Expectation-Maximization algorithm \cite{lange1995gradient} for Gaussian Mixture Models for general number of clusters and mixing coefficients. We derive the convergence rate…

Statistics Theory · Mathematics 2017-12-05 Bowei Yan , Mingzhang Yin , Purnamrita Sarkar

We study the supervised clustering problem under the two-component anisotropic Gaussian mixture model in high dimensions and in the non-asymptotic setting. We first derive a lower and a matching upper bound for the minimax risk of…

Statistics Theory · Mathematics 2021-11-16 Stanislav Minsker , Mohamed Ndaoud , Yiqiu Shen

This work provides a computationally efficient and statistically consistent moment-based estimator for mixtures of spherical Gaussians. Under the condition that component means are in general position, a simple spectral decomposition…

Machine Learning · Computer Science 2012-10-30 Daniel Hsu , Sham M. Kakade

A mixture of factor analyzers is a semi-parametric density estimator that generalizes the well-known mixtures of Gaussians model by allowing each Gaussian in the mixture to be represented in a different lower-dimensional manifold. This…

Machine Learning · Statistics 2015-10-23 Heysem Kaya , Albert Ali Salah

This paper considers a canonical clustering problem where one receives unlabeled samples drawn from a balanced mixture of two elliptical distributions and aims for a classifier to estimate the labels. Many popular methods including PCA and…

Machine Learning · Statistics 2021-11-30 Kaizheng Wang , Yuling Yan , Mateo Díaz

Parameter estimation for model-based clustering using a finite mixture of normal inverse Gaussian (NIG) distributions is achieved through variational Bayes approximations. Univariate NIG mixtures and multivariate NIG mixtures are…

Methodology · Statistics 2017-10-09 Sanjeena Subedi , Paul D. McNicholas

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

Machine Learning · Computer Science 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

Mixture models are a natural choice in many applications, but it can be difficult to place an a priori upper bound on the number of components. To circumvent this, investigators are turning increasingly to Dirichlet process mixture models…

Statistics Theory · Mathematics 2018-06-22 Łukasz Rajkowski

A model involving Gaussian processes (GPs) is introduced to simultaneously handle multi-task learning, clustering, and prediction for multiple functional data. This procedure acts as a model-based clustering method for functional data as…

Machine Learning · Computer Science 2023-01-24 Arthur Leroy , Pierre Latouche , Benjamin Guedj , Servane Gey

Coresets are efficient representations of data sets such that models trained on the coreset are provably competitive with models trained on the original data set. As such, they have been successfully used to scale up clustering models such…

Machine Learning · Statistics 2016-05-03 Mario Lucic , Olivier Bachem , Andreas Krause

We introduce a new approach to deciding the number of clusters. The approach is applied to Optimally Tuned Robust Improper Maximum Likelihood Estimation (OTRIMLE; Coretto and Hennig 2016) of a Gaussian mixture model allowing for…

Methodology · Statistics 2020-12-29 Christian Hennig , Pietro Coretto

Convex clustering is an attractive clustering algorithm with favorable properties such as efficiency and optimality owing to its convex formulation. It is thought to generalize both k-means clustering and agglomerative clustering. However,…

Machine Learning · Statistics 2021-05-19 Canh Hao Nguyen , Hiroshi Mamitsuka

The Gaussian kernel and its traditional normalizations (e.g., row-stochastic) are popular approaches for assessing similarities between data points. Yet, they can be inaccurate under high-dimensional noise, especially if the noise magnitude…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Xiuyuan Cheng

Model-based clustering approaches concern the paradigm of exploratory data analysis relying on the finite mixture model to automatically find a latent structure governing observed data. They are one of the most popular and successful…

Methodology · Statistics 2014-04-29 Faicel Chamroukhi

Algorithms for community detection are usually stochastic, leading to different partitions for different choices of random seeds. Consensus clustering has proven to be an effective technique to derive more stable and accurate partitions…

Physics and Society · Physics 2019-04-23 Aditya Tandon , Aiiad Albeshri , Vijey Thayananthan , Wadee Alhalabi , Santo Fortunato

Heavy-tailed distributions are widely used in robust mixture modelling due to possessing thick tails. As a computationally tractable subclass of the stable distributions, sub-Gaussian $\alpha$-stable distribution received much interest in…

Machine Learning · Statistics 2017-01-25 Mahdi Teimouri , Saeid Rezakhah , Adel Mohammdpour