English
Related papers

Related papers: Settling the Polynomial Learnability of Mixtures o…

200 papers

We study the complexity of learning mixtures of separated Gaussians with common unknown bounded covariance matrix. Specifically, we focus on learning Gaussian mixture models (GMMs) on $\mathbb{R}^d$ of the form $P= \sum_{i=1}^k w_i…

Machine Learning · Computer Science 2023-06-23 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

We study supervised learning problems using clustering constraints to impose structure on either features or samples, seeking to help both prediction and interpretation. The problem of clustering features arises naturally in text…

Machine Learning · Computer Science 2016-09-20 Vincent Roulet , Fajwel Fogel , Alexandre d'Aspremont , Francis Bach

Determining the number of clusters is a fundamental issue in data clustering. Several algorithms have been proposed, including centroid-based algorithms using the Euclidean distance and model-based algorithms using a mixture of probability…

Machine Learning · Computer Science 2024-07-30 Ryosuke Motegi , Yoichi Seki

This paper uses Gaussian mixture model instead of linear Gaussian model to fit the distribution of every node in Bayesian network. We will explain why and how we use Gaussian mixture models in Bayesian network. Meanwhile we propose a new…

Machine Learning · Statistics 2022-05-17 Yiran Dong , Chuanhou Gao

We give a polynomial-time algorithm for learning high-dimensional halfspaces with margins in $d$-dimensional space to within desired TV distance when the ambient distribution is an unknown affine transformation of the $d$-fold product of an…

Machine Learning · Computer Science 2023-11-03 Xinyuan Cao , Santosh S. Vempala

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated…

Machine Learning · Statistics 2025-01-23 Takashi Furuya , Hiroyuki Kusumoto , Koichi Taniguchi , Naoya Kanno , Kazuma Suetake

Gaussian mixture models find their place as a powerful tool, mostly in the clustering problem, but with proper preparation also in feature extraction, pattern recognition, image segmentation and in general machine learning. When faced with…

Machine Learning · Computer Science 2022-04-01 Mateusz Przyborowski , Mateusz Pabiś , Andrzej Janusz , Dominik Ślęzak

We derive uniform convergence rates for the maximum likelihood estimator and minimax lower bounds for parameter estimation in two-component location-scale Gaussian mixture models with unequal variances. We assume the mixing proportions of…

Statistics Theory · Mathematics 2020-06-02 Tudor Manole , Nhat Ho

This work introduces a novel probabilistic deep learning technique called deep Gaussian mixture ensembles (DGMEs), which enables accurate quantification of both epistemic and aleatoric uncertainty. By assuming the data generating process…

Machine Learning · Statistics 2023-06-13 Yousef El-Laham , Niccolò Dalmasso , Elizabeth Fons , Svitlana Vyetrenko

This survey provides an exposition of a suite of techniques based on the theory of polynomials, collectively referred to as polynomial methods, which have recently been applied to address several challenging problems in statistical…

Statistics Theory · Mathematics 2021-04-22 Yihong Wu , Pengkun Yang

We study the clustering problem for mixtures of bounded covariance distributions, under a fine-grained separation assumption. Specifically, given samples from a $k$-component mixture distribution $D = \sum_{i =1}^k w_i P_i$, where each $w_i…

Machine Learning · Computer Science 2023-12-20 Ilias Diakonikolas , Daniel M. Kane , Jasper C. H. Lee , Thanasis Pittas

In this paper, we introduce a novel Gaussian mixture based evidential learning solution for robust stereo matching. Diverging from previous evidential deep learning approaches that rely on a single Gaussian distribution, our framework…

Computer Vision and Pattern Recognition · Computer Science 2024-08-07 Weide Liu , Xingxing Wang , Lu Wang , Jun Cheng , Fayao Liu , Xulei Yang

In applications such as rank aggregation, mixture models for permutations are frequently used when the population exhibits heterogeneity. In this work, we study the widely used Mallows mixture model. In the high-dimensional setting, we…

Statistics Theory · Mathematics 2022-03-07 Cheng Mao , Yihong Wu

The Gaussian mixture model is a classic technique for clustering and data modeling that is used in numerous applications. With the rise of big data, there is a need for parameter estimation techniques that can handle streaming data and…

Artificial Intelligence · Computer Science 2016-09-20 Priyank Jaini , Pascal Poupart

This work concerns learning probabilistic models for ranking data in a heterogeneous population. The specific problem we study is learning the parameters of a Mallows Mixture Model. Despite being widely studied, current heuristics for this…

Machine Learning · Computer Science 2014-11-03 Pranjal Awasthi , Avrim Blum , Or Sheffet , Aravindan Vijayaraghavan

We consider estimating the parameters of a Gaussian mixture density with a given number of components best representing a given set of weighted samples. We adopt a density interpretation of the samples by viewing them as a discrete Dirac…

Machine Learning · Statistics 2025-04-03 Daniel Frisch , Uwe D. Hanebeck

Even in low dimensions, sampling from multi-modal distributions is challenging. We provide the first sampling algorithm for a broad class of distributions -- including all Gaussian mixtures -- with a query complexity that is polynomial in…

Computation · Statistics 2025-10-24 Adrien Vacher , Omar Chehab , Anna Korba

Bi-clustering is a technique that allows for the simultaneous clustering of observations and features in a dataset. This technique is often used in bioinformatics, text mining, and time series analysis. An important advantage of…

Computation · Statistics 2023-02-09 Anastasiia Livochka , Ryan Browne , Sanjeena Subedi

In Gaussian graphical models, the likelihood equations must typically be solved iteratively. We investigate two algorithms: A version of iterative proportional scaling which avoids inversion of large matrices, and an algorithm based on…

Computation · Statistics 2023-12-12 Søren Højsgaard , Steffen Lauritzen

Gaussian mixtures are a powerful and widely used tool to model non-Gaussian estimation problems. They are able to describe measurement errors that follow arbitrary distributions and can represent ambiguity in assignment tasks like point set…

Robotics · Computer Science 2021-04-02 Tim Pfeifer , Sven Lange , Peter Protzel
‹ Prev 1 3 4 5 6 7 10 Next ›