中文
相关论文

相关论文: Learning Mixtures of Spherical Gaussians via Fouri…

200 篇论文

We revisit the problem of learning mixtures of spherical Gaussians. Given samples from mixture $\frac{1}{k}\sum_{j=1}^{k}\mathcal{N}(\mu_j, I_d)$, the goal is to estimate the means $\mu_1, \mu_2, \ldots, \mu_k \in \mathbb{R}^d$ up to a…

机器学习 · 计算机科学 2022-10-07 Mingda Qiao , Guru Guruganesh , Ankit Singh Rawat , Avinava Dubey , Manzil Zaheer

We consider the problem of efficiently learning mixtures of a large number of spherical Gaussians, when the components of the mixture are well separated. In the most basic form of this problem, we are given samples from a uniform mixture of…

数据结构与算法 · 计算机科学 2017-11-01 Oded Regev , Aravindan Vijayaraghavan

In this work, we give a ${\rm poly}(d,k)$ time and sample algorithm for efficiently learning the parameters of a mixture of $k$ spherical distributions in $d$ dimensions. Unlike all previous methods, our techniques apply to heavy-tailed…

数据结构与算法 · 计算机科学 2026-05-22 Alkis Kalavasis , Pravesh K. Kothari , Shuchen Li , Manolis Zampetakis

In this paper we present a method for learning the parameters of a mixture of $k$ identical spherical Gaussians in $n$-dimensional space with an arbitrarily small separation between the components. Our algorithm is polynomial in all…

机器学习 · 计算机科学 2010-05-14 Mikhail Belkin , Kaushik Sinha

We study the problem of learning mixtures of linear classifiers under Gaussian covariates. Given sample access to a mixture of $r$ distributions on $\mathbb{R}^n$ of the form $(\mathbf{x},y_{\ell})$, $\ell\in [r]$, where…

机器学习 · 计算机科学 2023-10-19 Ilias Diakonikolas , Daniel M. Kane , Yuxin Sun

We study the problem of learning mixtures of Gaussians with approximate differential privacy. We prove that roughly $kd^2 + k^{1.5} d^{1.75} + k^2 d$ samples suffice to learn a mixture of $k$ arbitrary $d$-dimensional Gaussians up to low…

机器学习 · 计算机科学 2024-11-05 Hassan Ashtiani , Mahbod Majid , Shyam Narayanan

We prove that $\tilde{\Theta}(k d^2 / \varepsilon^2)$ samples are necessary and sufficient for learning a mixture of $k$ Gaussians in $\mathbb{R}^d$, up to error $\varepsilon$ in total variation distance. This improves both the known upper…

机器学习 · 计算机科学 2020-07-23 Hassan Ashtiani , Shai Ben-David , Nick Harvey , Christopher Liaw , Abbas Mehrabian , Yaniv Plan

We study the problem of list-decodable Gaussian mean estimation and the related problem of learning mixtures of separated spherical Gaussians. We develop a set of techniques that yield new efficient algorithms with significantly improved…

数据结构与算法 · 计算机科学 2017-11-21 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Statistical and machine-learning algorithms are frequently applied to high-dimensional data. In many of these applications data is scarce, and often much more costly than computation time. We provide the first sample-efficient…

机器学习 · 计算机科学 2014-02-20 Jayadev Acharya , Ashkan Jafarpour , Alon Orlitsky , Ananda Theertha Suresh

Mixtures of Gaussian (or normal) distributions arise in a variety of application areas. Many heuristics have been proposed for the task of finding the component Gaussians given samples from the mixture, such as the EM algorithm, a…

概率论 · 数学 2007-05-23 Sanjeev Arora , Ravi Kannan

One of the most popular algorithms for clustering in Euclidean space is the $k$-means algorithm; $k$-means is difficult to analyze mathematically, and few theoretical guarantees are known about it, particularly when the data is {\em…

机器学习 · 计算机科学 2009-12-02 Kamalika Chaudhuri , Sanjoy Dasgupta , Andrea Vattani

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

机器学习 · 计算机科学 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

We study the problem of learning mixtures of $k$ Gaussians in $d$ dimensions. We make no separation assumptions on the underlying mixture components: we only require that the covariance matrices have bounded condition number and that the…

数据结构与算法 · 计算机科学 2024-11-20 Sitan Chen , Vasilis Kontonis , Kulin Shah

We consider the problem of spherical Gaussian Mixture models with $k \geq 3$ components when the components are well separated. A fundamental previous result established that separation of $\Omega(\sqrt{\log k})$ is necessary and sufficient…

机器学习 · 计算机科学 2020-06-22 Jeongyeol Kwon , Constantine Caramanis

We consider the problem of clustering mixtures of mean-separated Gaussians in high dimensions. We are given samples from a mixture of $k$ identity covariance Gaussians, so that the minimum pairwise distance between any two pairs of means is…

数据结构与算法 · 计算机科学 2021-12-02 Jerry Li , Allen Liu

We consider the problem of identifying the parameters of an unknown mixture of two arbitrary $d$-dimensional gaussians from a sequence of independent random samples. Our main results are upper and lower bounds giving a computationally…

机器学习 · 计算机科学 2015-05-19 Moritz Hardt , Eric Price

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

机器学习 · 计算机科学 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee

Given data drawn from a mixture of multivariate Gaussians, a basic problem is to accurately estimate the mixture parameters. We give an algorithm for this problem that has a running time, and data requirement polynomial in the dimension and…

机器学习 · 计算机科学 2010-04-27 Ankur Moitra , Gregory Valiant

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

数据结构与算法 · 计算机科学 2017-11-21 Samuel B. Hopkins , Jerry Li

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

机器学习 · 计算机科学 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis
‹ 上一页 1 2 3 10 下一页 ›