中文
相关论文

相关论文: Settling the Robust Learnability of Mixtures of Ga…

200 篇论文

We study the efficient learnability of high-dimensional Gaussian mixtures in the outlier-robust setting, where a small constant fraction of the data is adversarially corrupted. We resolve the polynomial learnability of this problem when the…

数据结构与算法 · 计算机科学 2020-05-14 Ilias Diakonikolas , Samuel B. Hopkins , Daniel Kane , Sushrut Karmalkar

We give an efficient algorithm for robustly clustering of a mixture of two arbitrary Gaussians, a central open problem in the theory of computationally efficient robust estimation, assuming only that the the means of the component Gaussians…

数据结构与算法 · 计算机科学 2020-06-02 He Jia , Santosh Vempala

We resolve one of the major outstanding problems in robust statistics. In particular, if $X$ is an evenly weighted mixture of two arbitrary $d$-dimensional Gaussians, we devise a polynomial time algorithm that given access to samples from…

数据结构与算法 · 计算机科学 2020-07-14 Daniel M. Kane

Given data drawn from a mixture of multivariate Gaussians, a basic problem is to accurately estimate the mixture parameters. We give an algorithm for this problem that has a running time, and data requirement polynomial in the dimension and…

机器学习 · 计算机科学 2010-04-27 Ankur Moitra , Gregory Valiant

We give a polynomial-time algorithm for the problem of robustly estimating a mixture of $k$ arbitrary Gaussians in $\mathbb{R}^d$, for any fixed $k$, in the presence of a constant fraction of arbitrary corruptions. This resolves the main…

数据结构与算法 · 计算机科学 2021-06-08 Ainesh Bakshi , Ilias Diakonikolas , He Jia , Daniel M. Kane , Pravesh K. Kothari , Santosh S. Vempala

Mixtures of Gaussian (or normal) distributions arise in a variety of application areas. Many heuristics have been proposed for the task of finding the component Gaussians given samples from the mixture, such as the EM algorithm, a…

概率论 · 数学 2007-05-23 Sanjeev Arora , Ravi Kannan

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

数据结构与算法 · 计算机科学 2017-11-21 Samuel B. Hopkins , Jerry Li

The question of polynomial learnability of probability distributions, particularly Gaussian mixture distributions, has recently received significant attention in theoretical computer science and machine learning. However, despite major…

机器学习 · 计算机科学 2010-05-13 Mikhail Belkin , Kaushik Sinha

In this note, we consider the problem of robust learning mixtures of linear regressions. We connect mixtures of linear regressions and mixtures of Gaussians with a simple thresholding, so that a quasi-polynomial time algorithm can be…

机器学习 · 统计学 2023-05-25 Ying Huang , Liang Chen

In this work we solve the problem of robustly learning a high-dimensional Gaussian mixture model with $k$ components from $\epsilon$-corrupted samples up to accuracy $\widetilde{O}(\epsilon)$ in total variation distance for any constant $k$…

机器学习 · 计算机科学 2021-11-16 Allen Liu , Ankur Moitra

Efficiently learning mixture of Gaussians is a fundamental problem in statistics and learning theory. Given samples coming from a random one out of k Gaussian distributions in Rn, the learning problem asks to estimate the means and the…

机器学习 · 计算机科学 2015-03-11 Rong Ge , Qingqing Huang , Sham M. Kakade

We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an $\varepsilon$-fraction of our samples were chosen by an adversary. We give robust estimators that achieve…

数据结构与算法 · 计算机科学 2017-11-07 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

We study the problem of learning mixtures of $k$ Gaussians in $d$ dimensions. We make no separation assumptions on the underlying mixture components: we only require that the covariance matrices have bounded condition number and that the…

数据结构与算法 · 计算机科学 2024-11-20 Sitan Chen , Vasilis Kontonis , Kulin Shah

In this paper we present a method for learning the parameters of a mixture of $k$ identical spherical Gaussians in $n$-dimensional space with an arbitrarily small separation between the components. Our algorithm is polynomial in all…

机器学习 · 计算机科学 2010-05-14 Mikhail Belkin , Kaushik Sinha

In many applications, data is collected in batches, some of which are corrupt or even adversarial. Recent work derived optimal robust algorithms for estimating discrete distributions in this setting. We consider a general framework of…

机器学习 · 统计学 2020-02-26 Ayush Jain , Alon Orlitsky

In this paper we show that very large mixtures of Gaussians are efficiently learnable in high dimension. More precisely, we prove that a mixture with known identical covariance matrices whose number of components is a polynomial of any…

机器学习 · 计算机科学 2014-02-19 Joseph Anderson , Mikhail Belkin , Navin Goyal , Luis Rademacher , James Voss

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

机器学习 · 计算机科学 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

机器学习 · 计算机科学 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee

We investigate the problem of learning Bayesian networks in a robust model where an $\epsilon$-fraction of the samples are adversarially corrupted. In this work, we study the fully observable discrete case where the structure of the network…

数据结构与算法 · 计算机科学 2018-10-30 Yu Cheng , Ilias Diakonikolas , Daniel Kane , Alistair Stewart

Mixtures of Gaussian factors are powerful tools for modeling an unobserved heterogeneous population, offering - at the same time - dimension reduction and model-based clustering. Unfortunately, the high prevalence of spurious solutions and…

统计方法学 · 统计学 2016-08-08 L. A. García-Escudero , A. Gordaliza , F. Greselin , S. Ingrassia , A. Mayo-Iscar
‹ 上一页 1 2 3 10 下一页 ›