中文
相关论文

相关论文: A Spectral Algorithm for List-Decodable Covariance…

200 篇论文

We study the complexity of learning mixtures of separated Gaussians with common unknown bounded covariance matrix. Specifically, we focus on learning Gaussian mixture models (GMMs) on $\mathbb{R}^d$ of the form $P= \sum_{i=1}^k w_i…

机器学习 · 计算机科学 2023-06-23 Ilias Diakonikolas , Daniel M. Kane , Thanasis Pittas , Nikos Zarifis

In this work, we propose variations of a Gaussian mixture model (GMM) based channel estimator that was recently proven to be asymptotically optimal in the minimum mean square error (MMSE) sense. We account for the need of low computational…

信息论 · 计算机科学 2023-06-06 Benedikt Fesl , Michael Joham , Sha Hu , Michael Koller , Nurettin Turan , Wolfgang Utschick

We study efficient algorithms for linear regression and covariance estimation in the absence of Gaussian assumptions on the underlying distributions of samples, making assumptions instead about only finitely-many moments. We focus on how…

We design a new, fast algorithm for agnostically learning univariate probability distributions whose densities are well approximated by piecewise polynomial functions. Let $f$ be the density function of an arbitrary univariate distribution,…

数据结构与算法 · 计算机科学 2015-06-03 Jayadev Acharya , Ilias Diakonikolas , Jerry Li , Ludwig Schmidt

In this paper, we study the problem of learning one-dimensional Gaussian mixture models (GMMs) with a specific focus on estimating both the model order and the mixing distribution from independent and identically distributed (i.i.d.)…

机器学习 · 统计学 2026-02-24 Xinyu Liu , Hai Zhang

Statistical and machine-learning algorithms are frequently applied to high-dimensional data. In many of these applications data is scarce, and often much more costly than computation time. We provide the first sample-efficient…

机器学习 · 计算机科学 2014-02-20 Jayadev Acharya , Ashkan Jafarpour , Alon Orlitsky , Ananda Theertha Suresh

We present a fast, differentially private algorithm for high-dimensional covariance-aware mean estimation with nearly optimal sample complexity. Only exponential-time estimators were previously known to achieve this guarantee. Given $n$…

机器学习 · 计算机科学 2025-11-26 Gavin Brown , Samuel B. Hopkins , Adam Smith

Given data drawn from a mixture of multivariate Gaussians, a basic problem is to accurately estimate the mixture parameters. We give an algorithm for this problem that has a running time, and data requirement polynomial in the dimension and…

机器学习 · 计算机科学 2010-04-27 Ankur Moitra , Gregory Valiant

Learning from data in the presence of outliers is a fundamental problem in statistics. Until recently, no computationally efficient algorithms were known to compute the mean of a high dimensional distribution under natural assumptions in…

数据结构与算法 · 计算机科学 2021-01-22 Yeshwanth Cherapanamjeri , Sidhanth Mohanty , Morris Yau

A novel formulation of the clustering problem is introduced in which the task is expressed as an estimation problem, where the object to be estimated is a function which maps a point to its distribution of cluster membership. Unlike…

机器学习 · 计算机科学 2025-10-14 David P. Hofmeyr

Gaussian Mixture Models (GMMs) range among the most frequently used models in machine learning. However, training large, general GMMs becomes computationally prohibitive for datasets that have many data points $N$ of high-dimensionality…

机器学习 · 统计学 2025-12-12 Sebastian Salwig , Till Kahlke , Florian Hirschberger , Dennis Forster , Jörg Lücke

We consider the estimation of parametric fractional time series models in which not only is the memory parameter unknown, but one may not know whether it lies in the stationary/invertible region or the nonstationary or noninvertible…

统计理论 · 数学 2012-03-14 Javier Hualde , Peter M. Robinson

We study the problem of estimating the parameters of a Gaussian distribution when samples are only shown if they fall in some (unknown) subset $S \subseteq \R^d$. This core problem in truncated statistics has long history going back to…

统计理论 · 数学 2019-08-06 Vasilis Kontonis , Christos Tzamos , Manolis Zampetakis

We begin the study of list-decodable linear regression using batches. In this setting only an $\alpha \in (0,1]$ fraction of the batches are genuine. Each genuine batch contains $\ge n$ i.i.d. samples from a common unknown distribution and…

机器学习 · 计算机科学 2022-11-24 Abhimanyu Das , Ayush Jain , Weihao Kong , Rajat Sen

We study the fundamental problem of high-dimensional mean estimation in a robust model where a constant fraction of the samples are adversarially corrupted. Recent work gave the first polynomial time algorithms for this problem with…

机器学习 · 计算机科学 2018-11-26 Yu Cheng , Ilias Diakonikolas , Rong Ge

We give a new algorithm for learning mixtures of $k$ Gaussians (with identity covariance in $\mathbb{R}^n$) to TV error $\varepsilon$, with quasi-polynomial ($O(n^{\text{poly\,log}\left(\frac{n+k}{\varepsilon}\right)})$) time and sample…

机器学习 · 计算机科学 2025-03-05 Khashayar Gatmiry , Jonathan Kelner , Holden Lee

We give an efficient algorithm for robustly clustering of a mixture of two arbitrary Gaussians, a central open problem in the theory of computationally efficient robust estimation, assuming only that the the means of the component Gaussians…

数据结构与算法 · 计算机科学 2020-06-02 He Jia , Santosh Vempala

We consider the task of privately obtaining prediction error guarantees in ordinary least-squares regression problems with Gaussian covariates (with unknown covariance structure). We provide the first sample-optimal polynomial time…

数据结构与算法 · 计算机科学 2025-04-01 Prashanti Anderson , Ainesh Bakshi , Mahbod Majid , Stefan Tiegel

We study the problem of learning mixtures of $k$ Gaussians in $d$ dimensions. We make no separation assumptions on the underlying mixture components: we only require that the covariance matrices have bounded condition number and that the…

数据结构与算法 · 计算机科学 2024-11-20 Sitan Chen , Vasilis Kontonis , Kulin Shah

We study the problem of list-decodable linear regression, where an adversary can corrupt a majority of the examples. Specifically, we are given a set $T$ of labeled examples $(x, y) \in \mathbb{R}^d \times \mathbb{R}$ and a parameter $0<…

数据结构与算法 · 计算机科学 2021-06-18 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas , Alistair Stewart