中文
相关论文

相关论文: A PTAS for Agnostically Learning Halfspaces

200 篇论文

We study several questions related to diversifying search results. We give improved approximation algorithms in each of the following problems, together with some lower bounds. - We give a polynomial-time approximation scheme (PTAS) for a…

数据结构与算法 · 计算机科学 2022-03-04 Amir Abboud , Vincent Cohen-Addad , Euiwoong Lee , Pasin Manurangsi

We give an algorithm that learns arbitrary Boolean functions of $k$ arbitrary halfspaces over $\mathbb{R}^n$, in the challenging distribution-free Probably Approximately Correct (PAC) learning model, running in time $2^{\sqrt{n} \cdot (\log…

数据结构与算法 · 计算机科学 2026-03-10 Josh Alman , Shyamal Patel , Rocco A. Servedio

We study the task of agnostic learning of multiclass linear classifiers under the Gaussian distribution. Given labeled examples $(x, y)$ from a distribution over $\mathbb{R}^d \times [k]$, with Gaussian $x$-marginal, the goal is to output a…

机器学习 · 计算机科学 2026-05-21 Ilias Diakonikolas , Giannis Iakovidis , Mingchen Ma

We study the complexity of smoothed agnostic learning of halfspaces on $\{\pm 1\}^n$ under uniform marginals in the model of~\cite{KM25}, where each input coordinate is independently flipped with probability $\sigma \in (0, {1}/{2})$. We…

机器学习 · 计算机科学 2026-05-14 Tim Sinen

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

机器学习 · 计算机科学 2021-06-24 Jie Shen

We study several questions in the reliable agnostic learning framework of Kalai et al. (2009), which captures learning tasks in which one type of error is costlier than others. A positive reliable classifier is one that makes no false…

机器学习 · 计算机科学 2014-02-25 Varun Kanade , Justin Thaler

We analyze the properties of gradient descent on convex surrogates for the zero-one loss for the agnostic learning of linear halfspaces. If $\mathsf{OPT}$ is the best classification error achieved by a halfspace, by appealing to the notion…

机器学习 · 计算机科学 2021-02-16 Spencer Frei , Yuan Cao , Quanquan Gu

We study the problem of supervised learning a metric space under discriminative constraints. Given a universe $X$ and sets ${\cal S}, {\cal D}\subset {X \choose 2}$ of similar and dissimilar pairs, we seek to find a mapping $f:X\to Y$, into…

计算几何 · 计算机科学 2019-03-20 Diego Ihara Centurion , Neshat Mohammadi , Anastasios Sidiropoulos

In the classic point location problem, one is given an arbitrary dataset $X \subset \mathbb{R}^d$ of $n$ points with query access to an unknown halfspace $f : \mathbb{R}^d \to \{0,1\}$, and the goal is to learn the label of every point in…

数据结构与算法 · 计算机科学 2025-09-26 Hadley Black , Kasper Green Larsen , Arya Mazumdar , Barna Saha , Geelon So

We study the efficient PAC learnability of halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, each label is independently flipped with some probability which is controlled by an adversary. This noise model…

机器学习 · 计算机科学 2020-06-12 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We use the Sum of Squares method to develop new efficient algorithms for learning well-separated mixtures of Gaussians and robust mean estimation, both in high dimensions, that substantially improve upon the statistical guarantees achieved…

数据结构与算法 · 计算机科学 2017-11-21 Samuel B. Hopkins , Jerry Li

We revisit the problem of distribution learning within the framework of learning-augmented algorithms. In this setting, we explore the scenario where a probability distribution is provided as potentially inaccurate advice on the true,…

机器学习 · 计算机科学 2025-02-03 Arnab Bhattacharyya , Davin Choo , Philips George John , Themis Gouleakis

We present a unified framework for designing deterministic monotone polynomial time approximation schemes (PTAS's) for a wide class of scheduling problems on uniformly related machines. This class includes (among others) minimizing the…

数据结构与算法 · 计算机科学 2015-03-20 Leah Epstein , Asaf Levin , Rob van Stee

Rubinfeld & Vasilyan recently introduced the framework of testable learning as an extension of the classical agnostic model. It relaxes distributional assumptions which are difficult to verify by conditions that can be checked efficiently…

机器学习 · 计算机科学 2024-11-07 Lucas Slot , Stefan Tiegel , Manuel Wiedmer

We give the first polynomial-time algorithm for performing linear or polynomial regression resilient to adversarial corruptions in both examples and labels. Given a sufficiently large (polynomial-size) training set drawn i.i.d. from…

机器学习 · 计算机科学 2020-06-05 Adam Klivans , Pravesh K. Kothari , Raghu Meka

The algorithm and complexity of approximating the permanent of a matrix is an extensively studied topic. Recently, its connection with quantum supremacy and more specifically BosonSampling draws special attention to the average-case…

数据结构与算法 · 计算机科学 2019-12-02 Zhengfeng Ji , Zhihan Jin , Pinyan Lu

We study the fundamental problem of learning the parameters of a high-dimensional Gaussian in the presence of noise -- where an $\varepsilon$-fraction of our samples were chosen by an adversary. We give robust estimators that achieve…

数据结构与算法 · 计算机科学 2017-11-07 Ilias Diakonikolas , Gautam Kamath , Daniel M. Kane , Jerry Li , Ankur Moitra , Alistair Stewart

We study ``selective'' or ``conditional'' classification problems under an agnostic setting. Classification tasks commonly focus on modeling the relationship between features and categories that captures the vast majority of data. In…

机器学习 · 计算机科学 2025-02-04 Jizhou Huang , Brendan Juba

We study the problem of {\em distribution-independent} PAC learning of halfspaces in the presence of Massart noise. Specifically, we are given a set of labeled examples $(\mathbf{x}, y)$ drawn from a distribution $\mathcal{D}$ on…

机器学习 · 计算机科学 2019-12-11 Ilias Diakonikolas , Themis Gouleakis , Christos Tzamos

Learning intersections of halfspaces is a central problem in Computational Learning Theory. Even for just two halfspaces, it remains a major open question whether learning is possible in polynomial time with respect to the margin $\gamma$…

机器学习 · 计算机科学 2025-11-18 Ilias Diakonikolas , Mingchen Ma , Lisheng Ren , Christos Tzamos