English
Related papers

Related papers: Efficient Learning of Linear Separators under Boun…

200 papers

We give a $2^{\tilde{O}(\sqrt{n}/\epsilon)}$-time algorithm for properly learning monotone Boolean functions under the uniform distribution over $\{0,1\}^n$. Our algorithm is robust to adversarial label noise and has a running time nearly…

Data Structures and Algorithms · Computer Science 2023-03-29 Jane Lange , Ronitt Rubinfeld , Arsen Vasilyan

In this paper we revisit some classic problems on classification under misspecification. In particular, we study the problem of learning halfspaces under Massart noise with rate $\eta$. In a recent work, Diakonikolas, Goulekakis, and Tzamos…

Machine Learning · Computer Science 2023-09-21 Sitan Chen , Frederic Koehler , Ankur Moitra , Morris Yau

We give the first fully polynomial-time algorithm for learning halfspaces with respect to the uniform distribution on the hypercube in the presence of contamination, where an adversary may corrupt some fraction of examples and labels…

Data Structures and Algorithms · Computer Science 2025-11-11 Gautam Chandrasekaran , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We study the problem of PAC learning halfspaces on $\mathbb{R}^d$ with Massart noise under the Gaussian distribution. In the Massart model, an adversary is allowed to flip the label of each point $\mathbf{x}$ with unknown probability…

Machine Learning · Computer Science 2021-11-09 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study the problem of learning adversarially robust halfspaces in the distribution-independent setting. In the realizable setting, we provide necessary and sufficient conditions on the adversarial perturbation sets under which halfspaces…

Machine Learning · Computer Science 2020-05-18 Omar Montasser , Surbhi Goel , Ilias Diakonikolas , Nathan Srebro

We give a computationally-efficient PAC active learning algorithm for $d$-dimensional homogeneous halfspaces that can tolerate Massart noise (Massart and N\'ed\'elec, 2006) and Tsybakov noise (Tsybakov, 2004). Specialized to the…

Machine Learning · Computer Science 2021-08-12 Chicheng Zhang , Yinan Li

We study the problem of PAC learning $\gamma$-margin halfspaces with Massart noise. We propose a simple proper learning algorithm, the Perspectron, that has sample complexity $\widetilde{O}((\epsilon\gamma)^{-2})$ and achieves…

Machine Learning · Computer Science 2025-01-20 Gautam Chandrasekaran , Vasilis Kontonis , Konstantinos Stavropoulos , Kevin Tian

This paper is concerned with computationally efficient learning of homogeneous sparse halfspaces in $\mathbb{R}^d$ under noise. Though recent works have established attribute-efficient learning algorithms under various types of label noise…

Machine Learning · Statistics 2021-03-03 Jie Shen , Chicheng Zhang

Towards understanding the statistical complexity of learning from heterogeneous sources, we study the problem of multi-distribution learning. Given $k$ data sources, the goal is to output a classifier for each source by exploiting shared…

Machine Learning · Statistics 2026-02-25 Rafael Hanashiro , Abhishek Shetty , Patrick Jaillet

We consider the problem of training a model under the presence of label noise. Current approaches identify samples with potentially incorrect labels and reduce their influence on the learning process by either assigning lower weights to…

Machine Learning · Computer Science 2019-06-04 Duc Tam Nguyen , Thi-Phuong-Nhung Ngo , Zhongyu Lou , Michael Klar , Laura Beggel , Thomas Brox

It is shown that a class of optical physical unclonable functions (PUFs) can be learned to arbitrary precision with arbitrarily high probability, even in the presence of noise, given access to polynomially many challenge-response pairs and…

Machine Learning · Computer Science 2023-09-08 Apollo Albright , Boris Gelfand , Michael Dixon

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

Machine Learning · Computer Science 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

We describe a slightly sub-exponential time algorithm for learning parity functions in the presence of random classification noise. This results in a polynomial-time algorithm for the case of parity functions that depend on only the first…

Machine Learning · Computer Science 2007-05-23 Avrim Blum , Adam Kalai , Hal Wasserman

We study non-convex empirical risk minimization for learning halfspaces and neural networks. For loss functions that are $L$-Lipschitz continuous, we present algorithms to learn halfspaces and multi-layer neural networks that achieve…

Machine Learning · Computer Science 2015-11-26 Yuchen Zhang , Jason D. Lee , Martin J. Wainwright , Michael I. Jordan

It has been a long-standing problem to efficiently learn a halfspace using as few labels as possible in the presence of noise. In this work, we propose an efficient Perceptron-based algorithm for actively learning homogeneous halfspaces…

Machine Learning · Computer Science 2017-11-07 Songbai Yan , Chicheng Zhang

We describe a framework for designing efficient active learning algorithms that are tolerant to random classification noise and are differentially-private. The framework is based on active learning algorithms that are statistical in the…

Machine Learning · Computer Science 2014-11-06 Maria Florina Balcan , Vitaly Feldman

We consider the problem of estimating how well a model class is capable of fitting a distribution of labeled data. We show that it is often possible to accurately estimate this "learnability" even when given an amount of data that is too…

Machine Learning · Computer Science 2019-03-26 Weihao Kong , Gregory Valiant

Inspired by recent work on learning with distribution shift, we give a general outlier removal algorithm called iterative polynomial filtering and show a number of striking applications for supervised learning with contamination: (1) We…

Machine Learning · Computer Science 2026-01-13 Adam R. Klivans , Konstantinos Stavropoulos , Kevin Tian , Arsen Vasilyan

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

Machine Learning · Computer Science 2025-02-18 Jie Shen

We provide new results concerning label efficient, polynomial time, passive and active learning of linear separators. We prove that active learning provides an exponential improvement over PAC (passive) learning of homogeneous linear…

Machine Learning · Computer Science 2013-04-29 Maria Florina Balcan , Philip M. Long