English
Related papers

Related papers: Learning Halfspaces with Massart Noise Under Struc…

200 papers

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

Machine Learning · Computer Science 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Learning intersections of halfspaces is a central problem in Computational Learning Theory. Even for just two halfspaces, it remains a major open question whether learning is possible in polynomial time with respect to the margin $\gamma$…

Machine Learning · Computer Science 2025-11-18 Ilias Diakonikolas , Mingchen Ma , Lisheng Ren , Christos Tzamos

The Forster transform is a method of regularizing a dataset by placing it in {\em radial isotropic position} while maintaining some of its essential properties. Forster transforms have played a key role in a diverse range of settings…

Data Structures and Algorithms · Computer Science 2022-12-07 Ilias Diakonikolas , Christos Tzamos , Daniel M. Kane

We study the learnability of linear separators in $\Re^d$ in the presence of bounded (a.k.a Massart) noise. This is a realistic generalization of the random classification noise model, where the adversary can flip each example $x$ with…

Machine Learning · Computer Science 2015-03-13 Pranjal Awasthi , Maria-Florina Balcan , Nika Haghtalab , Ruth Urner

We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a…

Machine Learning · Computer Science 2023-03-10 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

We study the problem of PAC learning homogeneous halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, the label of every sample is independently flipped with an adversarially controlled probability that can be…

Machine Learning · Computer Science 2020-10-06 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We present an improved algorithm for {\em quasi-properly} learning convex polyhedra in the realizable PAC setting from data with a margin. Our learning algorithm constructs a consistent polyhedron as an intersection of about $t \log t$…

Machine Learning · Computer Science 2021-11-03 Lee-Ad Gottlieb , Eran Kaufman , Aryeh Kontorovich , Gabriel Nivasch

We study the problem of learning adversarially robust halfspaces in the distribution-independent setting. In the realizable setting, we provide necessary and sufficient conditions on the adversarial perturbation sets under which halfspaces…

Machine Learning · Computer Science 2020-05-18 Omar Montasser , Surbhi Goel , Ilias Diakonikolas , Nathan Srebro

Subspace learning is an important problem, which has many applications in image and video processing. It can be used to find a low-dimensional representation of signals and images. But in many applications, the desired signal is heavily…

Computer Vision and Pattern Recognition · Computer Science 2017-07-13 Shervin Minaee , Yao Wang

We study the computational complexity of adversarially robust proper learning of halfspaces in the distribution-independent agnostic PAC model, with a focus on $L_p$ perturbations. We give a computationally efficient learning algorithm and…

Machine Learning · Computer Science 2020-07-31 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

Machine Learning · Computer Science 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

We study the problem of boosting the accuracy of a weak learner in the (distribution-independent) PAC model with Massart noise. In the Massart noise model, the label of each example $x$ is independently misclassified with probability…

Machine Learning · Computer Science 2021-06-16 Ilias Diakonikolas , Russell Impagliazzo , Daniel Kane , Rex Lei , Jessica Sorrell , Christos Tzamos

Towards understanding the statistical complexity of learning from heterogeneous sources, we study the problem of multi-distribution learning. Given $k$ data sources, the goal is to output a classifier for each source by exploiting shared…

Machine Learning · Statistics 2026-02-25 Rafael Hanashiro , Abhishek Shetty , Patrick Jaillet

We analyze the properties of gradient descent on convex surrogates for the zero-one loss for the agnostic learning of linear halfspaces. If $\mathsf{OPT}$ is the best classification error achieved by a halfspace, by appealing to the notion…

Machine Learning · Computer Science 2021-02-16 Spencer Frei , Yuan Cao , Quanquan Gu

We investigate the generalization properties of a self-training algorithm with halfspaces. The approach learns a list of halfspaces iteratively from labeled and unlabeled training data, in which each iteration consists of two steps:…

Machine Learning · Computer Science 2022-02-16 Lies Hadjadj , Massih-Reza Amini , Sana Louhichi , Alexis Deschamps

We provide new results for noise-tolerant and sample-efficient learning algorithms under $s$-concave distributions. The new class of $s$-concave distributions is a broad and natural generalization of log-concavity, and includes many…

Machine Learning · Statistics 2018-01-30 Maria-Florina Balcan , Hongyang Zhang

Abstract notions of convexity over the vertices of a graph, and corresponding notions of halfspaces, have recently gained attention from the machine learning community. In this work we study monophonic halfspaces, a notion of graph…

Machine Learning · Computer Science 2025-07-01 Marco Bressan , Victor Chepoi , Emmanuel Esposito , Maximilian Thiessen

In the classic point location problem, one is given an arbitrary dataset $X \subset \mathbb{R}^d$ of $n$ points with query access to an unknown halfspace $f : \mathbb{R}^d \to \{0,1\}$, and the goal is to learn the label of every point in…

Data Structures and Algorithms · Computer Science 2025-09-26 Hadley Black , Kasper Green Larsen , Arya Mazumdar , Barna Saha , Geelon So

We study the problem of computationally and label efficient PAC active learning $d$-dimensional halfspaces with Tsybakov Noise~\citep{tsybakov2004optimal} under structured unlabeled data distributions. Inspired…

Machine Learning · Computer Science 2024-07-23 Yinan Li , Chicheng Zhang

We study the problem of agnostically learning halfspaces under the Gaussian distribution. Our main result is the {\em first proper} learning algorithm for this problem whose sample complexity and computational complexity qualitatively match…

Machine Learning · Computer Science 2021-02-11 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis