中文
相关论文

相关论文: Learning General Halfspaces with General Massart N…

200 篇论文

In the classic point location problem, one is given an arbitrary dataset $X \subset \mathbb{R}^d$ of $n$ points with query access to an unknown halfspace $f : \mathbb{R}^d \to \{0,1\}$, and the goal is to learn the label of every point in…

数据结构与算法 · 计算机科学 2025-09-26 Hadley Black , Kasper Green Larsen , Arya Mazumdar , Barna Saha , Geelon So

We give the first fully polynomial-time algorithm for learning halfspaces with respect to the uniform distribution on the hypercube in the presence of contamination, where an adversary may corrupt some fraction of examples and labels…

数据结构与算法 · 计算机科学 2025-11-11 Gautam Chandrasekaran , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

机器学习 · 计算机科学 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

机器学习 · 计算机科学 2025-02-18 Jie Shen

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

机器学习 · 计算机科学 2021-10-06 Jie Shen

We study the problem of boosting the accuracy of a weak learner in the (distribution-independent) PAC model with Massart noise. In the Massart noise model, the label of each example $x$ is independently misclassified with probability…

机器学习 · 计算机科学 2021-06-16 Ilias Diakonikolas , Russell Impagliazzo , Daniel Kane , Rex Lei , Jessica Sorrell , Christos Tzamos

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

机器学习 · 计算机科学 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

机器学习 · 计算机科学 2021-06-24 Jie Shen

Recent work of Klivans, Stavropoulos, and Vasilyan initiated the study of testable learning with distribution shift (TDS learning), where a learner is given labeled samples from training distribution $\mathcal{D}$, unlabeled samples from…

数据结构与算法 · 计算机科学 2024-05-22 Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We study the learnability of linear separators in $\Re^d$ in the presence of bounded (a.k.a Massart) noise. This is a realistic generalization of the random classification noise model, where the adversary can flip each example $x$ with…

机器学习 · 计算机科学 2015-03-13 Pranjal Awasthi , Maria-Florina Balcan , Nika Haghtalab , Ruth Urner

We show hardness of improperly learning halfspaces in the agnostic model, both in the distribution-independent as well as the distribution-specific setting, based on the assumption that worst-case lattice problems, such as GapSVP or SIVP,…

机器学习 · 计算机科学 2023-02-21 Stefan Tiegel

We give the first tester-learner for halfspaces that succeeds universally over a wide class of structured distributions. Our universal tester-learner runs in fully polynomial time and has the following guarantee: the learner achieves error…

机器学习 · 计算机科学 2023-05-22 Aravind Gollakota , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We pose a fundamental question in computational learning theory: can we efficiently test whether a training set satisfies the assumptions of a given noise model? This question has remained unaddressed despite decades of research on learning…

机器学习 · 计算机科学 2026-05-11 Surbhi Goel , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

We give an algorithm that learns arbitrary Boolean functions of $k$ arbitrary halfspaces over $\mathbb{R}^n$, in the challenging distribution-free Probably Approximately Correct (PAC) learning model, running in time $2^{\sqrt{n} \cdot (\log…

数据结构与算法 · 计算机科学 2026-03-10 Josh Alman , Shyamal Patel , Rocco A. Servedio

It has been a long-standing problem to efficiently learn a halfspace using as few labels as possible in the presence of noise. In this work, we propose an efficient Perceptron-based algorithm for actively learning homogeneous halfspaces…

机器学习 · 计算机科学 2017-11-07 Songbai Yan , Chicheng Zhang

This paper is concerned with computationally efficient learning of homogeneous sparse halfspaces in $\mathbb{R}^d$ under noise. Though recent works have established attribute-efficient learning algorithms under various types of label noise…

机器学习 · 统计学 2021-03-03 Jie Shen , Chicheng Zhang

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces under the Gaussian distribution on $R^d$ in the presence of some form of query access. In the classical pool-based active learning model, where the…

机器学习 · 计算机科学 2025-01-03 Ilias Diakonikolas , Daniel M. Kane , Mingchen Ma

Many popular learning algorithms (E.g. Regression, Fourier-Transform based algorithms, Kernel SVM and Kernel ridge regression) operate by reducing the problem to a convex optimization problem over a vector space of functions. These methods…

机器学习 · 计算机科学 2014-05-13 Amit Daniely , Nati Linial , Shai Shalev-Shwartz

We study the task of agnostically learning halfspaces under the Gaussian distribution. Specifically, given labeled examples $(\mathbf{x},y)$ from an unknown distribution on $\mathbb{R}^n \times \{ \pm 1\}$, whose marginal distribution on…

机器学习 · 计算机科学 2023-02-14 Ilias Diakonikolas , Daniel M. Kane , Lisheng Ren

We study the problem of computationally efficient proper agnostic learning of multidimensional concept classes under the Gaussian distribution. In this setting, given i.i.d. labeled samples from an unknown distribution over $\mathbb{R}^d…

数据结构与算法 · 计算机科学 2026-05-28 Sergei Tikhonov , Arsen Vasilyan