中文
相关论文

相关论文: Non-Convex SGD Learns Halfspaces with Adversarial …

200 篇论文

We study the problem of learning halfspaces with Massart noise in the distribution-specific PAC model. We give the first computationally efficient algorithm for this problem with respect to a broad family of distributions, including…

机器学习 · 计算机科学 2020-02-14 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study the efficient PAC learnability of halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, each label is independently flipped with some probability which is controlled by an adversary. This noise model…

机器学习 · 计算机科学 2020-06-12 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We analyze the properties of gradient descent on convex surrogates for the zero-one loss for the agnostic learning of linear halfspaces. If $\mathsf{OPT}$ is the best classification error achieved by a halfspace, by appealing to the notion…

机器学习 · 计算机科学 2021-02-16 Spencer Frei , Yuan Cao , Quanquan Gu

We study the problem of PAC learning halfspaces on $\mathbb{R}^d$ with Massart noise under the Gaussian distribution. In the Massart model, an adversary is allowed to flip the label of each point $\mathbf{x}$ with unknown probability…

机器学习 · 计算机科学 2021-11-09 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study the problem of {\em distribution-independent} PAC learning of halfspaces in the presence of Massart noise. Specifically, we are given a set of labeled examples $(\mathbf{x}, y)$ drawn from a distribution $\mathcal{D}$ on…

机器学习 · 计算机科学 2019-12-11 Ilias Diakonikolas , Themis Gouleakis , Christos Tzamos

We give the first polynomial-time algorithm for the testable learning of halfspaces in the presence of adversarial label noise under the Gaussian distribution. In the recently introduced testable learning model, one is required to produce a…

机器学习 · 计算机科学 2023-03-10 Ilias Diakonikolas , Daniel M. Kane , Vasilis Kontonis , Sihan Liu , Nikos Zarifis

We study the problem of PAC learning halfspaces in the reliable agnostic model of Kalai et al. (2012). The reliable PAC model captures learning scenarios where one type of error is costlier than the others. Our main positive result is a new…

机器学习 · 计算机科学 2024-11-19 Ilias Diakonikolas , Lisheng Ren , Nikos Zarifis

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

机器学习 · 计算机科学 2021-06-24 Jie Shen

We investigate approximation guarantees provided by logistic regression for the fundamental problem of agnostic learning of homogeneous halfspaces. Previously, for a certain broad class of "well-behaved" distributions on the examples,…

机器学习 · 计算机科学 2022-02-01 Ziwei Ji , Kwangjun Ahn , Pranjal Awasthi , Satyen Kale , Stefani Karp

We give the first efficient algorithm for learning halfspaces in the testable learning model recently defined by Rubinfeld and Vasilyan (2023). In this model, a learner certifies that the accuracy of its output hypothesis is near optimal…

机器学习 · 计算机科学 2023-03-14 Aravind Gollakota , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan

This paper is concerned with computationally efficient learning of homogeneous sparse halfspaces in $\mathbb{R}^d$ under noise. Though recent works have established attribute-efficient learning algorithms under various types of label noise…

机器学习 · 统计学 2021-03-03 Jie Shen , Chicheng Zhang

We show hardness of improperly learning halfspaces in the agnostic model, both in the distribution-independent as well as the distribution-specific setting, based on the assumption that worst-case lattice problems, such as GapSVP or SIVP,…

机器学习 · 计算机科学 2023-02-21 Stefan Tiegel

We study the task of testable learning of general -- not necessarily homogeneous -- halfspaces with adversarial label noise with respect to the Gaussian distribution. In the testable learning framework, the goal is to develop a…

机器学习 · 计算机科学 2024-09-02 Ilias Diakonikolas , Daniel M. Kane , Sihan Liu , Nikos Zarifis

We study the problem of PAC learning $\gamma$-margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is known to be $\widetilde{\Theta}(1/(\gamma^2…

机器学习 · 计算机科学 2025-01-17 Ilias Diakonikolas , Nikos Zarifis

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

机器学习 · 计算机科学 2021-10-06 Jie Shen

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

机器学习 · 计算机科学 2025-02-18 Jie Shen

We develop a framework using Hilbert spaces as a proxy to analyze PAC learning problems with structural properties. We consider a joint Hilbert space incorporating the relation between the true label and the predictor under a joint…

机器学习 · 计算机科学 2021-02-15 Mohsen Heidari , Wojciech Szpankowski

We study the problem of PAC learning halfspaces with Massart noise. Given labeled samples $(x, y)$ from a distribution $D$ on $\mathbb{R}^{d} \times \{ \pm 1\}$ such that the marginal $D_x$ on the examples is arbitrary and the label $y$ of…

机器学习 · 计算机科学 2021-11-09 Ilias Diakonikolas , Daniel M. Kane

We study the problem of efficient PAC active learning of homogeneous linear classifiers (halfspaces) in $\mathbb{R}^d$, where the goal is to learn a halfspace with low error using as few label queries as possible. Under the extra assumption…

机器学习 · 计算机科学 2018-06-05 Chicheng Zhang

We study the problem of {\em properly} learning large margin halfspaces in the agnostic PAC model. In more detail, we study the complexity of properly learning $d$-dimensional halfspaces on the unit ball within misclassification error…

机器学习 · 计算机科学 2019-08-30 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi
‹ 上一页 1 2 3 10 下一页 ›