English
Related papers

Related papers: Attribute-Efficient PAC Learning of Sparse Halfspa…

200 papers

Understanding noise tolerance of machine learning algorithms is a central quest in learning theory. In this work, we study the problem of computationally efficient PAC learning of halfspaces in the presence of malicious noise, where an…

Machine Learning · Computer Science 2025-02-18 Jie Shen

This paper is concerned with computationally efficient learning of homogeneous sparse halfspaces in $\mathbb{R}^d$ under noise. Though recent works have established attribute-efficient learning algorithms under various types of label noise…

Machine Learning · Statistics 2021-03-03 Jie Shen , Chicheng Zhang

This paper explores the challenges of PAC learning in semi-enclosed environments that face persistent disruptive noise and demonstrates the weaknesses of traditional learning models based on noise-free data. We present a novel algorithm…

Machine Learning · Computer Science 2024-11-05 Shirmohammad Tavangari , Zahra Shakarami , Aref Yelghi , Asef Yelghi

The concept class of low-degree polynomial threshold functions (PTFs) plays a fundamental role in machine learning. In this paper, we study PAC learning of $K$-sparse degree-$d$ PTFs on $\mathbb{R}^n$, where any such concept depends only on…

Data Structures and Algorithms · Computer Science 2024-03-20 Shiwei Zeng , Jie Shen

Noise-tolerant PAC learning of linear models has been of central interests in machine learning community since the last century. In recent years, many computationally-efficient algorithms have been proposed for the problem of learning…

Machine Learning · Computer Science 2026-05-19 Rita Adhikari , Shiwei Zeng

We study the problem of efficient PAC active learning of homogeneous linear classifiers (halfspaces) in $\mathbb{R}^d$, where the goal is to learn a halfspace with low error using as few label queries as possible. Under the extra assumption…

Machine Learning · Computer Science 2018-06-05 Chicheng Zhang

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

Machine Learning · Computer Science 2021-10-06 Jie Shen

We study the efficient learnability of geometric concept classes - specifically, low-degree polynomial threshold functions (PTFs) and intersections of halfspaces - when a fraction of the data is adversarially corrupted. We give the first…

Machine Learning · Computer Science 2017-07-06 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

We study the efficient PAC learnability of halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, each label is independently flipped with some probability which is controlled by an adversary. This noise model…

Machine Learning · Computer Science 2020-06-12 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

We study ``selective'' or ``conditional'' classification problems under an agnostic setting. Classification tasks commonly focus on modeling the relationship between features and categories that captures the vast majority of data. In…

Machine Learning · Computer Science 2025-02-04 Jizhou Huang , Brendan Juba

We study {\em online} active learning of homogeneous halfspaces in $\mathbb{R}^d$ with adversarial noise where the overall probability of a noisy label is constrained to be at most $\nu$. Our main contribution is a Perceptron-like online…

Machine Learning · Computer Science 2021-06-24 Jie Shen

We study the computational complexity of adversarially robust proper learning of halfspaces in the distribution-independent agnostic PAC model, with a focus on $L_p$ perturbations. We give a computationally efficient learning algorithm and…

Machine Learning · Computer Science 2020-07-31 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi

We study the problem of learning halfspaces with Massart noise in the distribution-specific PAC model. We give the first computationally efficient algorithm for this problem with respect to a broad family of distributions, including…

Machine Learning · Computer Science 2020-02-14 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

In machine learning applications, predictive models are trained to serve future queries across the entire data distribution. Real-world data often demands excessively complex models to achieve competitive performance, however, sacrificing…

Machine Learning · Computer Science 2025-09-22 Jizhou Huang , Brendan Juba

We study the problem of PAC learning $\gamma$-margin halfspaces in the presence of Massart noise. Without computational considerations, the sample complexity of this learning problem is known to be $\widetilde{\Theta}(1/(\gamma^2…

Machine Learning · Computer Science 2025-01-17 Ilias Diakonikolas , Nikos Zarifis

We study the complexity of PAC learning halfspaces in the presence of Massart noise. In this problem, we are given i.i.d. labeled examples $(\mathbf{x}, y) \in \mathbb{R}^N \times \{ \pm 1\}$, where the distribution of $\mathbf{x}$ is…

Machine Learning · Computer Science 2022-07-29 Ilias Diakonikolas , Daniel M. Kane , Pasin Manurangsi , Lisheng Ren

We study the problem of learning adversarially robust halfspaces in the distribution-independent setting. In the realizable setting, we provide necessary and sufficient conditions on the adversarial perturbation sets under which halfspaces…

Machine Learning · Computer Science 2020-05-18 Omar Montasser , Surbhi Goel , Ilias Diakonikolas , Nathan Srebro

We study the problem of PAC learning halfspaces in the reliable agnostic model of Kalai et al. (2012). The reliable PAC model captures learning scenarios where one type of error is costlier than the others. Our main positive result is a new…

Machine Learning · Computer Science 2024-11-19 Ilias Diakonikolas , Lisheng Ren , Nikos Zarifis

We study the problem of {\em distribution-independent} PAC learning of halfspaces in the presence of Massart noise. Specifically, we are given a set of labeled examples $(\mathbf{x}, y)$ drawn from a distribution $\mathcal{D}$ on…

Machine Learning · Computer Science 2019-12-11 Ilias Diakonikolas , Themis Gouleakis , Christos Tzamos

We consider the problem of Probably Approximate Correct (PAC) learning of a binary classifier from noisy labeled examples acquired from multiple annotators (each characterized by a respective classification noise rate). First, we consider…

Machine Learning · Computer Science 2012-10-19 Dinesh Garg , Sourangshu Bhattacharya , S. Sundararajan , Shirish Shevade
‹ Prev 1 2 3 10 Next ›