Improved Algorithms for Efficient Active Learning Halfspaces with Massart and Tsybakov noise
Machine Learning
2021-08-12 v2 Machine Learning
Abstract
We give a computationally-efficient PAC active learning algorithm for -dimensional homogeneous halfspaces that can tolerate Massart noise (Massart and N\'ed\'elec, 2006) and Tsybakov noise (Tsybakov, 2004). Specialized to the -Massart noise setting, our algorithm achieves an information-theoretically near-optimal label complexity of under a wide range of unlabeled data distributions (specifically, the family of "structured distributions" defined in Diakonikolas et al. (2020)). Under the more challenging Tsybakov noise condition, we identify two subfamilies of noise conditions, under which our efficient algorithm provides label complexity guarantees strictly lower than passive learning algorithms.
Cite
@article{arxiv.2102.05312,
title = {Improved Algorithms for Efficient Active Learning Halfspaces with Massart and Tsybakov noise},
author = {Chicheng Zhang and Yinan Li},
journal= {arXiv preprint arXiv:2102.05312},
year = {2021}
}
Comments
32 pages; COLT 2021