English
Related papers

Related papers: Learning Halfspaces With Membership Queries

200 papers

The model of learning with \emph{local membership queries} interpolates between the PAC model and the membership queries model by allowing the learner to query the label of any example that is similar to an example in the training set. This…

Machine Learning · Computer Science 2016-03-14 Galit Bary-Weisberg , Amit Daniely , Shai Shalev-Shwartz

With the explosion of massive, widely available unlabeled data in the past years, finding label and time efficient, robust learning algorithms has become ever more important in theory and in practice. We study the paradigm of active…

Machine Learning · Computer Science 2020-01-17 Max Hopkins , Daniel Kane , Shachar Lovett , Gaurav Mahajan

Valiant's 1984 paper is widely credited with introducing the PAC learning model, but it, in fact, introduced a different model: unlike PAC learning, the learner receives only positives, may issue membership queries, and must output a…

Machine Learning · Statistics 2026-05-14 Steve Hanneke , Anay Mehrotra , Grigoris Velegkas , Manolis Zampetakis

An active learner is given a hypothesis class, a large set of unlabeled examples and the ability to interactively query labels to an oracle of a subset of these examples; the goal of the learner is to learn a hypothesis in the class that…

Machine Learning · Computer Science 2015-10-19 Chicheng Zhang , Kamalika Chaudhuri

Many machine learning algorithms require large numbers of labeled data to deliver state-of-the-art results. In applications such as medical diagnosis and fraud detection, though there is an abundance of unlabeled data, it is costly to label…

Machine Learning · Computer Science 2023-06-07 Xiang Chen , Zhao Song , Baocheng Sun , Junze Yin , Danyang Zhuo

In machine learning, classification is usually seen as a function approximation problem, where the goal is to learn a function that maps input features to class labels. In this paper, we propose a novel clustering and classification…

Machine Learning · Computer Science 2025-02-25 Hrushikesh Mhaskar , Ryan O'Dowd , Efstratios Tsoukanis

Gathering training data is a key step of any supervised learning task, and it is both critical and expensive. Critical, because the quantity and quality of the training data has a high impact on the performance of the learned function.…

Data Structures and Algorithms · Computer Science 2021-10-28 Quentin Lutz , Élie de Panafieu , Alex Scott , Maya Stein

Active learning is a subfield of machine learning that focuses on improving the data collection efficiency of expensive-to-evaluate systems. Especially, active learning integrated surrogate modeling has shown remarkable performance in…

Machine Learning · Computer Science 2023-04-19 Cheolhei Lee , Kaiwen Wang , Jianguo Wu , Wenjun Cai , Xiaowei Yue

Active learning generally involves querying the most representative samples for human labeling, which has been widely studied in many fields such as image classification and object detection. However, its potential has not been explored in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jun Wang , Shaoguo Wen , Kaixing Chen , Jianghua Yu , Xin Zhou , Peng Gao , Changsheng Li , Guotong Xie

The demands on visual recognition systems do not end with the complexity offered by current large-scale image datasets, such as ImageNet. In consequence, we need curious and continuously learning algorithms that actively acquire knowledge…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Christoph Käding , Erik Rodner , Alexander Freytag , Joachim Denzler

We consider active learning with logged data, where labeled examples are drawn conditioned on a predetermined logging policy, and the goal is to learn a classifier on the entire population, not just conditioned on the logging policy. Prior…

Machine Learning · Computer Science 2018-06-14 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Bayesian inference for neural networks, or Bayesian deep learning, has the potential to provide well-calibrated predictions with quantified uncertainty and robustness. However, the main hurdle for Bayesian deep learning is its computational…

Machine Learning · Statistics 2023-09-07 Sanket Jantre , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian…

Machine Learning · Computer Science 2021-01-01 Cuong V. Nguyen , Lam Si Tung Ho , Huan Xu , Vu Dinh , Binh Nguyen

Active learning is the process of training a model with limited labeled data by selecting a core subset of an unlabeled data pool to label. The large scale of data sets used in deep learning forces most sample selection strategies to employ…

Machine Learning · Computer Science 2023-03-08 Rafid Mahmood , Sanja Fidler , Marc T. Law

In multiple instance multiple label learning, each sample, a bag, consists of multiple instances. To alleviate labeling complexity, each sample is associated with a set of bag-level labels leaving instances within the bag unlabeled. This…

Machine Learning · Computer Science 2021-07-28 Tam Nguyen , Raviv Raich

In machine learning, active class selection (ACS) algorithms aim to actively select a class and ask the oracle to provide an instance for that class to optimize a classifier's performance while minimizing the number of requests. In this…

Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we analyze the performance of a variety of AL algorithms on…

Machine Learning · Computer Science 2022-10-11 Dara Bahri , Heinrich Jiang , Tal Schuster , Afshin Rostamizadeh

This paper studies a new problem, \emph{active learning with partial labels} (ALPL). In this setting, an oracle annotates the query samples with partial labels, relaxing the oracle from the demanding accurate labeling process. To address…

Machine Learning · Computer Science 2023-07-17 Fei Zhang , Yunjie Ye , Lei Feng , Zhongwen Rao , Jieming Zhu , Marcus Kalander , Chen Gong , Jianye Hao , Bo Han

Inspired by the concept of active learning, we propose active inference$\unicode{x2013}$a methodology for statistical inference with machine-learning-assisted data collection. Assuming a budget on the number of labels that can be collected,…

Machine Learning · Statistics 2026-04-09 Tijana Zrnic , Emmanuel J. Candès

We give the first fully polynomial-time algorithm for learning halfspaces with respect to the uniform distribution on the hypercube in the presence of contamination, where an adversary may corrupt some fraction of examples and labels…

Data Structures and Algorithms · Computer Science 2025-11-11 Gautam Chandrasekaran , Adam R. Klivans , Konstantinos Stavropoulos , Arsen Vasilyan