中文
相关论文

相关论文: Beating the Minimax Rate of Active Learning with P…

200 篇论文

We address the problem of active logistic regression in the realizable setting. It is well known that active learning can require exponentially fewer label queries compared to passive learning, in some cases using $\log \frac{1}{\eps}$…

机器学习 · 计算机科学 2025-04-21 Yihan Zhou , Eric Price , Trung Nguyen

To scale optimization and simulation, prior work has explored training machine-learning surrogates that map problem parameters to solutions inexpensively at inference time. Unfortunately, commonly used approaches, including supervised and…

机器学习 · 计算机科学 2026-05-12 Khai Nguyen , Petros Ellinas , Anvita Bhagavathula , Priya L. Donti

Optimal design for model training is a critical topic in machine learning. Active Learning aims at obtaining improved models by querying samples with maximum uncertainty according to the estimation model for artificially labeling; this has…

Gathering labeled data to train well-performing machine learning models is one of the critical challenges in many applications. Active learning aims at reducing the labeling costs by an efficient and effective allocation of costly labeling…

机器学习 · 计算机科学 2020-06-03 Daniel Kottke , Marek Herde , Christoph Sandrock , Denis Huseljic , Georg Krempl , Bernhard Sick

Active learning is a powerful tool when labelling data is expensive, but it introduces a bias because the training data no longer follows the population distribution. We formalize this bias and investigate the situations in which it can be…

机器学习 · 统计学 2021-06-01 Sebastian Farquhar , Yarin Gal , Tom Rainforth

Active learning aims to obtain a classifier of high accuracy by using fewer label requests in comparison to passive learning by selecting effective queries. Many active learning methods have been developed in the past two decades, which…

机器学习 · 计算机科学 2016-08-08 Cem Orhan , Öznur Taştan

We propose Active Surrogate Estimators (ASEs), a new method for label-efficient model evaluation. Evaluating model performance is a challenging and important problem when labels are expensive. ASEs address this active testing problem using…

机器学习 · 计算机科学 2022-10-20 Jannik Kossen , Sebastian Farquhar , Yarin Gal , Tom Rainforth

Modern computing and communication technologies can make data collection procedures very efficient. However, our ability to analyze large data sets and/or to extract information out from them is hard-pressed to keep up with our capacities…

机器学习 · 统计学 2019-01-30 Zhanfeng Wang , Yumi Kwon , Yuan-chin Ivan Chang

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

机器学习 · 计算机科学 2022-02-07 Dongchen Huang , Yi-feng Yang

We introduce a new approach for designing computationally efficient learning algorithms that are tolerant to noise, and demonstrate its effectiveness by designing algorithms with improved noise tolerance guarantees for learning linear…

机器学习 · 计算机科学 2018-06-05 Pranjal Awasthi , Maria Florina Balcan , Philip M. Long

We construct and analyze active learning algorithms for the problem of binary classification with abstention. We consider three abstention settings: \emph{fixed-cost} and two variants of \emph{bounded-rate} abstention, and for each of them…

机器学习 · 计算机科学 2019-06-04 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

We present a new active learning algorithm based on nonparametric estimators of the regression function. Our investigation provides probabilistic bounds for the rates of convergence of the generalization error achievable by proposed method…

统计理论 · 数学 2011-11-03 Stanislav Minsker

We study the efficient PAC learnability of halfspaces in the presence of Tsybakov noise. In the Tsybakov noise model, each label is independently flipped with some probability which is controlled by an adversary. This noise model…

机器学习 · 计算机科学 2020-06-12 Ilias Diakonikolas , Vasilis Kontonis , Christos Tzamos , Nikos Zarifis

Data generation and labeling are usually an expensive part of learning for robotics. While active learning methods are commonly used to tackle the former problem, preference-based learning is a concept that attempts to solve the latter by…

机器学习 · 计算机科学 2018-10-11 Erdem Bıyık , Dorsa Sadigh

We study active learning where the labeler can not only return incorrect labels but also abstain from labeling. We consider different noise and abstention conditions of the labeler. We propose an algorithm which utilizes abstention…

机器学习 · 计算机科学 2016-11-01 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Deep neural networks have reached high accuracy on object detection but their success hinges on large amounts of labeled data. To reduce the labels dependency, various active learning strategies have been proposed, typically based on the…

计算机视觉与模式识别 · 计算机科学 2021-11-30 Ismail Elezi , Zhiding Yu , Anima Anandkumar , Laura Leal-Taixe , Jose M. Alvarez

Active learning is an iterative labeling process that is used to obtain a small labeled subset, despite the absence of labeled data, thereby enabling to train a model for supervised tasks such as text classification. While active learning…

计算与语言 · 计算机科学 2024-10-07 Christopher Schröder , Gerhard Heyer

Pre-trained Vision Language Models (VLMs) have demonstrated notable progress in various zero-shot tasks, such as classification and retrieval. Despite their performance, because improving performance on new tasks requires task-specific…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jihwan Bang , Sumyeong Ahn , Jae-Gil Lee

There is a growing need for models that are interpretable and have reduced energy and computational cost (e.g., in health care analytics and federated learning). Examples of algorithms to train such models include logistic regression and…

机器学习 · 计算机科学 2023-02-21 Tyler Sypherd , Nathan Stromberg , Richard Nock , Visar Berisha , Lalitha Sankar

The explosive growth of easily-accessible unlabeled data has lead to growing interest in active learning, a paradigm in which data-hungry learning algorithms adaptively select informative examples in order to lower prohibitively expensive…

机器学习 · 计算机科学 2021-02-11 Max Hopkins , Daniel Kane , Shachar Lovett , Michal Moshkovitz