English
Related papers

Related papers: Gradient-Discrepancy Acquisition for Pool-Based Ac…

200 papers

One of the motivations for property testing of boolean functions is the idea that testing can serve as a preprocessing step before learning. However, in most machine learning applications, it is not possible to request for labels of…

Data Structures and Algorithms · Computer Science 2012-04-18 Maria-Florina Balcan , Eric Blais , Avrim Blum , Liu Yang

Typically, a supervised learning model is trained using passive learning by randomly selecting unlabelled instances to annotate. This approach is effective for learning a model, but can be costly in cases where acquiring labelled instances…

Machine Learning · Computer Science 2024-03-05 Zan-Kai Chong , Hiroyuki Ohsaki , Bok-Min Goi

We study acquisition functions for active learning (AL) for text classification. The Expected Loss Reduction (ELR) method focuses on a Bayesian estimate of the reduction in classification error, recently updated with Mean Objective Cost of…

Machine Learning · Computer Science 2021-10-28 Wei Tan , Lan Du , Wray Buntine

Domain adaptive active learning is leading the charge in label-efficient training of neural networks. For semantic segmentation, state-of-the-art models jointly use two criteria of uncertainty and diversity to select training labels,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Marc Schachtsiek , Simone Rossi , Thomas Hannagan

We analyze the data-dependent capacity of neural networks and assess anomalies in inputs from the perspective of networks during inference. The notion of data-dependent capacity allows for analyzing the knowledge base of a model populated…

Machine Learning · Computer Science 2023-04-13 Jinsol Lee , Charlie Lehman , Mohit Prabhushankar , Ghassan AlRegib

Supervised machine learning often requires large training sets to train accurate models, yet obtaining large amounts of labeled data is not always feasible. Hence, it becomes crucial to explore active learning methods for reducing the size…

Machine Learning · Computer Science 2024-04-16 Ashna Jose , Emilie Devijver , Massih-Reza Amini , Noel Jakse , Roberta Poloni

Active learning typically focuses on training a model on few labeled examples alone, while unlabeled ones are only used for acquisition. In this work we depart from this setting by using both labeled and unlabeled data during model training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Oriane Siméoni , Mateusz Budnik , Yannis Avrithis , Guillaume Gravier

Active Learning (AL) has emerged as a powerful approach for minimizing labeling costs by selectively sampling the most informative data for neural network model development. Effective AL for large-scale vision-language models necessitates…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Athmanarayanan Lakshmi Narayanan , Amrutha Machireddy , Ranganath Krishnan

Active learning aims to obtain a classifier of high accuracy by using fewer label requests in comparison to passive learning by selecting effective queries. Many active learning methods have been developed in the past two decades, which…

Machine Learning · Computer Science 2016-08-08 Cem Orhan , Öznur Taştan

In this paper, we propose a novel approach for learning multi-label classifiers with the help of privileged information. Specifically, we use similarity constraints to capture the relationship between available information and privileged…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Shiyu Chen , Shangfei Wang , Tanfang Chen , Xiaoxiao Shi

The effectiveness of active learning largely depends on the sampling efficiency of the acquisition function. Expected Loss Reduction (ELR) focuses on a Bayesian estimate of the reduction in classification error, and more general costs fit…

Machine Learning · Computer Science 2023-12-19 Wei Tan , Lan Du , Wray Buntine

Active learning is a machine learning paradigm that aims to improve the performance of a model by strategically selecting and querying unlabeled data. One effective selection strategy is to base it on the model's predictive uncertainty,…

Machine Learning · Computer Science 2024-05-17 Seong Jin Cho , Gwangsu Kim , Junghyun Lee , Jinwoo Shin , Chang D. Yoo

Active learning (AL) reduces the amount of labeled data needed to train a machine learning model by intelligently choosing which instances to label. Classic pool-based AL requires all data to be present in a datacenter, which can be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Sebastian Schmidt , Stephan Günnemann

Most active learning research has focused on methods which perform well when many labels are available, but can be dramatically worse than random selection when label budgets are small. Other methods have focused on the low-budget regime,…

Machine Learning · Computer Science 2025-02-28 Wonho Bae , Gabriel L. Oliveira , Danica J. Sutherland

In this paper we propose a multi-armed bandit inspired, pool based active learning algorithm for the problem of binary classification. By carefully constructing an analogy between active learning and multi-armed bandits, we utilize ideas…

Machine Learning · Computer Science 2013-09-27 Ravi Ganti , Alexander G. Gray

Recent advances in machine learning have led to increased deployment of black-box classifiers across a wide variety of applications. In many such situations there is a critical need to both reliably assess the performance of these…

Machine Learning · Statistics 2021-03-16 Disi Ji , Robert L. Logan , Padhraic Smyth , Mark Steyvers

We study a logistic model-based active learning procedure for binary classification problems, in which we adopt a batch subject selection strategy with a modified sequential experimental design method. Moreover, accompanying the proposed…

Machine Learning · Statistics 2018-02-02 Hsiang-Ling Hsu , Yuan-Chin Ivan Chang , Ray-Bing Chen

The goal of active learning is to achieve the same accuracy achievable by passive learning, while using much fewer labels. Exponential savings in terms of label complexity have been proved in very special cases, but fundamental lower bounds…

Machine Learning · Statistics 2026-01-01 Yinglun Zhu , Robert Nowak

Active learning aims to develop label-efficient algorithms by querying the most representative samples to be labeled by a human annotator. Current active learning techniques either rely on model uncertainty to select the most uncertain…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Sayna Ebrahimi , William Gan , Dian Chen , Giscard Biamby , Kamyar Salahi , Michael Laielli , Shizhan Zhu , Trevor Darrell

Understanding and explaining deep learning models is an imperative task. Towards this, we propose a method that obtains gradient-based certainty estimates that also provide visual attention maps. Particularly, we solve for visual question…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Badri N. Patro , Mayank Lunayach , Vinay P. Namboodiri