English
Related papers

Related papers: Active Learning with Distributional Estimates

200 papers

Classification algorithms aim to predict an unknown label (e.g., a quality class) for a new instance (e.g., a product). Therefore, training samples (instances and labels) are used to deduct classification hypotheses. Often, it is relatively…

Machine Learning · Computer Science 2019-01-30 Daniel Kottke , Jim Schellinger , Denis Huseljic , Bernhard Sick

The performance of learning-based algorithms improves with the amount of labelled data used for training. Yet, manually annotating data is particularly difficult for medical image segmentation tasks because of the limited expert…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

The remarkable advancements in large language models (LLMs) have significantly enhanced the performance in few-shot learning settings. By using only a small number of labeled examples, referred to as demonstrations, LLMs can effectively…

Computation and Language · Computer Science 2023-11-23 Katerina Margatina , Timo Schick , Nikolaos Aletras , Jane Dwivedi-Yu

In this paper, we suggest a novel data-driven approach to active learning (AL). The key idea is to train a regressor that predicts the expected error reduction for a candidate sample in a particular learning state. By formulating the query…

Machine Learning · Computer Science 2017-07-17 Ksenia Konyushkova , Raphael Sznitman , Pascal Fua

The great success that deep models have achieved in the past is mainly owed to large amounts of labeled training data. However, the acquisition of labeled data for new tasks aside from existing benchmarks is both challenging and costly.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

Active learning is of great interest for many practical applications, especially in industry and the physical sciences, where there is a strong need to minimize the number of costly experiments necessary to train predictive models. However,…

Machine Learning · Computer Science 2021-12-23 Maryam Pardakhti , Nila Mandal , Anson W. K. Ma , Qian Yang

As deep learning continues to evolve, the need for data efficiency becomes increasingly important. Considering labeling large datasets is both time-consuming and expensive, active learning (AL) provides a promising solution to this…

Machine Learning · Computer Science 2025-05-21 Yifeng Wang , Xueying Zhan , Siyu Huang

Active learning is a machine learning method aiming at optimal design for model training. At variance with supervised learning, which labels all samples, active learning provides an improved model by labeling samples with maximal…

Active learning (AL) aims to optimize model training and reduce annotation costs by selecting the most informative samples for labeling. Typically, AL methods rely on the empirical distribution of labeled data to define the decision…

Computation and Language · Computer Science 2025-07-23 Hui Xiang , Jinqiao Shi , Ting Zhang , Xiaojie Zhao , Yong Liu , Yong Ma

Active learning (AL) techniques optimally utilize a labeling budget by iteratively selecting instances that are most valuable for learning. However, they lack ``prerequisite checks'', i.e., there are no prescribed criteria to pick an AL…

Machine Learning · Computer Science 2024-10-07 Abhishek Ghose , Emma Thuong Nguyen

We design an active learning algorithm for cost-sensitive multiclass classification: problems where different errors have different costs. Our algorithm, COAL, makes predictions by regressing to each label's cost and predicting the…

Machine Learning · Computer Science 2021-10-13 Akshay Krishnamurthy , Alekh Agarwal , Tzu-Kuo Huang , Hal Daume , John Langford

In this letter, we introduce deep active learning (AL) for multi-label classification (MLC) problems in remote sensing (RS). In particular, we investigate the effectiveness of several AL query functions for MLC of RS images. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Lars Möllenbrok , Gencer Sumbul , Begüm Demir

Training high-quality instance segmentation models requires an abundance of labeled images with instance masks and classifications, which is often expensive to procure. Active learning addresses this challenge by striving for optimum…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ke Yu , Stephen Albro , Giulia DeSalvo , Suraj Kothawade , Abdullah Rashwan , Sasan Tavakkol , Kayhan Batmanghelich , Xiaoqi Yin

Active learning (AL) aims to select the most useful data samples from an unlabeled data pool and annotate them to expand the labeled dataset under a limited budget. Especially, uncertainty-based methods choose the most uncertain samples,…

Machine Learning · Computer Science 2023-10-02 Seong Min Kye , Kwanghee Choi , Hyeongmin Byun , Buru Chang

Active learning (AL) is an effective approach to select the most informative samples to label so as to reduce the annotation cost. Existing AL methods typically work under the closed-set assumption, i.e., all classes existing in the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Linhao Qu , Yingfan Ma , Zhiwei Yang , Manning Wang , Zhijian Song

A major problem with Active Learning (AL) is high training costs since models are typically retrained from scratch after every query round. We start by demonstrating that standard AL on neural networks with warm starting fails, both to…

Machine Learning · Computer Science 2023-12-14 Arnav Das , Gantavya Bhatt , Megh Bhalerao , Vianne Gao , Rui Yang , Jeff Bilmes

Deep learning (DL) algorithms rely on massive amounts of labeled data. Semi-supervised learning (SSL) and active learning (AL) aim to reduce this label complexity by leveraging unlabeled data or carefully acquiring labels, respectively. In…

Machine Learning · Computer Science 2023-02-16 Seo Taek Kong , Soomin Jeon , Dongbin Na , Jaewon Lee , Hong-Seok Lee , Kyu-Hwan Jung

This paper proposes an active learning (AL) algorithm to solve regression problems based on inverse-distance weighting functions for selecting the feature vectors to query. The algorithm has the following features: (i) supports both…

Machine Learning · Computer Science 2022-12-15 Alberto Bemporad

Modern computing and communication technologies can make data collection procedures very efficient. However, our ability to analyze large data sets and/or to extract information out from them is hard-pressed to keep up with our capacities…

Machine Learning · Statistics 2019-01-30 Zhanfeng Wang , Yumi Kwon , Yuan-chin Ivan Chang

Active learning (AL) is a principled strategy to reduce annotation cost in data-hungry deep learning. However, existing AL algorithms focus almost exclusively on unimodal data, overlooking the substantial annotation burden in multimodal…

Machine Learning · Computer Science 2026-04-24 Jiancheng Zhang , Yinglun Zhu