English
Related papers

Related papers: A Survey on Cost Types, Interaction Schemes, and A…

200 papers

We propose a new active learning (AL) framework, Active Learning++, which can utilize an annotator's labels as well as its rationale. Annotators can provide their rationale for choosing a label by ranking input features based on their…

Machine Learning · Computer Science 2020-09-11 Bhavya Ghai , Q. Vera Liao , Yunfeng Zhang , Klaus Mueller

Active learning (AL) algorithms may achieve better performance with fewer data because the model guides the data selection process. While many algorithms have been proposed, there is little study on what the optimal AL algorithm looks like,…

Machine Learning · Computer Science 2021-02-23 Yilun Zhou , Adithya Renduchintala , Xian Li , Sida Wang , Yashar Mehdad , Asish Ghoshal

State-of-the-art supervised NLP models achieve high accuracy but are also susceptible to failures on inputs from low-data regimes, such as domains that are not represented in training data. As an approximation to collecting ground-truth…

Computation and Language · Computer Science 2023-06-29 Parikshit Bansal , Amit Sharma

Medical image analysis requires substantial labeled data for model training, yet expert annotation is expensive and time-consuming. Active learning (AL) addresses this challenge by strategically selecting the most informative samples for…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Ifrat Ikhtear Uddin , Longwei Wang , Xiao Qin , Yang Zhou , KC Santosh

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

We propose a new active learning (AL) method for text classification with convolutional neural networks (CNNs). In AL, one selects the instances to be manually labeled with the aim of maximizing model performance with minimal effort. Neural…

Computation and Language · Computer Science 2016-12-02 Ye Zhang , Matthew Lease , Byron C. Wallace

Supervised machine learning methods usually require a large set of labeled examples for model training. However, in many real applications, there are plentiful unlabeled data but limited labeled data; and the acquisition of labels is…

Machine Learning · Computer Science 2019-01-15 Ying-Peng Tang , Guo-Xiang Li , Sheng-Jun Huang

In many data mining applications collection of sufficiently large datasets is the most time consuming and expensive. On the other hand, industrial methods of data collection create huge databases, and make difficult direct applications of…

Machine Learning · Statistics 2011-08-03 Vladimir Nikulin

Event extraction (EE) plays an important role in many industrial application scenarios, and high-quality EE methods require a large amount of manual annotation data to train supervised learning models. However, the cost of obtaining…

Computation and Language · Computer Science 2023-03-21 Shirong Shen , Zhen Li , Guilin Qi

CNN visualization and interpretation methods, like class-activation maps (CAMs), are typically used to highlight the image regions linked to class predictions. These models allow to simultaneously classify images and extract class-dependent…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Soufiane Belharbi , Ismail Ben Ayed , Luke McCaffrey , Eric Granger

Active learning is a commonly used approach that reduces the labeling effort required to train deep neural networks. However, the effectiveness of current active learning methods is limited by their closed-world assumptions, which assume…

Machine Learning · Computer Science 2024-01-11 Ruiyu Mao , Ouyang Xu , Yunhui Guo

Active learning is able to reduce the amount of labelling effort by using a machine learning model to query the user for specific inputs. While there are many papers on new active learning techniques, these techniques rarely satisfy the…

Machine Learning · Computer Science 2020-06-18 Parmida Atighehchian , Frédéric Branchaud-Charron , Alexandre Lacoste

We consider the problem of learning when obtaining the training labels is costly, which is usually tackled in the literature using active-learning techniques. These approaches provide strategies to choose the examples to label before or…

Machine Learning · Computer Science 2017-07-18 Gabriella Contardo , Ludovic Denoyer , Thierry Artieres

State-of-the-art question answering (QA) relies upon large amounts of training data for which labeling is time consuming and thus expensive. For this reason, customizing QA systems is challenging. As a remedy, we propose a novel framework…

Computation and Language · Computer Science 2020-11-10 Bernhard Kratzwald , Stefan Feuerriegel , Huan Sun

Semantic segmentation of satellite imagery plays a vital role in land cover mapping and environmental monitoring. However, annotating large-scale, high-resolution satellite datasets is costly and time consuming, especially when covering…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Gadi Hemanth Kumar , Athira Nambiar , Pankaj Bodani

Instruction-tuned LLMs can annotate thousands of instances from a short prompt at negligible cost. This raises two questions for active learning (AL): can LLM labels replace human labels within the AL loop, and does AL remain necessary when…

Computation and Language · Computer Science 2026-04-23 Ahmad Dawar Hakimi , Lea Hirlimann , Isabelle Augenstein , Hinrich Schütze

Active learning (AL) reduces the amount of labeled data needed to train a machine learning model by intelligently choosing which instances to label. Classic pool-based AL requires all data to be present in a datacenter, which can be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Sebastian Schmidt , Stephan Günnemann

This paper proposes an active learning (AL) algorithm to solve regression problems based on inverse-distance weighting functions for selecting the feature vectors to query. The algorithm has the following features: (i) supports both…

Machine Learning · Computer Science 2022-12-15 Alberto Bemporad

Annotating bounding boxes is costly and limits the scalability of object detection. This challenge is compounded by the need to preserve high accuracy while minimizing manual effort in real-world applications. Prior active learning methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rashi Sharma , Justin Timothy C. Bersamin , Karthikk Subramanian