English
Related papers

Related papers: Enhancing Cost Efficiency in Active Learning with …

200 papers

Active learning (AL) is a human-and-model-in-the-loop paradigm that iteratively selects informative unlabeled data for human annotation, aiming to improve over random sampling. However, performing AL experiments with human annotations…

Machine Learning · Computer Science 2023-05-24 Katerina Margatina , Nikolaos Aletras

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

Active learning aims to develop label-efficient algorithms by sampling the most representative queries to be labeled by an oracle. We describe a pool-based semi-supervised active learning algorithm that implicitly learns this sampling…

Machine Learning · Computer Science 2019-10-30 Samarth Sinha , Sayna Ebrahimi , Trevor Darrell

Integrating human expertise into machine learning systems often reduces the role of experts to labeling oracles, a paradigm that limits the amount of information exchanged and fails to capture the nuances of human judgment. We address this…

Human-Computer Interaction · Computer Science 2026-02-18 Belén Martín-Urcelay , Yoonsang Lee , Matthieu R. Bloch , Christopher J. Rozell

Pool-based active learning (AL) is a promising technology for increasing data-efficiency of machine learning models. However, surveys show that performance of recent AL methods is very sensitive to the choice of dataset and training…

Machine Learning · Computer Science 2023-09-12 Tim Bakker , Herke van Hoof , Max Welling

Active Learning (AL) addresses the crucial challenge of enabling machines to efficiently gather labeled examples through strategic queries. Among the many AL strategies, Uncertainty Sampling (US) stands out as one of the most widely…

Machine Learning · Computer Science 2025-06-24 Po-Yi Lu , Yi-Jie Cheng , Chun-Liang Li , Hsuan-Tien Lin

We propose a new active learning (AL) framework, Active Learning++, which can utilize an annotator's labels as well as its rationale. Annotators can provide their rationale for choosing a label by ranking input features based on their…

Machine Learning · Computer Science 2020-09-11 Bhavya Ghai , Q. Vera Liao , Yunfeng Zhang , Klaus Mueller

In critical machine learning applications, ensuring fairness is essential to avoid perpetuating social inequities. In this work, we address the challenges of reducing bias and improving accuracy in data-scarce environments, where the cost…

Machine Learning · Computer Science 2023-12-15 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

CNN visualization and interpretation methods, like class-activation maps (CAMs), are typically used to highlight the image regions linked to class predictions. These models allow to simultaneously classify images and extract class-dependent…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Soufiane Belharbi , Ismail Ben Ayed , Luke McCaffrey , Eric Granger

Multi-task learning is central to many real-world applications. Unfortunately, obtaining labelled data for all tasks is time-consuming, challenging, and expensive. Active Learning (AL) can be used to reduce this burden. Existing techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Nikita Durasov , Nik Dorndorf , Pascal Fua

Active learning (AL) is a training paradigm for selecting unlabeled samples for annotation to improve model performance on a test set, which is useful when only a limited number of samples can be annotated. These algorithms often work by…

Computation and Language · Computer Science 2026-04-13 Lorenzo Jaime Yu Flores , Cesare Spinoso di-Piano , Ori Ernst , David Ifeoluwa Adelani , Jackie Chi Kit Cheung

Federated active learning (FAL) seeks to reduce annotation cost under privacy constraints, yet its effectiveness degrades in realistic settings with severe global class imbalance and highly heterogeneous clients. We conduct a systematic…

Machine Learning · Computer Science 2026-03-12 Chen-Chen Zong , Sheng-Jun Huang

In this paper we propose an active metric learning method for clustering with pairwise constraints. The proposed method actively queries the label of informative instance pairs, while estimating underlying metrics by incorporating unlabeled…

Machine Learning · Statistics 2021-11-10 Yujia Deng , Yubai Yuan , Haoda Fu , Annie Qu

This work addresses challenges arising from extracting entities from textual data, including the high cost of data annotation, model accuracy, selecting appropriate evaluation criteria, and the overall quality of annotation. We present a…

Computation and Language · Computer Science 2020-04-28 Hussein S. Al-Olimat , Steven Gustafson , Jason Mackay , Krishnaprasad Thirunarayan , Amit Sheth

Counterfactual learning from observational data involves learning a classifier on an entire population based on data that is observed conditioned on a selection policy. This work considers this problem in an active setting, where the…

Machine Learning · Statistics 2019-10-29 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

The paucity of labeled data is a typical challenge in the automotive industry. Annotating time-series measurements requires solid domain knowledge and in-depth exploratory data analysis, which implies a high labeling effort. Conventional…

Machine Learning · Computer Science 2023-12-27 Yuqicheng Zhu , Mohamed-Ali Tnani , Timo Jahnz , Klaus Diepold

Active learning is a machine learning approach for reducing the data labeling effort. Given a pool of unlabeled samples, it tries to select the most useful ones to label so that a model built from them can achieve the best possible…

Machine Learning · Computer Science 2020-03-31 Dongrui Wu

Active Learning (AL) aims to enhance the performance of deep models by selecting the most informative samples for annotation from a pool of unlabeled data. Despite impressive performance in closed-set settings, most AL methods fail in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Bardia Safaei , Vibashan VS , Celso M. de Melo , Vishal M. Patel

When solving decision and optimisation problems, many competing algorithms (model and solver choices) have complementary strengths. Typically, there is no single algorithm that works well for all instances of a problem. Automated algorithm…

Machine Learning · Computer Science 2025-06-11 Erdem Kuş , Özgür Akgün , Nguyen Dang , Ian Miguel

Active learning (AL) is a machine learning (ML) approach that strategically selects the most informative samples for annotation during training, aiming to minimize annotation costs. This strategy not only reduces labeling expenses but also…

Machine Learning · Computer Science 2026-03-25 Cédric Jung , Shirin Salehi , Anke Schmeink