English
Related papers

Related papers: Test Distribution-Aware Active Learning: A Princip…

200 papers

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Human concept learning is typically active: learners choose which instances to query or test in order to reduce uncertainty about an underlying rule or category. Active concept learning must balance informativeness of queries against the…

Artificial Intelligence · Computer Science 2026-02-09 Anirudh Chari , Neil Pattanaik

Labeled data can be expensive to acquire in several application domains, including medical imaging, robotics, and computer vision. To efficiently train machine learning models under such high labeling costs, active learning (AL) judiciously…

Machine Learning · Computer Science 2022-06-13 Konstantinos D. Polyzos , Qin Lu , Georgios B. Giannakis

A popular strategy for active learning is to specifically target a reduction in epistemic uncertainty, since aleatoric uncertainty is often considered as being intrinsic to the system of interest and therefore not reducible. Yet,…

Methodology · Statistics 2024-12-12 Jake Thomas , Jeremie Houssineau

Active learning (AL) is a machine learning (ML) approach that strategically selects the most informative samples for annotation during training, aiming to minimize annotation costs. This strategy not only reduces labeling expenses but also…

Machine Learning · Computer Science 2026-03-25 Cédric Jung , Shirin Salehi , Anke Schmeink

We study acquisition functions for active learning (AL) for text classification. The Expected Loss Reduction (ELR) method focuses on a Bayesian estimate of the reduction in classification error, recently updated with Mean Objective Cost of…

Machine Learning · Computer Science 2021-10-28 Wei Tan , Lan Du , Wray Buntine

Pool-based active learning (AL) is a promising technology for increasing data-efficiency of machine learning models. However, surveys show that performance of recent AL methods is very sensitive to the choice of dataset and training…

Machine Learning · Computer Science 2023-09-12 Tim Bakker , Herke van Hoof , Max Welling

Exploration and adaptation to new tasks in a transfer learning setup is a central challenge in reinforcement learning. In this work, we build on the idea of modeling a distribution over policies in a Bayesian deep reinforcement learning…

Machine Learning · Computer Science 2019-06-11 Disha Shrivastava , Eeshan Gunesh Dhekane , Riashat Islam

Randomized Controlled Trials (RCTs) represent the gold standard for causal inference yet remain a scarce resource. While large-scale observational data is often available, it is utilized only for retrospective fusion, and remains discarded…

Machine Learning · Statistics 2026-03-05 Erdun Gao , Liang Zhang , Jake Fawkes , Aoqi Zuo , Wenqin Liu , Haoxuan Li , Mingming Gong , Dino Sejdinovic

This paper considers deep out-of-distribution active learning. In practice, fully trained neural networks interact randomly with out-of-distribution (OOD) inputs and map aberrant samples randomly within the model representation space. Since…

Machine Learning · Computer Science 2023-01-13 Ryan Benkert , Mohit Prabhushankar , Ghassan AlRegib

The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched…

In many science and industry settings, a central challenge is designing experiments under time and budget constraints. Bayesian Optimal Experimental Design (BOED) is a paradigm to pick maximally informative designs that has been widely…

Machine Learning · Statistics 2026-04-02 Roubing Tang , Sabina J. Sloman , Samuel Kaski

Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage…

Machine Learning · Computer Science 2020-12-08 Mona Buisson-Fenet , Friedrich Solowjow , Sebastian Trimpe

In recent years, active learning has been successfully applied to an array of NLP tasks. However, prior work often assumes that training and test data are drawn from the same distribution. This is problematic, as in real-life settings data…

Computation and Language · Computer Science 2023-02-15 Ard Snijders , Douwe Kiela , Katerina Margatina

It is not an exaggeration to say that the recent progress in artificial intelligence technology depends on large-scale and high-quality data. Simultaneously, a prevalent issue exists everywhere: the budget for data labeling is constrained.…

Machine Learning · Computer Science 2023-08-22 Yujin Hwang , Won Jo , Juyoung Hong , Yukyung Choi

Active learning aims to identify the most informative data from an unlabeled data pool that enables a model to reach the desired accuracy rapidly. This benefits especially deep neural networks which generally require a huge number of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jihyo Kim , Jeonghyeon Kim , Sangheum Hwang

The aim of Active Learning is to select the most informative samples from an unlabelled set of data. This is useful in cases where the amount of data is large and labelling is expensive, such as in machine vision or medical imaging. Two…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Julien Combes , Alexandre Derville , Jean-François Coeurjolly

Active learning is able to reduce the amount of labelling effort by using a machine learning model to query the user for specific inputs. While there are many papers on new active learning techniques, these techniques rarely satisfy the…

Machine Learning · Computer Science 2020-06-18 Parmida Atighehchian , Frédéric Branchaud-Charron , Alexandre Lacoste

We study pool-based active learning with abstention feedbacks, where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian…

Machine Learning · Statistics 2021-01-05 Cuong V. Nguyen , Lam Si Tung Ho , Huan Xu , Vu Dinh , Binh Nguyen

We consider the problem of learning when obtaining the training labels is costly, which is usually tackled in the literature using active-learning techniques. These approaches provide strategies to choose the examples to label before or…

Machine Learning · Computer Science 2017-07-18 Gabriella Contardo , Ludovic Denoyer , Thierry Artieres