English
Related papers

Related papers: Avoid Wasted Annotation Costs in Open-set Active L…

200 papers

Deep neural networks have reached high accuracy on object detection but their success hinges on large amounts of labeled data. To reduce the labels dependency, various active learning strategies have been proposed, typically based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ismail Elezi , Zhiding Yu , Anima Anandkumar , Laura Leal-Taixe , Jose M. Alvarez

In the era of data-driven intelligence, the paradox of data abundance and annotation scarcity has emerged as a critical bottleneck in the advancement of machine learning. This paper gives a detailed overview of Active Learning (AL), which…

Machine Learning · Computer Science 2025-11-27 Chiung-Yi Tseng , Junhao Song , Ziqian Bi , Tianyang Wang , Chia Xin Liang , Xinyuan Song , Ming Liu

Foundation vision or vision-language models are trained on large unlabeled or noisy data and learn robust representations that can achieve impressive zero- or few-shot performance on diverse tasks. Given these properties, they are a natural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Sanket Rajan Gupte , Josiah Aklilu , Jeffrey J. Nirschl , Serena Yeung-Levy

Access to high-quality labeled data remains a limiting factor in applied supervised learning. While label variation (LV), i.e., differing labels for the same instance, is common, especially in natural language processing, annotation…

Computation and Language · Computer Science 2025-07-04 Cornelia Gruber , Helen Alber , Bernd Bischl , Göran Kauermann , Barbara Plank , Matthias Aßenmacher

Online Active Learning (OAL) aims to manage unlabeled datastream by selectively querying the label of data. OAL is applicable to many real-world problems, such as anomaly detection in health-care and finance. In these problems, there are…

Machine Learning · Computer Science 2019-11-19 Yifan Zhang , Peilin Zhao , Shuaicheng Niu , Qingyao Wu , Jiezhang Cao , Junzhou Huang , Mingkui Tan

The goal of pool-based active learning is to judiciously select a fixed-sized subset of unlabeled samples from a pool to query an oracle for their labels, in order to maximize the accuracy of a supervised learner. However, the unsaid…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shubhang Bhatnagar , Sachin Goyal , Darshan Tank , Amit Sethi

Despite the vast body of literature on Active Learning (AL), there is no comprehensive and open benchmark allowing for efficient and simple comparison of proposed samplers. Additionally, the variability in experimental settings across the…

Machine Learning · Computer Science 2023-04-12 W. Jonas , A. Abraham , L. Dreyfus-Schmidt

Avoiding out-of-distribution (OOD) data is critical for training supervised machine learning models in the medical imaging domain. Furthermore, obtaining labeled medical data is difficult and expensive since it requires expert annotators…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Suraj Kothawade , Akshit Srivastava , Venkat Iyer , Ganesh Ramakrishnan , Rishabh Iyer

Visual grounding requires large and diverse region-text pairs. However, manual annotation is costly and fixed vocabularies restrict scalability and generalization. Existing pseudo-labeling pipelines often overfit to biased distributions and…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yichi Zhang , Gongwei Chen , Jun Zhu , Jia Wan , Liqiang Nie

While annotating decent amounts of data to satisfy sophisticated learning models can be cost-prohibitive for many real-world applications. Active learning (AL) and semi-supervised learning (SSL) are two effective, but often isolated, means…

Machine Learning · Computer Science 2022-06-08 Jiannan Guo , Yangyang Kang , Yu Duan , Xiaozhong Liu , Siliang Tang , Wenqiao Zhang , Kun Kuang , Changlong Sun , Fei Wu

Data collection and annotation is a laborious, time-consuming prerequisite for supervised machine learning tasks. Online Active Learning (OAL) is a paradigm that addresses this issue by simultaneously minimizing the amount of annotation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Mark Lindsey , Ankit Shah , Francis Kubala , Richard M. Stern

While many active learning papers assume that the learner can simply ask for a label and receive it, real annotation often presents a mismatch between the form of a label (say, one among many classes), and the form of an annotation…

Machine Learning · Computer Science 2019-07-10 Peiyun Hu , Zachary C. Lipton , Anima Anandkumar , Deva Ramanan

The objective of active learning (AL) is to train classification models with less number of labeled instances by selecting only the most informative instances for labeling. The AL algorithms designed for other data types such as images and…

Machine Learning · Statistics 2020-07-23 Kaushalya Madhawa , Tsuyoshi Murata

Active learning (AL) techniques optimally utilize a labeling budget by iteratively selecting instances that are most valuable for learning. However, they lack ``prerequisite checks'', i.e., there are no prescribed criteria to pick an AL…

Machine Learning · Computer Science 2024-10-07 Abhishek Ghose , Emma Thuong Nguyen

Annotating data for supervised learning can be costly. When the annotation budget is limited, active learning can be used to select and annotate those observations that are likely to give the most gain in model performance. We propose an…

Machine Learning · Statistics 2024-08-19 Amanda Olmin , Jakob Lindqvist , Lennart Svensson , Fredrik Lindsten

Deploying medical AI across resource-constrained institutions demands data-efficient learning pipelines that respect patient privacy. Federated Learning (FL) enables collaborative medical AI without centralising data, yet real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Adea Nesturi , David Dueñas Gaviria , Jiajun Zeng , Shadi Albarqouni

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

Active learning (AL) has emerged as a crucial strategy for reducing the prohibitive costs associated with medical image segmentation. However, standard uncertainty-based AL methods typically focus on maximizing performance metrics, ignoring…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Ghazal Danaee , Mélanie Gaillochet , Christian Desrosiers , Herve Lombaert , Sylvain Bouix

In this study, we benchmark query strategies for deep actice learning~(DAL). DAL reduces annotation costs by annotating only high-quality samples selected by query strategies. Existing research has two main problems, that the experimental…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Shiryu Ueno , Yusei Yamada , Shunsuke Nakatsuka , Kunihito Kato

Supervised finetuning (SFT) on instruction datasets has played a crucial role in achieving the remarkable zero-shot generalization capabilities observed in modern large language models (LLMs). However, the annotation efforts required to…