English
Related papers

Related papers: Optimizing Active Learning for Low Annotation Budg…

200 papers

In the era of data-driven intelligence, the paradox of data abundance and annotation scarcity has emerged as a critical bottleneck in the advancement of machine learning. This paper gives a detailed overview of Active Learning (AL), which…

Machine Learning · Computer Science 2025-11-27 Chiung-Yi Tseng , Junhao Song , Ziqian Bi , Tianyang Wang , Chia Xin Liang , Xinyuan Song , Ming Liu

Active learning focuses on choosing a subset of unlabeled data to be labeled. However, most such methods assume that a large subset of the data can be annotated. We are interested in low-budget active learning where only a small subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Kossar Pourahmadi , Parsa Nooralinejad , Hamed Pirsiavash

Neural coreference resolution models trained on one dataset may not transfer to new, low-resource domains. Active learning mitigates this problem by sampling a small subset of data for annotators to label. While active learning is…

Computation and Language · Computer Science 2022-03-30 Michelle Yuan , Patrick Xia , Chandler May , Benjamin Van Durme , Jordan Boyd-Graber

Active learning is a paradigm aimed at reducing the annotation effort by training the model on actively selected informative and/or representative samples. Another paradigm to reduce the annotation effort is self-training that learns from a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Javad Zolfaghari Bengar , Joost van de Weijer , Bartlomiej Twardowski , Bogdan Raducanu

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Sebastien Deschamps , Hichem Sahbi

Active learning aims to optimize the dataset annotation process when resources are constrained. Most existing methods are designed for balanced datasets. Their practical applicability is limited by the fact that a majority of real-life…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Human annotation of training samples is expensive, laborious, and sometimes challenging, especially for Natural Language Processing (NLP) tasks. To reduce the labeling cost and enhance the sample efficiency, Active Learning (AL) technique…

Computation and Language · Computer Science 2024-01-17 Xuesong Wang

Annotating new datasets for machine learning tasks is tedious, time-consuming, and costly. For segmentation applications, the burden is particularly high as manual delineations of relevant image content are often extremely expensive or can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Javier Gamazo Tejero , Martin S. Zinkernagel , Sebastian Wolf , Raphael Sznitman , Pablo Márquez Neila

Efficient data annotation remains a critical challenge in machine learning, particularly for object detection tasks requiring extensive labeled data. Active learning (AL) has emerged as a promising solution to minimize annotation costs by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Somraj Gautam , Nachiketa Purohit , Gaurav Harit

Pool-based active learning (AL) aims to optimize the annotation process (i.e., labeling) as the acquisition of annotations is often time-consuming and therefore expensive. For this purpose, an AL strategy queries annotations intelligently…

Machine Learning · Computer Science 2022-01-06 Marek Herde , Denis Huseljic , Bernhard Sick , Adrian Calma

While many active learning papers assume that the learner can simply ask for a label and receive it, real annotation often presents a mismatch between the form of a label (say, one among many classes), and the form of an annotation…

Machine Learning · Computer Science 2019-07-10 Peiyun Hu , Zachary C. Lipton , Anima Anandkumar , Deva Ramanan

Deep neural networks (DNNs) have demonstrated exceptional performance across various image segmentation tasks. However, the process of preparing datasets for training segmentation DNNs is both labor-intensive and costly, as it typically…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Yixin Zhang , Shen Zhao , Hanxue Gu , Maciej A. Mazurowski

This paper is on active learning where the goal is to reduce the data annotation burden by interacting with a (human) oracle during training. Standard active learning methods ask the oracle to annotate data samples. Instead, we take a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Miriam W. Huijser , Jan C. van Gemert

The pretraining-finetuning paradigm has gained widespread adoption in vision tasks and other fields, yet it faces the significant challenge of high sample annotation costs. To mitigate this, the concept of active finetuning has emerged,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Han Lu , Yichen Xie , Xiaokang Yang , Junchi Yan

Many recent delineation techniques owe much of their increased effectiveness to path classification algorithms that make it possible to distinguish promising paths from others. The downside of this development is that they require annotated…

Computer Vision and Pattern Recognition · Computer Science 2015-12-03 Agata Mosinska , Raphael Sznitman , Przemysław Głowacki , Pascal Fua

Active learning frameworks offer efficient data annotation without remarkable accuracy degradation. In other words, active learning starts training the model with a small size of labeled data while exploring the space of unlabeled data in…

Machine Learning · Computer Science 2022-04-22 Salman Mohamadi , Hamidreza Amindavar

Label aggregation such as majority voting is commonly used to resolve annotator disagreement in dataset creation. However, this may disregard minority values and opinions. Recent studies indicate that learning from individual annotations…

Computation and Language · Computer Science 2023-10-24 Xinpeng Wang , Barbara Plank

Recent years have witnessed amazing outcomes from "Big Models" trained by "Big Data". Most popular algorithms for model training are iterative. Due to the surging volumes of data, we can usually afford to process only a fraction of the…

Databases · Computer Science 2015-12-15 Jinyang Gao , H. V. Jagadish , Beng Chin Ooi

Active learning seeks to achieve strong performance with fewer training samples. It does this by iteratively asking an oracle to label new selected samples in a human-in-the-loop manner. This technique has gained increasing popularity due…

Machine Learning · Computer Science 2024-07-16 Dongyuan Li , Zhen Wang , Yankai Chen , Renhe Jiang , Weiping Ding , Manabu Okumura

Active learning is relevant and challenging for high-dimensional regression models when the annotation of the samples is expensive. Yet most of the existing sampling methods cannot be applied to large-scale problems, consuming too much time…

Machine Learning · Computer Science 2020-01-24 Evgenii Tsymbalov , Maxim Panov , Alexander Shapeev