English
Related papers

Related papers: Testing the Assumptions of Active Learning for Tra…

200 papers

Active learning aims to optimize the dataset annotation process when resources are constrained. Most existing methods are designed for balanced datasets. Their practical applicability is limited by the fact that a majority of real-life…

Machine Learning · Computer Science 2022-02-02 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Knowing exactly how many data points need to be labeled to achieve a certain model performance is a hugely beneficial step towards reducing the overall budgets for annotation. It pertains to both active learning and traditional data…

Computation and Language · Computer Science 2023-07-04 Ernie Chang , Muhammad Hassan Rashid , Pin-Jie Lin , Changsheng Zhao , Vera Demberg , Yangyang Shi , Vikas Chandra

The paucity of labeled data is a typical challenge in the automotive industry. Annotating time-series measurements requires solid domain knowledge and in-depth exploratory data analysis, which implies a high labeling effort. Conventional…

Machine Learning · Computer Science 2023-12-27 Yuqicheng Zhu , Mohamed-Ali Tnani , Timo Jahnz , Klaus Diepold

Active learning (AL) aims to improve model performance within a fixed labeling budget by choosing the most informative data points to label. Existing AL focuses on the single-domain setting, where all data come from the same domain (e.g.,…

Machine Learning · Computer Science 2024-02-12 Guang-Yuan Hao , Hengguan Huang , Haotian Wang , Jie Gao , Hao Wang

When tasked with supporting multiple languages for a given problem, two approaches have arisen: training a model for each language with the annotation budget divided equally among them, and training on a high-resource language followed by…

Computation and Language · Computer Science 2022-04-05 Joel Ruben Antony Moniz , Barun Patra , Matthew R. Gormley

Access to high-quality labeled data remains a limiting factor in applied supervised learning. While label variation (LV), i.e., differing labels for the same instance, is common, especially in natural language processing, annotation…

Computation and Language · Computer Science 2025-07-04 Cornelia Gruber , Helen Alber , Bernd Bischl , Göran Kauermann , Barbara Plank , Matthias Aßenmacher

Modern systems that rely on Machine Learning (ML) for predictive modelling, may suffer from the cold-start problem: supervised models work well but, initially, there are no labels, which are costly or slow to obtain. This problem is even…

Machine Learning · Computer Science 2021-10-25 Ricardo Barata , Miguel Leite , Ricardo Pacheco , Marco O. P. Sampaio , João Tiago Ascensão , Pedro Bizarro

Training deep models with limited annotations poses a significant challenge when applied to diverse practical domains. Employing semi-supervised learning alongside the self-supervised model offers the potential to enhance label efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziting Wen , Oscar Pizarro , Stefan Williams

Active Learning techniques are used to tackle learning problems where obtaining training labels is costly. In this work we use Meta-Active Learning to learn to select a subset of samples from a pool of unsupervised input for further…

Machine Learning · Computer Science 2019-11-04 Ignasi Mas , Josep Ramon Morros , Veronica Vilaplana

Deep active learning (DAL) seeks to reduce annotation costs by enabling the model to actively query instance annotations from which it expects to learn the most. Despite extensive research, there is currently no standardized evaluation…

Machine Learning · Computer Science 2023-06-21 Lukas Rauch , Matthias Aßenmacher , Denis Huseljic , Moritz Wirth , Bernd Bischl , Bernhard Sick

The objective of Active Learning is to strategically label a subset of the dataset to maximize performance within a predetermined labeling budget. In this study, we harness features acquired through self-supervised learning. We introduce a…

Machine Learning · Computer Science 2023-12-27 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Active learning is a machine learning method aiming at optimal design for model training. At variance with supervised learning, which labels all samples, active learning provides an improved model by labeling samples with maximal…

Active learning is a machine learning paradigm that aims to improve the performance of a model by strategically selecting and querying unlabeled data. One effective selection strategy is to base it on the model's predictive uncertainty,…

Machine Learning · Computer Science 2024-05-17 Seong Jin Cho , Gwangsu Kim , Junghyun Lee , Jinwoo Shin , Chang D. Yoo

Instead of randomly acquiring training data points, Uncertainty-based Active Learning (UAL) operates by querying the label(s) of pivotal samples from an unlabeled pool selected based on the prediction uncertainty, thereby aiming at…

Machine Learning · Computer Science 2024-08-27 Amir Hossein Rahmati , Mingzhou Fan , Ruida Zhou , Nathan M. Urban , Byung-Jun Yoon , Xiaoning Qian

Active learning aims to alleviate the amount of labor involved in data labeling by automating the selection of unlabeled samples via an acquisition function. For example, variational adversarial active learning (VAAL) leverages an…

Machine Learning · Computer Science 2024-08-26 Zongyao Lyu , William J. Beksi

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

Long-term test-time adaptation (TTA) is a challenging task due to error accumulation. Recent approaches tackle this issue by actively labeling a small proportion of samples in each batch, yet the annotation burden quickly grows as the batch…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Guowei Wang , Changxing Ding

Active learning has emerged as a standard paradigm in areas with scarcity of labeled training data, such as in the medical domain. Language models have emerged as the prevalent choice of several natural language tasks due to the performance…

Computation and Language · Computer Science 2021-09-07 Anson Bastos , Manohar Kaul

In recent years, deep neural networks (DNNs) have been found very successful for multi-label classification (MLC) of remote sensing (RS) images. Self-supervised pre-training combined with fine-tuning on a randomly selected small training…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Lars Möllenbrok , Begüm Demir

We address the problem of active learning under label shift: when the class proportions of source and target domains differ. We introduce a "medial distribution" to incorporate a tradeoff between importance weighting and class-balanced…

Machine Learning · Computer Science 2021-03-01 Eric Zhao , Anqi Liu , Animashree Anandkumar , Yisong Yue