English
Related papers

Related papers: ActiveGLAE: A Benchmark for Deep Active Learning w…

200 papers

Deep active learning has emerged as a powerful tool for training deep learning models within a predefined labeling budget. These models have achieved performances comparable to those trained in an offline setting. However, deep active…

Machine Learning · Computer Science 2023-09-21 Moseli Mots'oehli , Kyungim Baek

This paper introduces a cost-efficient active learning (AL) framework for classification, featuring a novel query design called candidate set query. Unlike traditional AL queries requiring the oracle to examine all possible classes, our…

Machine Learning · Computer Science 2025-08-20 Yeho Gwon , Sehyun Hwang , Hoyoung Kim , Jungseul Ok , Suha Kwak

Active learning approaches in computer vision generally involve querying strong labels for data. However, previous works have shown that weak supervision can be effective in training models for vision tasks while greatly reducing annotation…

Computer Vision and Pattern Recognition · Computer Science 2019-10-16 Sai Vikas Desai , Akshay L Chandra , Wei Guo , Seishi Ninomiya , Vineeth N Balasubramanian

Solving complex classification tasks using deep neural networks typically requires large amounts of annotated data. However, corresponding class labels are noisy when provided by error-prone annotators, e.g., crowdworkers. Training standard…

Machine Learning · Computer Science 2023-10-25 Marek Herde , Denis Huseljic , Bernhard Sick

Aligning large language models (LLMs) depends on high-quality datasets of human preference labels, which are costly to collect. Although active learning has been studied to improve sample efficiency relative to passive collection, many…

Machine Learning · Computer Science 2026-02-03 Yao Zhao , Kwang-Sung Jun

Real-world domain experts (e.g., doctors) rarely annotate only a decision label in their day-to-day workflow without providing explanations. Yet, existing low-resource learning techniques, such as Active Learning (AL), that aim to support…

Computation and Language · Computer Science 2023-10-24 Bingsheng Yao , Ishan Jindal , Lucian Popa , Yannis Katsis , Sayan Ghosh , Lihong He , Yuxuan Lu , Shashank Srivastava , Yunyao Li , James Hendler , Dakuo Wang

Despite recent advancements, NLP models continue to be vulnerable to bias. This bias often originates from the uneven distribution of real-world data and can propagate through the annotation process. Escalated integration of these models in…

Computation and Language · Computer Science 2023-05-29 Sabit Hassan , Malihe Alikhani

Pool-based sampling in active learning (AL) represents a key framework for an-notating informative data when dealing with deep learning models. In this paper, we present a novel pipeline for pool-based Active Learning. Unlike most previous…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Razvan Caramalau , Binod Bhattarai , Tae-Kyun Kim

Modern systems that rely on Machine Learning (ML) for predictive modelling, may suffer from the cold-start problem: supervised models work well but, initially, there are no labels, which are costly or slow to obtain. This problem is even…

Machine Learning · Computer Science 2021-10-25 Ricardo Barata , Miguel Leite , Ricardo Pacheco , Marco O. P. Sampaio , João Tiago Ascensão , Pedro Bizarro

Pretrained on web-scale open data, VLMs offer powerful capabilities for solving downstream tasks after being adapted to task-specific labeled data. Yet, data labeling can be expensive and may demand domain expertise. Active Learning (AL)…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Tong Wang , Jiaqi Wang , Shu Kong

Deep learning (DL) is revolutionizing the scientific computing community. To reduce the data gap, active learning has been identified as a promising solution for DL in the scientific computing community. However, the deep active learning…

Machine Learning · Computer Science 2022-10-04 Simiao Ren , Yang Deng , Willie J. Padilla , Jordan Malof

Active Learning (AL) is an active domain of research, but is seldom used in the industry despite the pressing needs. This is in part due to a misalignment of objectives, while research strives at getting the best results on selected…

Machine Learning · Computer Science 2021-02-22 Alexandre Abraham , Léo Dreyfus-Schmidt

Deep convolutional neural networks have achieved great success in various applications. However, training an effective DNN model for a specific task is rather challenging because it requires a prior knowledge or experience to design the…

Machine Learning · Computer Science 2018-06-06 Sheng-Jun Huang , Jia-Wei Zhao , Zhao-Yang Liu

Recent successes of Deep Neural Networks (DNNs) in a variety of research tasks, however, heavily rely on the large amounts of labeled samples. This may require considerable annotation cost in real-world applications. Fortunately, active…

Machine Learning · Computer Science 2020-09-08 Qiang Liu , Zhaocheng Liu , Xiaofang Zhu , Yeliang Xiu

Active learning has been utilized as an efficient tool in building anomaly detection models by leveraging expert feedback. In an active learning framework, a model queries samples to be labeled by experts and re-trains the model with the…

Machine Learning · Computer Science 2023-09-19 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

Active learning (AL) accelerates scientific discovery by prioritizing the most informative experiments, but traditional machine learning (ML) models used in AL suffer from cold-start limitations and domain-specific feature engineering,…

Machine Learning · Computer Science 2025-12-05 Hongchen Wang , Rafael Espinosa Castañeda , Jay R. Werber , Yao Fehlis , Edward Kim , Jason Hattrick-Simpers

How to accurately predict the properties of molecules is an essential problem in AI-driven drug discovery, which generally requires a large amount of annotation for training deep learning models. Annotating molecules, however, is quite…

Machine Learning · Computer Science 2022-05-24 Kuangqi Zhou , Kaixin Wang , Jiashi Feng , Jian Tang , Tingyang Xu , Xinchao Wang

In this work, we provide a survey of active learning (AL) for its applications in natural language processing (NLP). In addition to a fine-grained categorization of query strategies, we also investigate several other important aspects of…

Computation and Language · Computer Science 2023-02-06 Zhisong Zhang , Emma Strubell , Eduard Hovy

This paper proposes asal, a new GAN based active learning method that generates high entropy samples. Instead of directly annotating the synthetic samples, ASAL searches similar samples from the pool and includes them for training. Hence,…

Machine Learning · Computer Science 2019-12-24 Christoph Mayer , Radu Timofte

Annotating training data for sequence tagging of texts is usually very time-consuming. Recent advances in transfer learning for natural language processing in conjunction with active learning open the possibility to significantly reduce the…