English
Related papers

Related papers: Does Deep Active Learning Work in the Wild?

200 papers

Pool-based active learning (AL) is a promising technology for increasing data-efficiency of machine learning models. However, surveys show that performance of recent AL methods is very sensitive to the choice of dataset and training…

Machine Learning · Computer Science 2023-09-12 Tim Bakker , Herke van Hoof , Max Welling

Active learning (AL) techniques reduce labeling costs for training neural machine translation (NMT) models by selecting smaller representative subsets from unlabeled data for annotation. Diversity sampling techniques select heterogeneous…

Computation and Language · Computer Science 2024-12-19 Abdul Hameed Azeemi , Ihsan Ayyub Qazi , Agha Ali Raza

Characterizing the ground state properties of quantum systems is fundamental to capturing their behavior but computationally challenging. Recent advances in AI have introduced novel approaches, with diverse machine learning (ML) and deep…

Machine Learning · Computer Science 2025-05-21 Yusheng Zhao , Chi Zhang , Yuxuan Du

Given a limited labeling budget, active learning (AL) aims to sample the most informative instances from an unlabeled pool to acquire labels for subsequent model training. To achieve this, AL typically measures the informativeness of…

Machine Learning · Computer Science 2023-07-07 Cheng Chen , Yong Wang , Lizi Liao , Yueguo Chen , Xiaoyong Du

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Partial label learning (PLL) is a class of weakly supervised learning where each training instance consists of a data and a set of candidate labels containing a unique ground truth label. To tackle this problem, a majority of current…

Machine Learning · Computer Science 2021-02-09 Junghoon Seo , Joon Suk Huh

We propose Disentanglement based Active Learning (DAL), a new active learning technique based on self-supervision which leverages the concept of disentanglement. Instead of requesting labels from human oracle, our method automatically…

Machine Learning · Computer Science 2021-09-28 Silpa Vadakkeeveetil Sreelatha , Adarsh Kappiyath , Sumitra S

Numerous Deep Learning (DL)-based approaches have gained attention in software Log Anomaly Detection (LAD), yet class imbalance in training data remains a challenge, with anomalies often comprising less than 1% of datasets like Thunderbird.…

Software Engineering · Computer Science 2024-10-31 Xiaoxue Ma , Huiqi Zou , Pinjia He , Jacky Keung , Yishu Li , Xiao Yu , Federica Sarro

Deep neural networks have reached high accuracy on object detection but their success hinges on large amounts of labeled data. To reduce the labels dependency, various active learning strategies have been proposed, typically based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ismail Elezi , Zhiding Yu , Anima Anandkumar , Laura Leal-Taixe , Jose M. Alvarez

The ability to train complex and highly effective models often requires an abundance of training data, which can easily become a bottleneck in cost, time, and computational resources. Batch active learning, which adaptively issues batched…

Active learning (AL) uses a data selection algorithm to select useful training samples to minimize annotation cost. This is now an essential tool for building low-resource syntactic analyzers such as part-of-speech (POS) taggers. Existing…

Computation and Language · Computer Science 2020-11-24 Aditi Chaudhary , Antonios Anastasopoulos , Zaid Sheikh , Graham Neubig

Which samples should be labelled in a large data set is one of the most important problems for trainingof deep learning. So far, a variety of active sample selection strategies related to deep learning havebeen proposed in many literatures.…

Machine Learning · Computer Science 2022-02-09 Peng Liu , Lizhe Wang , Guojin He , Lei Zhao

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts…

Machine Learning · Computer Science 2020-06-02 Max Hopkins , Daniel M. Kane , Shachar Lovett

In many applications, data is easy to acquire but expensive and time-consuming to label prominent examples include medical imaging and NLP. This disparity has only grown in recent years as our ability to collect data improves. Under these…

Machine Learning · Computer Science 2021-04-07 Jaya Krishna Mandivarapu , Blake Camp , Rolando Estrada

Active Learning (AL) has gained prominence in integrating data-intensive machine learning (ML) models into domains with limited labeled data. However, its effectiveness diminishes significantly when the labeling budget is low. In this…

Machine Learning · Computer Science 2024-02-12 Zhuokai Zhao , Yibo Jiang , Yuxin Chen

Hyperparameter optimization is an important subfield of machine learning that focuses on tuning the hyperparameters of a chosen algorithm to achieve peak performance. Recently, there has been a stream of methods that tackle the issue of…

Machine Learning · Computer Science 2023-10-26 Arlind Kadra , Maciej Janowski , Martin Wistuba , Josif Grabocka

Machine learning models deployed in open-world scenarios often encounter unfamiliar conditions and perform poorly in unanticipated situations. As AI systems advance and find application in safety-critical domains, effectively handling…

Machine Learning · Computer Science 2025-04-22 Tian Xie , Jifan Zhang , Haoyue Bai , Robert Nowak

Most deep reinforcement learning algorithms are data inefficient in complex and rich environments, limiting their applicability to many scenarios. One direction for improving data efficiency is multitask learning with shared neural network…

Active Learning (AL) addresses the crucial challenge of enabling machines to efficiently gather labeled examples through strategic queries. Among the many AL strategies, Uncertainty Sampling (US) stands out as one of the most widely…

Machine Learning · Computer Science 2025-06-24 Po-Yi Lu , Yi-Jie Cheng , Chun-Liang Li , Hsuan-Tien Lin

Active learning (AL) has shown promise for being a particularly data-efficient machine learning approach. Yet, its performance depends on the application and it is not clear when AL practitioners can expect computational savings. Here, we…

Machine Learning · Computer Science 2024-08-22 Kunal Ghosh , Milica Todorović , Aki Vehtari , Patrick Rinke