English
Related papers

Related papers: On Initial Pools for Deep Active Learning

200 papers

The deployment of Deep Learning (DL) models is still precluded in those contexts where the amount of supervised data is limited. To answer this issue, active learning strategies aim at minimizing the amount of labelled data required to…

Machine Learning · Computer Science 2023-09-28 Gabriele Ciravegna , Frédéric Precioso , Alessandro Betti , Kevin Mottin , Marco Gori

The advent of large language models (LLMs) capable of producing general-purpose representations lets us revisit the practicality of deep active learning (AL): By leveraging frozen LLM embeddings, we can mitigate the computational costs of…

Computation and Language · Computer Science 2025-06-04 Lukas Rauch , Moritz Wirth , Denis Huseljic , Marek Herde , Bernhard Sick , Matthias Aßenmacher

Training a spoofing countermeasure (CM) that generalizes to various unseen data is desired but challenging. While methods such as data augmentation and self-supervised learning are applicable, the imperfect CM performance on diverse test…

Audio and Speech Processing · Electrical Eng. & Systems 2022-10-10 Xin Wang , Junich Yamagishi

Label efficiency has become an increasingly important objective in deep learning applications. Active learning aims to reduce the number of labeled examples needed to train deep networks, but the empirical performance of active learning…

Machine Learning · Computer Science 2023-12-19 Jifan Zhang , Shuai Shao , Saurabh Verma , Robert Nowak

During recent years, active learning has evolved into a popular paradigm for utilizing user's feedback to improve accuracy of learning algorithms. Active learning works by selecting the most informative sample among unlabeled data and…

Machine Learning · Computer Science 2016-11-17 Alireza Ghasemi , Hamid R. Rabiee , Mohsen Fadaee , Mohammad T. Manzuri , Mohammad H. Rohban

In this paper, we propose a novel active learning approach integrated with an improved semi-supervised learning framework to reduce the cost of manual annotation and enhance model performance. Our proposed approach effectively leverages…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Wanli Ma , Oktay Karakus , Paul L. Rosin

Training deep models with limited annotations poses a significant challenge when applied to diverse practical domains. Employing semi-supervised learning alongside the self-supervised model offers the potential to enhance label efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziting Wen , Oscar Pizarro , Stefan Williams

Improving performance in multiple domains is a challenging task, and often requires significant amounts of data to train and test models. Active learning techniques provide a promising solution by enabling models to select the most…

Machine Learning · Computer Science 2023-04-14 Anand Gokul Mahalingam , Aayush Shah , Akshay Gulati , Royston Mascarenhas , Rakshitha Panduranga

Even though Active Learning (AL) is widely studied, it is rarely applied in contexts outside its own scientific literature. We posit that the reason for this is AL's high computational cost coupled with the comparatively small lifts it is…

Machine Learning · Computer Science 2025-08-04 Thorben Werner , Lars Schmidt-Thieme , Vijaya Krishna Yalavarthi

We propose Cartography Active Learning (CAL), a novel Active Learning (AL) algorithm that exploits the behavior of the model on individual instances during training as a proxy to find the most informative instances for labeling. CAL is…

Computation and Language · Computer Science 2022-05-10 Mike Zhang , Barbara Plank

Recent advances in natural language processing (NLP) in online social media are evidently owed to large-scale datasets. However, labeling, storing, and processing a large number of textual data points, e.g., tweets, has remained…

Computation and Language · Computer Science 2022-02-02 Toktam A. Oghaz , Ivan Garibay

Most of the existing learning models, particularly deep neural networks, are reliant on large datasets whose hand-labeling is expensive and time demanding. A current trend is to make the learning of these models frugal and less dependent on…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Sebastien Deschamps , Hichem Sahbi

We introduce Information Condensing Active Learning (ICAL), a batch mode model agnostic Active Learning (AL) method targeted at Deep Bayesian Active Learning that focuses on acquiring labels for points which have as much information as…

Machine Learning · Computer Science 2020-02-21 Siddhartha Jain , Ge Liu , David Gifford

Active learning (AL) for multiple target models aims to reduce labeled data querying while effectively training multiple models concurrently. Existing AL algorithms often rely on iterative model training, which can be computationally…

Machine Learning · Computer Science 2024-10-03 Sheng-Jun Huang , Yi Li , Yiming Sun , Ying-Peng Tang

Quantum machine learning, as an extension of classical machine learning that harnesses quantum mechanics, facilitates effiient learning from data encoded in quantum states. Training a quantum neural network typically demands a substantial…

Quantum Physics · Physics 2026-02-17 Yongcheng Ding , Yue Ban , Mikel Sanz , José D. Martín-Guerrero , Xi Chen

Dialogue Acts (DAs) can be used to explain what expert tutors do and what students know during the tutoring process. Most empirical studies adopt the random sampling method to obtain sentence samples for manual annotation of DAs, which are…

Computation and Language · Computer Science 2023-04-13 Wei Tan , Jionghao Lin , David Lang , Guanliang Chen , Dragan Gasevic , Lan Du , Wray Buntine

Pretraining neural networks with massive unlabeled datasets has become popular as it equips the deep models with a better prior to solve downstream tasks. However, this approach generally assumes that the downstream tasks have access to…

Sound · Computer Science 2024-02-19 Harlin Lee , Aaqib Saeed , Andrea L. Bertozzi

Active Learning aims to optimize performance while minimizing annotation costs by selecting the most informative samples from an unlabelled pool. Traditional uncertainty sampling often leads to sampling bias by choosing similar uncertain…

Machine Learning · Computer Science 2024-11-27 Tejaswi Kasarla , Abhishek Jha , Faye Tervoort , Rita Cucchiara , Pascal Mettes

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating. Most existing works are based on shallow linear models by…

Machine Learning · Computer Science 2020-07-29 Changsheng Li , Handong Ma , Zhao Kang , Ye Yuan , Xiao-Yu Zhang , Guoren Wang

Active learning (AL), which aims to construct an effective training set by iteratively curating the most formative unlabeled data for annotation, has been widely used in low-resource tasks. Most active learning techniques in classification…

Computation and Language · Computer Science 2024-12-17 Yun Luo , Zhen Yang , Fandong Meng , Yingjie Li , Fang Guo , Qinglin Qi , Jie Zhou , Yue Zhang