English
Related papers

Related papers: The Role of Active Learning in Modern Machine Lear…

200 papers

Semi-Supervised Learning (SSL) is a framework that utilizes both labeled and unlabeled data to enhance model performance. Conventional SSL methods operate under the assumption that labeled and unlabeled data share the same label space.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Noam Fluss , Guy Hacohen , Daphna Weinshall

While annotating decent amounts of data to satisfy sophisticated learning models can be cost-prohibitive for many real-world applications. Active learning (AL) and semi-supervised learning (SSL) are two effective, but often isolated, means…

Machine Learning · Computer Science 2022-06-08 Jiannan Guo , Yangyang Kang , Yu Duan , Xiaozhong Liu , Siliang Tang , Wenqiao Zhang , Kun Kuang , Changlong Sun , Fei Wu

With the goal of making deep learning more label-efficient, a growing number of papers have been studying active learning (AL) for deep models. However, there are a number of issues in the prevalent experimental settings, mainly stemming…

Computer Vision and Pattern Recognition · Computer Science 2021-11-04 Nathan Beck , Durga Sivasubramanian , Apurva Dani , Ganesh Ramakrishnan , Rishabh Iyer

Developed to alleviate prohibitive labeling costs, active learning (AL) methods aim to reduce label complexity in supervised learning. While recent work has demonstrated the benefit of using AL in combination with large pre-trained language…

Machine Learning · Computer Science 2023-10-24 Josip Jukić , Jan Šnajder

The field of Natural Language Generation (NLG) suffers from a severe shortage of labeled data due to the extremely expensive and time-consuming process involved in manual annotation. A natural approach for coping with this problem is active…

Computation and Language · Computer Science 2023-10-18 Yotam Perlitz , Ariel Gera , Michal Shmueli-Scheuer , Dafna Sheinwald , Noam Slonim , Liat Ein-Dor

Active Learning (AL) has gained prominence in integrating data-intensive machine learning (ML) models into domains with limited labeled data. However, its effectiveness diminishes significantly when the labeling budget is low. In this…

Machine Learning · Computer Science 2024-02-12 Zhuokai Zhao , Yibo Jiang , Yuxin Chen

To address the annotation burden in LiDAR-based 3D object detection, active learning (AL) methods offer a promising solution. However, traditional active learning approaches solely rely on a small amount of labeled data to train an initial…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zengran Wang , Yanan Zhang , Jiaxin Chen , Di Huang

Active learning seeks to achieve strong performance with fewer training samples. It does this by iteratively asking an oracle to label new selected samples in a human-in-the-loop manner. This technique has gained increasing popularity due…

Machine Learning · Computer Science 2024-07-16 Dongyuan Li , Zhen Wang , Yankai Chen , Renhe Jiang , Weiping Ding , Manabu Okumura

Active learning (AL) is a promising ML paradigm that has the potential to parse through large unlabeled data and help reduce annotation cost in domains where labeling data can be prohibitive. Recently proposed neural network based AL…

Machine Learning · Computer Science 2022-06-17 Prateek Munjal , Nasir Hayat , Munawar Hayat , Jamshid Sourati , Shadab Khan

Active Learning (AL) methods seek to improve classifier performance when labels are expensive or scarce. We consider two central questions: Where does AL work? How much does it help? To address these questions, a comprehensive experimental…

Machine Learning · Statistics 2014-08-07 Lewis Evans , Niall M. Adams , Christoforos Anagnostopoulos

In recent years, speech-based self-supervised learning (SSL) has made significant progress in various tasks, including automatic speech recognition (ASR). An ASR model with decent performance can be realized by fine-tuning an SSL model with…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-30 Zhisheng Zheng , Ziyang Ma , Yu Wang , Xie Chen

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Machine Learning · Computer Science 2021-04-08 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and…

Computation and Language · Computer Science 2021-04-06 Rishi Hazra , Parag Dutta , Shubham Gupta , Mohammed Abdul Qaathir , Ambedkar Dukkipati

Training deep object detectors demands expensive bounding box annotation. Active learning (AL) is a promising technique to alleviate the annotation burden. Performing AL at box-level for object detection, i.e., selecting the most…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jingyi Liao , Xun Xu , Chuan-Sheng Foo , Lile Cai

Active learning (AL) aims to optimize model training and reduce annotation costs by selecting the most informative samples for labeling. Typically, AL methods rely on the empirical distribution of labeled data to define the decision…

Computation and Language · Computer Science 2025-07-23 Hui Xiang , Jinqiao Shi , Ting Zhang , Xiaojie Zhao , Yong Liu , Yong Ma

While semi-supervised learning (SSL) has received tremendous attentions in many machine learning tasks due to its successful use of unlabeled data, existing SSL algorithms use either all unlabeled examples or the unlabeled examples with a…

Machine Learning · Computer Science 2021-09-03 Yi Xu , Lei Shang , Jinxing Ye , Qi Qian , Yu-Feng Li , Baigui Sun , Hao Li , Rong Jin

Machine Learning (ML) is widely used to automatically extract meaningful information from Electronic Health Records (EHR) to support operational, clinical, and financial decision-making. However, ML models require a large number of…

Machine Learning · Computer Science 2021-04-14 Martha Dais Ferreira , Michal Malyska , Nicola Sahar , Riccardo Miotto , Fernando Paulovich , Evangelos Milios

A major challenge that prevents the training of DL models is the limited availability of accurately labeled data. This shortcoming is highlighted in areas where data annotation becomes a time-consuming and error-prone task. In this regard,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 David Aparco-Cardenas , Jancarlo F. Gomes , Alexandre X. Falcão , Pedro J. de Rezende

Efficient data annotation remains a critical challenge in machine learning, particularly for object detection tasks requiring extensive labeled data. Active learning (AL) has emerged as a promising solution to minimize annotation costs by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-25 Somraj Gautam , Nachiketa Purohit , Gaurav Harit

The goal of this paper is to simulate the benefits of jointly applying active learning (AL) and semi-supervised training (SST) in a new speech recognition application. Our data selection approach relies on confidence filtering, and its…

Computation and Language · Computer Science 2019-03-08 Thomas Drugman , Janne Pylkkonen , Reinhard Kneser