English
Related papers

Related papers: DUAL: Diversity and Uncertainty Active Learning fo…

200 papers

In recent years, a variety of tasks have been accomplished by deep reinforcement learning (DRL). However, when applying DRL to tasks in a real-world environment, designing an appropriate reward is difficult. Rewards obtained via actual…

Machine Learning · Computer Science 2023-10-04 Kanata Suzuki , Tetsuya Ogata

Annotating datasets for object detection is an expensive and time-consuming endeavor. To minimize this burden, active learning (AL) techniques are employed to select the most informative samples for annotation within a constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

Objects, in the real world, rarely occur in isolation and exhibit typical arrangements governed by their independent utility, and their expected interaction with humans and other objects in the context. For example, a chair is expected near…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Sharat Agarwal

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Active learning enhances the performance of machine learning methods, particularly in semi-supervised cases, by judiciously selecting a limited number of unlabeled data points for labeling, with the goal of improving the performance of an…

Machine Learning · Computer Science 2025-04-17 Gokul Bhusal , Kevin Miller , Ekaterina Merkurjev

Active learning (AL) aims at reducing labeling effort by identifying the most valuable unlabeled data points from a large pool. Traditional AL frameworks have two limitations: First, they perform data selection in a multi-round manner,…

Machine Learning · Computer Science 2021-08-09 Si Chen , Tianhao Wang , Ruoxi Jia

How can we find a general way to choose the most suitable samples for training a classifier? Even with very limited prior information? Active learning, which can be regarded as an iterative optimization procedure, plays a key role to…

Machine Learning · Computer Science 2019-04-16 Bo Du , Zengmao Wang , Lefei Zhang , Liangpei Zhang , Wei Liu , Jialie Shen , Dacheng Tao

Multi-task learning (MTL) optimizes several learning tasks simultaneously and leverages their shared information to improve generalization and the prediction of the model for each task. Auxiliary tasks can be added to the main task to…

Machine Learning · Computer Science 2020-07-03 Partoo Vafaeikia , Khashayar Namdar , Farzad Khalvati

In active learning, the focus is mainly on the selection strategy of unlabeled data for enhancing the generalization capability of the next learning cycle. For this, various uncertainty measurement methods have been proposed. On the other…

Computer Vision and Pattern Recognition · Computer Science 2020-11-06 SeulGi Hong , Heonjin Ha , Junmo Kim , Min-Kook Choi

A robust summarization system should be able to capture the gist of the document, regardless of the specific word choices or noise in the input. In this work, we first explore the summarization models' robustness against perturbations…

Computation and Language · Computer Science 2023-06-05 Xiuying Chen , Guodong Long , Chongyang Tao , Mingzhe Li , Xin Gao , Chengqi Zhang , Xiangliang Zhang

The field of Natural Language Generation (NLG) suffers from a severe shortage of labeled data due to the extremely expensive and time-consuming process involved in manual annotation. A natural approach for coping with this problem is active…

Computation and Language · Computer Science 2023-10-18 Yotam Perlitz , Ariel Gera , Michal Shmueli-Scheuer , Dafna Sheinwald , Noam Slonim , Liat Ein-Dor

Data collection and annotation is a laborious, time-consuming prerequisite for supervised machine learning tasks. Online Active Learning (OAL) is a paradigm that addresses this issue by simultaneously minimizing the amount of annotation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Mark Lindsey , Ankit Shah , Francis Kubala , Richard M. Stern

Transformer-based models have achieved state-of-the-art performance on short-input summarization. However, they still struggle with summarizing longer text. In this paper, we present DYLE, a novel dynamic latent extraction approach for…

Computation and Language · Computer Science 2022-04-26 Ziming Mao , Chen Henry Wu , Ansong Ni , Yusen Zhang , Rui Zhang , Tao Yu , Budhaditya Deb , Chenguang Zhu , Ahmed H. Awadallah , Dragomir Radev

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

Active Learning (AL) and Semi-supervised Learning are two techniques that have been studied to reduce the high cost of deep learning by using a small amount of labeled data and a large amount of unlabeled data. To improve the accuracy of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Jaeseung Lim , Jongkeun Na , Nojun Kwak

The cost of annotating transcriptions for large speech corpora becomes a bottleneck to maximally enjoy the potential capacity of deep neural network-based automatic speech recognition models. In this paper, we present a new training…

Audio and Speech Processing · Electrical Eng. & Systems 2020-11-06 Jihwan Bang , Heesu Kim , YoungJoon Yoo , Jung-Woo Ha

It is critical that the models pay attention not only to accuracy but also to the certainty of prediction. Uncertain predictions of deep models caused by noisy data raise significant concerns in trustworthy AI areas. To explore and handle…

Machine Learning · Computer Science 2023-03-30 Wei Wei , Jiahuan Zhou , Hongze Li , Ying Wu

Large Language Models (LLMs) are highly accurate in classification tasks, however, substantial computational and financial costs hinder their large-scale deployment in dynamic environments. Knowledge Distillation (KD) where a LLM "teacher"…

Machine Learning · Computer Science 2025-11-18 Viviana Luccioli , Rithika Iyengar , Ryan Panley , Flora Haberkorn , Xiaoyu Ge , Leland Crane , Nitish Sinha , Seung Jung Lee

Multi-task learning is central to many real-world applications. Unfortunately, obtaining labelled data for all tasks is time-consuming, challenging, and expensive. Active Learning (AL) can be used to reduce this burden. Existing techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Nikita Durasov , Nik Dorndorf , Pascal Fua

While deep learning succeeds in a wide range of tasks, it highly depends on the massive collection of annotated data which is expensive and time-consuming. To lower the cost of data annotation, active learning has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-22 Siyu Huang , Tianyang Wang , Haoyi Xiong , Bihan Wen , Jun Huan , Dejing Dou