English
Related papers

Related papers: Reliable Active Learning from Unreliable Labels vi…

200 papers

Models that can actively seek out the best quality training data hold the promise of more accurate, adaptable, and efficient machine learning. Active learning techniques often tend to prefer examples that are the most difficult to classify.…

Machine Learning · Computer Science 2023-07-25 Savya Khosla , Chew Kin Whye , Jordan T. Ash , Cyril Zhang , Kenji Kawaguchi , Alex Lamb

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

Machine Learning · Computer Science 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Deep learning-based diagnostic models often suffer performance drops due to distribution shifts between training (source) and test (target) domains. Collecting and labeling sufficient target domain data for model retraining represents an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yaofei Duan , Yuhao Huang , Xin Yang , Luyi Han , Xinyu Xie , Zhiyuan Zhu , Ping He , Ka-Hou Chan , Ligang Cui , Sio-Kei Im , Dong Ni , Tao Tan

While deep learning succeeds in a wide range of tasks, it highly depends on the massive collection of annotated data which is expensive and time-consuming. To lower the cost of data annotation, active learning has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Siyu Huang , Tianyang Wang , Haoyi Xiong , Jun Huan , Dejing Dou

Training and validating models for semantic segmentation require datasets with pixel-wise annotations, which are notoriously labor-intensive. Although useful priors such as foundation models or crowdsourced datasets are available, they are…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Hoyoung Kim , Sehyun Hwang , Suha Kwak , Jungseul Ok

Quantifying the impacts of air pollution on health and climate relies on key atmospheric particle properties such as toxicity and hygroscopicity. However, these properties typically require complex observational techniques or expensive…

Machine Learning · Computer Science 2026-02-13 Fei Jiang , Jiyang Xia , Junjie Yu , Mingfei Sun , Hugh Coe , David Topping , Dantong Liu , Zhenhui Jessie Li , Zhonghua Zheng

Active learning (AL) repeatedly trains the classifier with the minimum labeling budget to improve the current classification model. The training process is usually supervised by an uncertainty evaluation strategy. However, the uncertainty…

Machine Learning · Computer Science 2020-09-29 Xiaofeng Cao

Deep learning-based techniques have proven effective in polyp segmentation tasks when provided with sufficient pixel-wise labeled data. However, the high cost of manual annotation has created a bottleneck for model generalization. To…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Duojun Huang , Xinyu Xiong , De-Jun Fan , Feng Gao , Xiao-Jian Wu , Guanbin Li

Deep metric learning (DML) has shown to be effective for content-based image retrieval (CBIR) in remote sensing (RS). Most of DML methods for CBIR rely on a high number of annotated images to accurately learn model parameters of deep neural…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Genc Hoxha , Gencer Sumbul , Julia Henkel , Lars Möllenbrok , Begüm Demir

Active learning (AL) concerns itself with learning a model from as few labelled data as possible through actively and iteratively querying an oracle with selected unlabelled samples. In this paper, we focus on analyzing a popular type of AL…

Machine Learning · Computer Science 2019-12-03 Minjie Xu , Gary Kazantsev

Deep learning approaches achieve state-of-the-art performance for classifying radiology images, but rely on large labelled datasets that require resource-intensive annotation by specialists. Both semi-supervised learning and active learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Shafa Balaram , Cuong M. Nguyen , Ashraf Kassim , Pavitra Krishnaswamy

Real-world domain experts (e.g., doctors) rarely annotate only a decision label in their day-to-day workflow without providing explanations. Yet, existing low-resource learning techniques, such as Active Learning (AL), that aim to support…

Computation and Language · Computer Science 2023-10-24 Bingsheng Yao , Ishan Jindal , Lucian Popa , Yannis Katsis , Sayan Ghosh , Lihong He , Yuxuan Lu , Shashank Srivastava , Yunyao Li , James Hendler , Dakuo Wang

Active learning (AL) attempts to maximize the performance gain of the model by marking the fewest samples. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize massive parameters, so that the model…

Machine Learning · Computer Science 2021-12-07 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Brij B. Gupta , Xiaojiang Chen , Xin Wang

Due to the lack of labels and the domain diversities, it is a challenge to study person re-identification in the cross-domain setting. An admirable method is to optimize the target model by assigning pseudo-labels for unlabeled samples…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Hongliang Zhang , Shoudong Han , Xiaofeng Pan , Jun Zhao

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

Computation and Language · Computer Science 2020-11-30 Yekyung Kim

Active learning (AL) techniques optimally utilize a labeling budget by iteratively selecting instances that are most valuable for learning. However, they lack ``prerequisite checks'', i.e., there are no prescribed criteria to pick an AL…

Machine Learning · Computer Science 2024-10-07 Abhishek Ghose , Emma Thuong Nguyen

While deep learning (DL) is data-hungry and usually relies on extensive labeled data to deliver good performance, Active Learning (AL) reduces labeling costs by selecting a small proportion of samples from unlabeled data for labeling and…

Machine Learning · Computer Science 2022-07-20 Xueying Zhan , Qingzhong Wang , Kuan-hao Huang , Haoyi Xiong , Dejing Dou , Antoni B. Chan

Active learning is a machine learning approach for reducing the data labeling effort. Given a pool of unlabeled samples, it tries to select the most useful ones to label so that a model built from them can achieve the best possible…

Machine Learning · Computer Science 2020-03-31 Dongrui Wu

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Active learning (AL) uses a data selection algorithm to select useful training samples to minimize annotation cost. This is now an essential tool for building low-resource syntactic analyzers such as part-of-speech (POS) taggers. Existing…

Computation and Language · Computer Science 2020-11-24 Aditi Chaudhary , Antonios Anastasopoulos , Zaid Sheikh , Graham Neubig