English
Related papers

Related papers: An Empirical Study on the Efficacy of Deep Active …

200 papers

Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we analyze the performance of a variety of AL algorithms on…

Machine Learning · Computer Science 2022-10-11 Dara Bahri , Heinrich Jiang , Tal Schuster , Afshin Rostamizadeh

Active Learning aims to optimize performance while minimizing annotation costs by selecting the most informative samples from an unlabelled pool. Traditional uncertainty sampling often leads to sampling bias by choosing similar uncertain…

Machine Learning · Computer Science 2024-11-27 Tejaswi Kasarla , Abhishek Jha , Faye Tervoort , Rita Cucchiara , Pascal Mettes

Developed to alleviate prohibitive labeling costs, active learning (AL) methods aim to reduce label complexity in supervised learning. While recent work has demonstrated the benefit of using AL in combination with large pre-trained language…

Machine Learning · Computer Science 2023-10-24 Josip Jukić , Jan Šnajder

The deployment of Deep Learning (DL) models is still precluded in those contexts where the amount of supervised data is limited. To answer this issue, active learning strategies aim at minimizing the amount of labelled data required to…

Machine Learning · Computer Science 2023-09-28 Gabriele Ciravegna , Frédéric Precioso , Alessandro Betti , Kevin Mottin , Marco Gori

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating. Most existing works are based on shallow linear models by…

Machine Learning · Computer Science 2020-07-29 Changsheng Li , Handong Ma , Zhao Kang , Ye Yuan , Xiao-Yu Zhang , Guoren Wang

In this letter, we introduce deep active learning (AL) for multi-label classification (MLC) problems in remote sensing (RS). In particular, we investigate the effectiveness of several AL query functions for MLC of RS images. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Lars Möllenbrok , Gencer Sumbul , Begüm Demir

As deep learning continues to evolve, the need for data efficiency becomes increasingly important. Considering labeling large datasets is both time-consuming and expensive, active learning (AL) provides a promising solution to this…

Machine Learning · Computer Science 2025-05-21 Yifeng Wang , Xueying Zhan , Siyu Huang

Supervised classification approaches can predict labels for unknown data because of the supervised training process. The success of classification is heavily dependent on the labeled training data. Differently, clustering is effective in…

Machine Learning · Computer Science 2015-02-19 Fangfang Li , Guandong Xu , Longbing Cao

Active learning (AL) is a widely-used training strategy for maximizing predictive performance subject to a fixed annotation budget. In AL one iteratively selects training examples for annotation, often those for which the current model is…

Machine Learning · Computer Science 2019-11-05 David Lowell , Zachary C. Lipton , Byron C. Wallace

Active learning (AL) aims to select the most useful data samples from an unlabeled data pool and annotate them to expand the labeled dataset under a limited budget. Especially, uncertainty-based methods choose the most uncertain samples,…

Machine Learning · Computer Science 2023-10-02 Seong Min Kye , Kwanghee Choi , Hyeongmin Byun , Buru Chang

While annotating decent amounts of data to satisfy sophisticated learning models can be cost-prohibitive for many real-world applications. Active learning (AL) and semi-supervised learning (SSL) are two effective, but often isolated, means…

Machine Learning · Computer Science 2022-06-08 Jiannan Guo , Yangyang Kang , Yu Duan , Xiaozhong Liu , Siliang Tang , Wenqiao Zhang , Kun Kuang , Changlong Sun , Fei Wu

Using deep learning, we now have the ability to create exceptionally good semantic segmentation systems; however, collecting the prerequisite pixel-wise annotations for training images remains expensive and time-consuming. Therefore, it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Aneesh Rangnekar , Christopher Kanan , Matthew Hoffman

Wildlife camera trap images are being used extensively to investigate animal abundance, habitat associations, and behavior, which is complicated by the fact that experts must first classify the images manually. Artificial intelligence…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ludwig Bothmann , Lisa Wimmer , Omid Charrakh , Tobias Weber , Hendrik Edelhoff , Wibke Peters , Hien Nguyen , Caryl Benjamin , Annette Menzel

Standard deep learning relies on Backpropagation (BP), which is constrained by biologically implausible weight symmetry and suffers from significant gradient interference within dense representations. To mitigate these bottlenecks, we…

Machine Learning · Computer Science 2026-01-30 Fanping Liu , Hua Yang , Jiasi Zou

Deep learning (DL) is revolutionizing the scientific computing community. To reduce the data gap, active learning has been identified as a promising solution for DL in the scientific computing community. However, the deep active learning…

Machine Learning · Computer Science 2022-10-04 Simiao Ren , Yang Deng , Willie J. Padilla , Jordan Malof

A major problem with Active Learning (AL) is high training costs since models are typically retrained from scratch after every query round. We start by demonstrating that standard AL on neural networks with warm starting fails, both to…

Machine Learning · Computer Science 2023-12-14 Arnav Das , Gantavya Bhatt , Megh Bhalerao , Vianne Gao , Rui Yang , Jeff Bilmes

Deep predictive models rely on human supervision in the form of labeled training data. Obtaining large amounts of annotated training data can be expensive and time consuming, and this becomes a critical bottleneck while building such models…

Machine Learning · Statistics 2020-10-01 Bindya Venkatesh , Jayaraman J. Thiagarajan

Active learning (AL) is a promising ML paradigm that has the potential to parse through large unlabeled data and help reduce annotation cost in domains where labeling data can be prohibitive. Recently proposed neural network based AL…

Machine Learning · Computer Science 2022-06-17 Prateek Munjal , Nasir Hayat , Munawar Hayat , Jamshid Sourati , Shadab Khan

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

Computation and Language · Computer Science 2020-11-30 Yekyung Kim

Deep learning (DL) algorithms rely on massive amounts of labeled data. Semi-supervised learning (SSL) and active learning (AL) aim to reduce this label complexity by leveraging unlabeled data or carefully acquiring labels, respectively. In…

Machine Learning · Computer Science 2023-02-16 Seo Taek Kong , Soomin Jeon , Dongbin Na , Jaewon Lee , Hong-Seok Lee , Kyu-Hwan Jung