中文
相关论文

相关论文: Navigating the Pitfalls of Active Learning Evaluat…

200 篇论文

Access to high-quality labeled data remains a limiting factor in applied supervised learning. While label variation (LV), i.e., differing labels for the same instance, is common, especially in natural language processing, annotation…

计算与语言 · 计算机科学 2025-07-04 Cornelia Gruber , Helen Alber , Bernd Bischl , Göran Kauermann , Barbara Plank , Matthias Aßenmacher

Several recent papers investigate Active Learning (AL) for mitigating the data dependence of deep learning for natural language processing. However, the applicability of AL to real-world problems remains an open question. While in…

计算与语言 · 计算机科学 2018-09-25 Aditya Siddhant , Zachary C. Lipton

The advent of large language models (LLMs) capable of producing general-purpose representations lets us revisit the practicality of deep active learning (AL): By leveraging frozen LLM embeddings, we can mitigate the computational costs of…

计算与语言 · 计算机科学 2025-06-04 Lukas Rauch , Moritz Wirth , Denis Huseljic , Marek Herde , Bernhard Sick , Matthias Aßenmacher

Active learning (AL) is for optimizing the selection of unlabeled data for annotation (labeling), aiming to enhance model performance while minimizing labeling effort. The key question in AL is which unlabeled data should be selected for…

计算机视觉与模式识别 · 计算机科学 2024-10-22 Yingrui Ji , Vijaya Sindhoori Kaza , Nishanth Artham , Tianyang Wang

Deep predictive models rely on human supervision in the form of labeled training data. Obtaining large amounts of annotated training data can be expensive and time consuming, and this becomes a critical bottleneck while building such models…

机器学习 · 统计学 2020-10-01 Bindya Venkatesh , Jayaraman J. Thiagarajan

Deep learning has achieved widespread success in medical image analysis, leading to an increasing demand for large-scale expert-annotated medical image datasets. Yet, the high cost of annotating medical images severely hampers the…

计算机视觉与模式识别 · 计算机科学 2024-03-14 Haoran Wang , Qiuye Jin , Shiman Li , Siyu Liu , Manning Wang , Zhijian Song

Active Learning (AL) techniques have proven to be highly effective in reducing data labeling costs across a range of machine learning tasks. Nevertheless, one known challenge of these methods is their potential to introduce unfairness…

机器学习 · 计算机科学 2023-12-20 Ricky Fajri , Akrati Saxena , Yulong Pei , Mykola Pechenizkiy

A major problem with Active Learning (AL) is high training costs since models are typically retrained from scratch after every query round. We start by demonstrating that standard AL on neural networks with warm starting fails, both to…

机器学习 · 计算机科学 2023-12-14 Arnav Das , Gantavya Bhatt , Megh Bhalerao , Vianne Gao , Rui Yang , Jeff Bilmes

Training a quantum machine learning model generally requires a large labeled dataset, which incurs high labeling and computational costs. To reduce such costs, a selective training strategy, called active learning (AL), chooses only a…

量子物理 · 物理学 2022-08-04 Chen Ding , Xiao-Yue Xu , Yun-Fei Niu , Shuo Zhang , Wan-Su Bao , He-Liang Huang

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Bardia Safaei , Vishal M. Patel

Deep learning has shown remarkable success in medical image analysis, but its reliance on large volumes of high-quality labeled data limits its applicability. While noisy labeled data are easier to obtain, directly incorporating them into…

计算机视觉与模式识别 · 计算机科学 2025-10-21 Chengxuan Qian , Kai Han , Jianxia Ding , Chongwen Lyu , Zhenlong Yuan , Jun Chen , Zhe Liu

Active learning(AL) has recently gained popularity for deep learning(DL) models. This is due to efficient and informative sampling, especially when the learner requires large-scale labelled datasets. Commonly, the sampling and training…

计算机视觉与模式识别 · 计算机科学 2023-01-05 Razvan Caramalau , Binod Bhattarai , Danail Stoyanov , Tae-Kyun Kim

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

机器学习 · 计算机科学 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Federated active learning (FAL) seeks to reduce annotation cost under privacy constraints, yet its effectiveness degrades in realistic settings with severe global class imbalance and highly heterogeneous clients. We conduct a systematic…

机器学习 · 计算机科学 2026-03-12 Chen-Chen Zong , Sheng-Jun Huang

Active learning (AL) has emerged as a crucial methodology for minimizing labeling costs in deep learning by selecting the most valuable samples from a pool of unlabeled data for annotation. Traditional AL operates under a closed-set…

机器学习 · 计算机科学 2026-04-23 Zongyao Lyu , William J. Beksi

Many active learning methods belong to the retraining-based approaches, which select one unlabeled instance, add it to the training set with its possible labels, retrain the classification model, and evaluate the criteria that we base our…

机器学习 · 统计学 2017-03-01 Yazhou Yang , Marco Loog

Using deep learning, we now have the ability to create exceptionally good semantic segmentation systems; however, collecting the prerequisite pixel-wise annotations for training images remains expensive and time-consuming. Therefore, it…

计算机视觉与模式识别 · 计算机科学 2022-10-19 Aneesh Rangnekar , Christopher Kanan , Matthew Hoffman

Active learning aims to develop label-efficient algorithms by querying the most representative samples to be labeled by a human annotator. Current active learning techniques either rely on model uncertainty to select the most uncertain…

计算机视觉与模式识别 · 计算机科学 2021-03-31 Sayna Ebrahimi , William Gan , Dian Chen , Giscard Biamby , Kamyar Salahi , Michael Laielli , Shizhan Zhu , Trevor Darrell

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

计算与语言 · 计算机科学 2020-11-30 Yekyung Kim

Active Learning (AL) techniques aim to minimize the training data required to train a model for a given task. Pool-based AL techniques start with a small initial labeled pool and then iteratively pick batches of the most informative samples…

机器学习 · 计算机科学 2021-07-15 Akshay L Chandra , Sai Vikas Desai , Chaitanya Devaguptapu , Vineeth N Balasubramanian