English
Related papers

Related papers: Avoid Wasted Annotation Costs in Open-set Active L…

200 papers

This study centers on overcoming the challenge of selecting the best annotators for each query in Active Learning (AL), with the objective of minimizing misclassifications. AL recognizes the challenges related to cost and time when…

Machine Learning · Computer Science 2025-08-02 Diana Mortagua

Given a limited labeling budget, active learning (AL) aims to sample the most informative instances from an unlabeled pool to acquire labels for subsequent model training. To achieve this, AL typically measures the informativeness of…

Machine Learning · Computer Science 2023-07-07 Cheng Chen , Yong Wang , Lizi Liao , Yueguo Chen , Xiaoyong Du

Active learning (AL) is a machine learning algorithm that can achieve greater accuracy with fewer labeled training instances, for having the ability to ask oracles to label the most valuable unlabeled data chosen iteratively and…

Machine Learning · Computer Science 2022-09-30 Ruoyu Wang

Deep learning has seen remarkable advancements in machine learning, yet it often demands extensive annotated data. Tasks like 3D semantic segmentation impose a substantial annotation burden, especially in domains like medicine, where expert…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Arvind Murari Vepa , Zukang Yang , Andrew Choi , Jungseock Joo , Fabien Scalzo , Yizhou Sun

Machine learning models are increasingly being utilized across various fields and tasks due to their outstanding performance and strong generalization capabilities. Nonetheless, their success hinges on the availability of large volumes of…

Machine Learning · Computer Science 2024-11-26 Shreen Gul , Mohamed Elmahallawy , Sanjay Madria , Ardhendu Tripathy

Machine learning models deployed in open-world scenarios often encounter unfamiliar conditions and perform poorly in unanticipated situations. As AI systems advance and find application in safety-critical domains, effectively handling…

Machine Learning · Computer Science 2025-04-22 Tian Xie , Jifan Zhang , Haoyue Bai , Robert Nowak

Active learning, a label-efficient paradigm, empowers models to interactively query an oracle for labeling new data. In the realm of LiDAR semantic segmentation, the challenges stem from the sheer volume of point clouds, rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Binhui Xie , Shuang Li , Qingju Guo , Chi Harold Liu , Xinjing Cheng

Deep learning (DL) algorithms rely on massive amounts of labeled data. Semi-supervised learning (SSL) and active learning (AL) aim to reduce this label complexity by leveraging unlabeled data or carefully acquiring labels, respectively. In…

Machine Learning · Computer Science 2023-02-16 Seo Taek Kong , Soomin Jeon , Dongbin Na , Jaewon Lee , Hong-Seok Lee , Kyu-Hwan Jung

One of the biggest challenges that complicates applied supervised machine learning is the need for huge amounts of labeled data. Active Learning (AL) is a well-known standard method for efficiently obtaining labeled data by first labeling…

Machine Learning · Computer Science 2021-08-18 Julius Gonsior , Maik Thiele , Wolfgang Lehner

In this work we propose a pragmatic method that reduces the annotation cost for structured label spaces using active learning. Our approach leverages partial annotation, which reduces labeling costs for structured outputs by selecting only…

Computation and Language · Computer Science 2023-10-20 Zhisong Zhang , Emma Strubell , Eduard Hovy

Pre-trained Vision Language Models (VLMs) have demonstrated notable progress in various zero-shot tasks, such as classification and retrieval. Despite their performance, because improving performance on new tasks requires task-specific…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jihwan Bang , Sumyeong Ahn , Jae-Gil Lee

Deep learning algorithms are often said to be data hungry. The performance of such algorithms generally improve as more and more annotated data is fed into the model. While collecting unlabelled data is easier (as they can be scraped easily…

Machine Learning · Computer Science 2024-01-04 Abhishek Sinha , Shreya Singh

Federated Active Learning (FAL) has emerged as a promising framework to leverage large quantities of unlabeled data across distributed clients while preserving data privacy. However, real-world deployments remain limited by high annotation…

Machine Learning · Computer Science 2025-05-20 Haoyuan Li , Mathias Funk , Jindong Wang , Aaqib Saeed

Software systems increasingly include AI components based on deep learning (DL). Reliable testing of such systems requires near-perfect test-input validity and label accuracy, with minimal human effort. Yet, the DL community has largely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Mohammad Hossein Amini , Mehrdad Sabetzadeh , Shiva Nejati

Multi-task learning, in which several tasks are jointly learned by a single model, allows NLP models to share information from multiple annotations and may facilitate better predictions when the tasks are inter-related. This technique,…

Computation and Language · Computer Science 2022-10-31 Guy Rotman , Roi Reichart

A major problem with Active Learning (AL) is high training costs since models are typically retrained from scratch after every query round. We start by demonstrating that standard AL on neural networks with warm starting fails, both to…

Machine Learning · Computer Science 2023-12-14 Arnav Das , Gantavya Bhatt , Megh Bhalerao , Vianne Gao , Rui Yang , Jeff Bilmes

Active learning selects informative samples for annotation within budget, which has proven efficient recently on object detection. However, the widely used active detection benchmarks conduct image-level evaluation, which is unrealistic in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Mengyao Lyu , Jundong Zhou , Hui Chen , Yijie Huang , Dongdong Yu , Yaqian Li , Yandong Guo , Yuchen Guo , Liuyu Xiang , Guiguang Ding

Active learning (AL) techniques reduce labeling costs for training neural machine translation (NMT) models by selecting smaller representative subsets from unlabeled data for annotation. Diversity sampling techniques select heterogeneous…

Computation and Language · Computer Science 2024-12-19 Abdul Hameed Azeemi , Ihsan Ayyub Qazi , Agha Ali Raza

Deep active learning aims to reduce the annotation cost for the training of deep models, which is notoriously data-hungry. Until recently, deep active learning methods were ineffectual in the low-budget regime, where only a small number of…

Machine Learning · Computer Science 2023-12-29 Ofer Yehuda , Avihu Dekel , Guy Hacohen , Daphna Weinshall

In the context of text classification, the financial burden of annotation exercises for creating training data is a critical issue. Active learning techniques, particularly those rooted in uncertainty sampling, offer a cost-effective…

Computation and Language · Computer Science 2024-06-19 Hamidreza Rouzegar , Masoud Makrehchi