English
Related papers

Related papers: Single Shot Active Learning using Pseudo Annotator…

200 papers

While deep learning succeeds in a wide range of tasks, it highly depends on the massive collection of annotated data which is expensive and time-consuming. To lower the cost of data annotation, active learning has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Siyu Huang , Tianyang Wang , Haoyi Xiong , Jun Huan , Dejing Dou

Multi-annotator learning (MAL) aims to model annotator-specific labeling patterns. However, existing methods face a critical challenge: they simply skip updating annotator-specific model parameters when encountering missing labels, i.e., a…

Multimedia · Computer Science 2025-08-08 Liyun Zhang , Zheng Lian , Hong Liu , Takanori Takebe , Yuta Nakashima

The field of few-shot learning has been laboriously explored in the supervised setting, where per-class labels are available. On the other hand, the unsupervised few-shot learning setting, where no labels of any kind are required, has seen…

Machine Learning · Statistics 2019-03-07 Antreas Antoniou , Amos Storkey

Active learning aims to develop label-efficient algorithms by querying the most representative samples to be labeled by a human annotator. Current active learning techniques either rely on model uncertainty to select the most uncertain…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Sayna Ebrahimi , William Gan , Dian Chen , Giscard Biamby , Kamyar Salahi , Michael Laielli , Shizhan Zhu , Trevor Darrell

Training deep object detectors demands expensive bounding box annotation. Active learning (AL) is a promising technique to alleviate the annotation burden. Performing AL at box-level for object detection, i.e., selecting the most…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Jingyi Liao , Xun Xu , Chuan-Sheng Foo , Lile Cai

Annotating data for multi-label classification is prohibitively expensive because every category of interest must be confirmed to be present or absent. Recent work on single positive multi-label (SPML) learning shows that it is possible to…

Machine Learning · Computer Science 2023-05-26 Julio Arroyo , Pietro Perona , Elijah Cole

Label scarcity has been a long-standing issue for biomedical image segmentation, due to high annotation costs and professional requirements. Recently, active learning (AL) strategies strive to reduce annotation costs by querying a small…

Image and Video Processing · Electrical Eng. & Systems 2022-11-02 Ziyuan Zhao , Wenjing Lu , Zeng Zeng , Kaixin Xu , Bharadwaj Veeravalli , Cuntai Guan

In this paper, we address the limitations of the common data annotation and training methods for objective single-label classification tasks. Typically, when annotating such tasks annotators are only asked to provide a single label for each…

Computation and Language · Computer Science 2023-11-10 Ben Wu , Yue Li , Yida Mu , Carolina Scarton , Kalina Bontcheva , Xingyi Song

Active learning (AL) is a promising ML paradigm that has the potential to parse through large unlabeled data and help reduce annotation cost in domains where labeling data can be prohibitive. Recently proposed neural network based AL…

Machine Learning · Computer Science 2022-06-17 Prateek Munjal , Nasir Hayat , Munawar Hayat , Jamshid Sourati , Shadab Khan

This paper aims to develop a novel cost-effective framework for face identification, which progressively maintains a batch of classifiers with the increasing face images of different individuals. By naturally combining two recently rising…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Liang Lin , Keze Wang , Deyu Meng , Wangmeng Zuo , Lei Zhang

One of the biggest challenges that complicates applied supervised machine learning is the need for huge amounts of labeled data. Active Learning (AL) is a well-known standard method for efficiently obtaining labeled data by first labeling…

Machine Learning · Computer Science 2021-08-18 Julius Gonsior , Maik Thiele , Wolfgang Lehner

Self-training has greatly facilitated domain adaptive semantic segmentation, which iteratively generates pseudo labels on unlabeled target data and retrains the network. However, realistic segmentation datasets are highly imbalanced, pseudo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Binhui Xie , Longhui Yuan , Shuang Li , Chi Harold Liu , Xinjing Cheng

Annotating datasets for object detection is an expensive and time-consuming endeavor. To minimize this burden, active learning (AL) techniques are employed to select the most informative samples for annotation within a constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Chenhongyi Yang , Lichao Huang , Elliot J. Crowley

Regression problems are pervasive in real-world applications. Generally a substantial amount of labeled samples are needed to build a regression model with good generalization ability. However, many times it is relatively easy to collect a…

Machine Learning · Computer Science 2018-08-14 Dongrui Wu , Chin-Teng Lin , Jian Huang

Active learning (AL) is a learning paradigm where an active learner has to train a model (e.g., a classifier) which is in principal trained in a supervised way, but in AL it has to be done by means of a data set with initially unlabeled…

Machine Learning · Computer Science 2015-12-23 Adrian Calma , Tobias Reitmaier , Bernhard Sick , Paul Lukowicz , Mark Embrechts

Active learning (AL) uses a data selection algorithm to select useful training samples to minimize annotation cost. This is now an essential tool for building low-resource syntactic analyzers such as part-of-speech (POS) taggers. Existing…

Computation and Language · Computer Science 2020-11-24 Aditi Chaudhary , Antonios Anastasopoulos , Zaid Sheikh , Graham Neubig

Active Learning aims to optimize performance while minimizing annotation costs by selecting the most informative samples from an unlabelled pool. Traditional uncertainty sampling often leads to sampling bias by choosing similar uncertain…

Machine Learning · Computer Science 2024-11-27 Tejaswi Kasarla , Abhishek Jha , Faye Tervoort , Rita Cucchiara , Pascal Mettes

Previous LLMs-based RL studies typically follow either supervised learning with high annotation costs, or unsupervised paradigms using voting or entropy-based rewards. However, their performance remains far from satisfactory due to the…

Machine Learning · Computer Science 2026-04-22 Zhiyin Yu , Bo Zhang , Qibin Hou , Zhonghai Wu , Xiao Luo , Lei Bai

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

Federated learning (FL) has been intensively investigated in terms of communication efficiency, privacy, and fairness. However, efficient annotation, which is a pain point in real-world FL applications, is less studied. In this project, we…

Machine Learning · Computer Science 2024-03-19 Jin-Hyun Ahn , Kyungsang Kim , Jeongwan Koh , Quanzheng Li