English
Related papers

Related papers: Active Learning with a Noisy Annotator

200 papers

Deep learning methods have achieved promising performance in many areas, but they are still struggling with noisy-labeled images during the training process. Considering that the annotation quality indispensably relies on great expertise,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Haidong Zhu , Jialin Shi , Ji Wu

Deep active learning aims to reduce the annotation cost for the training of deep models, which is notoriously data-hungry. Until recently, deep active learning methods were ineffectual in the low-budget regime, where only a small number of…

Machine Learning · Computer Science 2023-12-29 Ofer Yehuda , Avihu Dekel , Guy Hacohen , Daphna Weinshall

Active learning (AL) is an effective approach to select the most informative samples to label so as to reduce the annotation cost. Existing AL methods typically work under the closed-set assumption, i.e., all classes existing in the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Linhao Qu , Yingfan Ma , Zhiwei Yang , Manning Wang , Zhijian Song

Recent successes in learning-based image classification, however, heavily rely on the large number of annotated training samples, which may require considerable human efforts. In this paper, we propose a novel active learning framework,…

Computer Vision and Pattern Recognition · Computer Science 2017-01-16 Keze Wang , Dongyu Zhang , Ya Li , Ruimao Zhang , Liang Lin

Active learning (AL) is a machine learning algorithm that can achieve greater accuracy with fewer labeled training instances, for having the ability to ask oracles to label the most valuable unlabeled data chosen iteratively and…

Machine Learning · Computer Science 2022-09-30 Ruoyu Wang

Deep learning in the presence of noisy annotations has been studied extensively in classification, but much less in segmentation tasks. In this work, we study the learning dynamics of deep segmentation networks trained on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Sheng Liu , Kangning Liu , Weicheng Zhu , Yiqiu Shen , Carlos Fernandez-Granda

Active learning aims to train accurate classifiers while minimizing labeling costs by strategically selecting informative samples for annotation. This study focuses on image classification tasks, comparing AL methods on CIFAR10, CIFAR100,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Moseli Mots'oehli , kyungim Baek

Curating an informative and representative dataset is essential for enhancing the performance of 2D object detectors. We present a novel active learning sampling strategy that addresses both the informativeness and diversity of the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Aral Hekimoglu , Adrian Brucker , Alper Kagan Kayali , Michael Schmidt , Alvaro Marcos-Ramiro

The performance of deep neural networks improves with more annotated data. The problem is that the budget for annotation is limited. One solution to this is active learning, where a model asks human to annotate data that it perceived as…

Computer Vision and Pattern Recognition · Computer Science 2019-05-10 Donggeun Yoo , In So Kweon

Label noise poses a serious threat to deep neural networks (DNNs). Employing robust loss functions which reconcile fitting ability with robustness is a simple but effective strategy to handle this problem. However, the widely-used static…

Machine Learning · Computer Science 2023-08-08 Xiu-Chuan Li , Xiaobo Xia , Fei Zhu , Tongliang Liu , Xu-Yao Zhang , Cheng-Lin Liu

Annotating bounding boxes is costly and limits the scalability of object detection. This challenge is compounded by the need to preserve high accuracy while minimizing manual effort in real-world applications. Prior active learning methods…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Rashi Sharma , Justin Timothy C. Bersamin , Karthikk Subramanian

Passive acoustic monitoring (PAM) in avian bioacoustics enables cost-effective and extensive data collection with minimal disruption to natural habitats. Despite advancements in computational avian bioacoustics, deep learning models…

Sound · Computer Science 2024-11-06 Lukas Rauch , Denis Huseljic , Moritz Wirth , Jens Decke , Bernhard Sick , Christoph Scholz

Accurate instrument segmentation in endoscopic vision of robot-assisted surgery is challenging due to reflection on the instruments and frequent contacts with tissue. Deep neural networks (DNN) show competitive performance and are in favor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Haonan Peng , Shan Lin , Daniel King , Yun-Hsuan Su , Randall A. Bly , Kris S. Moe , Blake Hannaford

Natural Language Understanding (NLU) models are typically trained in a supervised learning framework. In the case of intent classification, the predicted labels are predefined and based on the designed annotation schema while the labelling…

We propose a meta-learning method for learning from multiple noisy annotators. In many applications such as crowdsourcing services, labels for supervised learning are given by multiple annotators. Since the annotators have different skills…

Machine Learning · Computer Science 2025-06-13 Atsutoshi Kumagai , Tomoharu Iwata , Taishi Nishiyama , Yasutoshi Ida , Yasuhiro Fujiwara

In this paper, we introduced the novel concept of advisor network to address the problem of noisy labels in image classification. Deep neural networks (DNN) are prone to performance reduction and overfitting problems on training data with…

Computer Vision and Pattern Recognition · Computer Science 2024-08-19 Simone Ricci , Tiberio Uricchio , Alberto Del Bimbo

Forgetting presents a significant challenge during incremental training, making it particularly demanding for contemporary AI systems to assimilate new knowledge in streaming data environments. To address this issue, most approaches in…

Machine Learning · Computer Science 2024-08-27 Monica Millunzi , Lorenzo Bonicelli , Angelo Porrello , Jacopo Credi , Petter N. Kolm , Simone Calderara

The vast amounts of audio data collected in Sound Event Detection (SED) applications require efficient annotation strategies to enable supervised learning. Manual labeling is expensive and time-consuming, making Active Learning (AL) a…

Sound · Computer Science 2025-03-05 Richard Lindholm , Oscar Marklund , Olof Mogren , John Martinsson

Training a supervised neural network classifier typically requires many annotated training samples. Collecting and annotating a large number of data points are costly and sometimes even infeasible. Traditional annotation process uses a…

Computation and Language · Computer Science 2020-10-02 Weixin Liang , James Zou , Zhou Yu

Deep neural networks have achieved remarkable success in a wide variety of natural image and medical image computing tasks. However, these achievements indispensably rely on accurately annotated training data. If encountering some…

Image and Video Processing · Electrical Eng. & Systems 2022-05-11 Cheng Xue , Lequan Yu , Pengfei Chen , Qi Dou , Pheng-Ann Heng