English
Related papers

Related papers: Annotator: A Generic Active Learning Baseline for …

200 papers

Crowdsourcing platforms offer a practical solution to the problem of affordably annotating large datasets for training supervised classifiers. Unfortunately, poor worker performance frequently threatens to compromise annotation reliability,…

Machine Learning · Computer Science 2014-01-17 Liyue Zhao , Yu Zhang , Gita Sukthankar

Medical image segmentation is a critical task in medical image analysis. In recent years, deep learning based approaches have shown exceptional performance when trained on a fully-annotated dataset. However, data annotation is often a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Han Liu , Hao Li , Xing Yao , Yubo Fan , Dewei Hu , Benoit Dawant , Vishwesh Nath , Zhoubing Xu , Ipek Oguz

We introduce LLM SELECTOR, the first framework for active model selection of Large Language Models (LLMs). Unlike prior evaluation and benchmarking approaches that rely on fully annotated datasets, LLM SELECTOR efficiently identifies the…

Computation and Language · Computer Science 2025-10-13 Yavuz Durmazkeser , Patrik Okanovic , Andreas Kirsch , Torsten Hoefler , Nezihe Merve Gürel

Recent years have witnessed the rapid progress of perception algorithms on top of LiDAR, a widely adopted sensor for autonomous driving systems. These LiDAR-based solutions are typically data hungry, requiring a large amount of data to be…

Robotics · Computer Science 2020-11-23 Tai Wang , Conghui He , Zhe Wang , Jianping Shi , Dahua Lin

Medical image analysis requires substantial labeled data for model training, yet expert annotation is expensive and time-consuming. Active learning (AL) addresses this challenge by strategically selecting the most informative samples for…

Image and Video Processing · Electrical Eng. & Systems 2026-03-06 Ifrat Ikhtear Uddin , Longwei Wang , Xiao Qin , Yang Zhou , KC Santosh

Active learning strives to reduce the need for costly data annotation, by repeatedly querying an annotator to label the most informative samples from a pool of unlabeled data, and then training a model from these samples. We identify two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Jiarong Wei , Yancong Lin , Holger Caesar

A main bottleneck of learning-based robotic scene understanding methods is the heavy reliance on extensive annotated training data, which often limits their generalization ability. In LiDAR panoptic segmentation, this challenge becomes even…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Ahmet Selim Çanakçı , Niclas Vödisch , Kürsat Petek , Wolfram Burgard , Abhinav Valada

Document images often have intricate layout structures, with numerous content regions (e.g. texts, figures, tables) densely arranged on each page. This makes the manual annotation of layout datasets expensive and inefficient. These…

Machine Learning · Computer Science 2021-03-31 Zejiang Shen , Jian Zhao , Melissa Dell , Yaoliang Yu , Weining Li

While LiDAR data acquisition is easy, labeling for semantic segmentation remains highly time consuming and must therefore be done selectively. Active learning (AL) provides a solution that can iteratively and intelligently label a dataset…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ozan Unal , Dengxin Dai , Ali Tamer Unal , Luc Van Gool

Most machine learning and data analytics applications, including performance engineering in software systems, require a large number of annotations and labelled data, which might not be available in advance. Acquiring annotations often…

Software Engineering · Computer Science 2023-09-21 Peter Samoaa , Linus Aronsson , Antonio Longa , Philipp Leitner , Morteza Haghir Chehreghani

3D object detection has recently received much attention due to its great potential in autonomous vehicle (AV). The success of deep learning based object detectors relies on the availability of large-scale annotated datasets, which is…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Jinpeng Lin , Zhihao Liang , Shengheng Deng , Lile Cai , Tao Jiang , Tianrui Li , Kui Jia , Xun Xu

The success of state-of-the-art deep neural networks heavily relies on the presence of large-scale labelled datasets, which are extremely expensive and time-consuming to annotate. This paper focuses on tackling semi-supervised part…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Yu Yang , Xiaotian Cheng , Hakan Bilen , Xiangyang Ji

This study centers on overcoming the challenge of selecting the best annotators for each query in Active Learning (AL), with the objective of minimizing misclassifications. AL recognizes the challenges related to cost and time when…

Machine Learning · Computer Science 2025-08-02 Diana Mortagua

Achieving a reliable LiDAR-based object detector in autonomous driving is paramount, but its success hinges on obtaining large amounts of precise 3D annotations. Active learning (AL) seeks to mitigate the annotation burden through…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Yadan Luo , Zhuoxiao Chen , Zhen Fang , Zheng Zhang , Zi Huang , Mahsa Baktashmotlagh

LiDAR provides highly accurate 3D point clouds. However, data needs to be manually labelled in order to provide subsequent useful information. Manual annotation of such data is time consuming, tedious and error prone, and hence in this…

Computer Vision and Pattern Recognition · Computer Science 2020-06-11 Ananya Gupta , Jonathan Byrne , David Moloney , Simon Watson , Hujun Yin

Image segmentation is one of the most essential biomedical image processing problems for different imaging modalities, including microscopy and X-ray in the Internet-of-Medical-Things (IoMT) domain. However, annotating biomedical images is…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Ziyuan Zhao , Zeng Zeng , Kaixin Xu , Cen Chen , Cuntai Guan

Semantic segmentation is crucial for various biomedical applications, yet its reliance on large annotated datasets presents a bottleneck due to the high cost and specialized expertise required for manual labeling. Active Learning (AL) aims…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Carsten T. Lüth , Jeremias Traub , Kim-Celine Kahl , Till J. Bungert , Lukas Klein , Lars Krämer , Paul F. Jaeger , Fabian Isensee , Klaus Maier-Hein

Using deep learning, we now have the ability to create exceptionally good semantic segmentation systems; however, collecting the prerequisite pixel-wise annotations for training images remains expensive and time-consuming. Therefore, it…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Aneesh Rangnekar , Christopher Kanan , Matthew Hoffman

We propose a new active learning (AL) framework, Active Learning++, which can utilize an annotator's labels as well as its rationale. Annotators can provide their rationale for choosing a label by ranking input features based on their…

Machine Learning · Computer Science 2020-09-11 Bhavya Ghai , Q. Vera Liao , Yunfeng Zhang , Klaus Mueller

Given an image, we would like to learn to detect objects belonging to particular object categories. Common object detection methods train on large annotated datasets which are annotated in terms of bounding boxes that contain the object of…

Computer Vision and Pattern Recognition · Computer Science 2016-11-30 Soumya Roy , Vinay P. Namboodiri , Arijit Biswas