English
Related papers

Related papers: Annotator-Centric Active Learning for Subjective N…

200 papers

Labeling data can be an expensive task as it is usually performed manually by domain experts. This is cumbersome for deep learning, as it is dependent on large labeled datasets. Active learning (AL) is a paradigm that aims to reduce…

Computation and Language · Computer Science 2021-11-05 Pieter Floris Jacobs , Gideon Maillette de Buy Wenniger , Marco Wiering , Lambert Schomaker

This paper is on active learning where the goal is to reduce the data annotation burden by interacting with a (human) oracle during training. Standard active learning methods ask the oracle to annotate data samples. Instead, we take a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Miriam W. Huijser , Jan C. van Gemert

Despite the vast body of literature on Active Learning (AL), there is no comprehensive and open benchmark allowing for efficient and simple comparison of proposed samplers. Additionally, the variability in experimental settings across the…

Machine Learning · Computer Science 2023-04-12 W. Jonas , A. Abraham , L. Dreyfus-Schmidt

Active Learning (AL) methods seek to improve classifier performance when labels are expensive or scarce. We consider two central questions: Where does AL work? How much does it help? To address these questions, a comprehensive experimental…

Machine Learning · Statistics 2014-08-07 Lewis Evans , Niall M. Adams , Christoforos Anagnostopoulos

In this paper, we introduce the FOCAL (Ford-OLIVES Collaboration on Active Learning) dataset which enables the study of the impact of annotation-cost within a video active learning setting. Annotation-cost refers to the time it takes an…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Kiran Kokilepersaud , Yash-Yee Logan , Ryan Benkert , Chen Zhou , Mohit Prabhushankar , Ghassan AlRegib , Enrique Corona , Kunjan Singh , Mostafa Parchami

The expensive annotation cost is notoriously known as the main constraint for the development of the point cloud semantic segmentation technique. Active learning methods endeavor to reduce such cost by selecting and labeling only a subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Feifei Shao , Yawei Luo , Ping Liu , Jie Chen , Yi Yang , Yulei Lu , Jun Xiao

One of the goals of natural language understanding is to develop models that map sentences into meaning representations. However, training such models requires expensive annotation of complex structures, which hinders their adoption.…

Computation and Language · Computer Science 2019-10-08 Omri Koshorek , Gabriel Stanovsky , Yichu Zhou , Vivek Srikumar , Jonathan Berant

Active learning (AL) aims to enable training high performance classifiers with low annotation cost by predicting which subset of unlabelled instances would be most beneficial to label. The importance of AL has motivated extensive research,…

Machine Learning · Computer Science 2018-06-14 Kunkun Pang , Mingzhi Dong , Yang Wu , Timothy Hospedales

Many contemporary data-driven research efforts in the natural sciences, such as chemistry and materials science, require large-scale, high-performance entity recognition from scientific datasets. Large language models (LLMs) have…

Computation and Language · Computer Science 2025-09-10 Zihan Chen , Lei Shi , Weize Wu , Qiji Zhou , Yue Zhang

Active Learning (AL) is a human-in-the-loop framework to interactively and adaptively label data instances, thereby enabling significant gains in model performance compared to random sampling. AL approaches function by selecting the hardest…

Machine Learning · Computer Science 2023-06-05 Nathan Beck , Krishnateja Killamsetty , Suraj Kothawade , Rishabh Iyer

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

Central to active learning (AL) is what data should be selected for annotation. Existing works attempt to select highly uncertain or informative data for annotation. Nevertheless, it remains unclear how selected data impacts the test…

Machine Learning · Computer Science 2022-01-25 Tianyang Wang , Xingjian Li , Pengkun Yang , Guosheng Hu , Xiangrui Zeng , Siyu Huang , Cheng-Zhong Xu , Min Xu

We introduce Information Condensing Active Learning (ICAL), a batch mode model agnostic Active Learning (AL) method targeted at Deep Bayesian Active Learning that focuses on acquiring labels for points which have as much information as…

Machine Learning · Computer Science 2020-02-21 Siddhartha Jain , Ge Liu , David Gifford

Semantic segmentation is a complex task that relies heavily on large amounts of annotated image data. However, annotating such data can be time-consuming and resource-intensive, especially in the medical domain. Active Learning (AL) is a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fei Wu , Pablo Marquez-Neila , Mingyi Zheng , Hedyeh Rafii-Tari , Raphael Sznitman

Deep learning methods typically depend on the availability of labeled data, which is expensive and time-consuming to obtain. Active learning addresses such effort by prioritizing which samples are best to annotate in order to maximize the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Standard myopic active learning assumes that human annotations are always obtainable whenever new samples are selected. This, however, is unrealistic in many real-world applications where human experts are not readily available at all…

Machine Learning · Statistics 2018-05-18 Yazhou Yang , Marco Loog

Active learning, a powerful paradigm in machine learning, aims at reducing labeling costs by selecting the most informative samples from an unlabeled dataset. However, the traditional active learning process often demands extensive…

Machine Learning · Computer Science 2024-01-17 Gábor Németh , Tamás Matuszka

Data collection and annotation is a laborious, time-consuming prerequisite for supervised machine learning tasks. Online Active Learning (OAL) is a paradigm that addresses this issue by simultaneously minimizing the amount of annotation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Mark Lindsey , Ankit Shah , Francis Kubala , Richard M. Stern

Active learning (AL) can reduce annotation costs in surgical video analysis while maintaining model performance. However, traditional AL methods, developed for images or short video clips, are suboptimal for surgical step recognition due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-30 Nisarg A. Shah , Bardia Safaei , Shameema Sikder , S. Swaroop Vedula , Vishal M. Patel

While many active learning papers assume that the learner can simply ask for a label and receive it, real annotation often presents a mismatch between the form of a label (say, one among many classes), and the form of an annotation…

Machine Learning · Computer Science 2019-07-10 Peiyun Hu , Zachary C. Lipton , Anima Anandkumar , Deva Ramanan
‹ Prev 1 3 4 5 6 7 10 Next ›