English
Related papers

Related papers: Visual Transformer for Task-aware Active Learning

200 papers

Transformer models have become the dominant backbone for sequence modeling, leveraging self-attention to produce contextualized token representations. These are typically aggregated into fixed-size vectors via pooling operations for…

Machine Learning · Computer Science 2025-10-07 Sofiane Ennadir , Levente Zólyomi , Oleg Smirnov , Tianze Wang , John Pertoft , Filip Cornell , Lele Cao

Pool-based Active Learning (AL) has achieved great success in minimizing labeling cost by sequentially selecting informative unlabeled samples from a large unlabeled data pool and querying their labels from oracle/annotators. However,…

Machine Learning · Computer Science 2022-07-05 Xueying Zhan , Zeyu Dai , Qingzhong Wang , Qing Li , Haoyi Xiong , Dejing Dou , Antoni B. Chan

We study how to leverage off-the-shelf visual and linguistic data to cope with out-of-vocabulary answers in visual question answering task. Existing large-scale visual datasets with annotations such as image class labels, bounding boxes and…

Machine Learning · Computer Science 2019-04-09 Hyeonwoo Noh , Taehoon Kim , Jonghwan Mun , Bohyung Han

Effective training of advanced ML models requires large amounts of labeled data, which is often scarce in scientific problems given the substantial human labor and material cost to collect labeled data. This poses a challenge on determining…

Machine Learning · Computer Science 2020-12-09 Xiaowei Jia , Beiyu Lin , Jacob Zwart , Jeffrey Sadler , Alison Appling , Samantha Oliver , Jordan Read

Machine learning methods usually rely on large sample size to have good performance, while it is difficult to provide labeled set in many applications. Pool-based active learning methods are there to detect, among a set of unlabeled data,…

Machine Learning · Computer Science 2023-10-04 Lies Hadjadj , Emilie Devijver , Remi Molinier , Massih-Reza Amini

Multi-task learning is central to many real-world applications. Unfortunately, obtaining labelled data for all tasks is time-consuming, challenging, and expensive. Active Learning (AL) can be used to reduce this burden. Existing techniques…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Nikita Durasov , Nik Dorndorf , Pascal Fua

We study the problem of actively learning a classifier with a low calibration error. One of the most popular Acquisition Functions (AFs) in pool-based Active Learning (AL) is querying by the model's uncertainty. However, we recognize that…

Machine Learning · Computer Science 2025-10-06 Ha Manh Bui , Iliana Maifeld-Carucci , Anqi Liu

Active learning (AL) is a training paradigm for selecting unlabeled samples for annotation to improve model performance on a test set, which is useful when only a limited number of samples can be annotated. These algorithms often work by…

Computation and Language · Computer Science 2026-04-13 Lorenzo Jaime Yu Flores , Cesare Spinoso di-Piano , Ori Ernst , David Ifeoluwa Adelani , Jackie Chi Kit Cheung

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

One of the long-standing challenges in Artificial Intelligence for learning goal-directed behavior is to build a single agent which can solve multiple tasks. Recent progress in multi-task learning for goal-directed sequential problems has…

Neural and Evolutionary Computing · Computer Science 2017-05-23 Sahil Sharma , Ashutosh Jha , Parikshit Hegde , Balaraman Ravindran

Active learning (AL) is for optimizing the selection of unlabeled data for annotation (labeling), aiming to enhance model performance while minimizing labeling effort. The key question in AL is which unlabeled data should be selected for…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Yingrui Ji , Vijaya Sindhoori Kaza , Nishanth Artham , Tianyang Wang

The promise of active learning (AL) is to reduce labelling costs by selecting the most valuable examples to annotate from a pool of unlabelled data. Identifying these examples is especially challenging with high-dimensional data (e.g.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Amin Parvaneh , Ehsan Abbasnejad , Damien Teney , Reza Haffari , Anton van den Hengel , Javen Qinfeng Shi

Foundation vision or vision-language models are trained on large unlabeled or noisy data and learn robust representations that can achieve impressive zero- or few-shot performance on diverse tasks. Given these properties, they are a natural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Sanket Rajan Gupte , Josiah Aklilu , Jeffrey J. Nirschl , Serena Yeung-Levy

We consider the pool-based active learning problem, where only a subset of the training data is labeled, and the goal is to query a batch of unlabeled samples to be labeled so as to maximally improve model performance. We formulate the…

Machine Learning · Computer Science 2022-11-01 Juan Elenter , Navid NaderiAlizadeh , Alejandro Ribeiro

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating. Most existing works are based on shallow linear models by…

Machine Learning · Computer Science 2020-07-29 Changsheng Li , Handong Ma , Zhao Kang , Ye Yuan , Xiao-Yu Zhang , Guoren Wang

Pathology image classification plays a crucial role in accurate medical diagnosis and treatment planning. Training high-performance models for this task typically requires large-scale annotated datasets, which are both expensive and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Lanfeng Zhong , Xin Liao , Shichuan Zhang , Shaoting Zhang , Guotai Wang

Uncertainty estimation is at the core of Active Learning (AL). Most existing methods resort to complex auxiliary models and advanced training fashions to estimate uncertainty for unlabeled data. These models need special design and hence…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Tianyang Wang , Xi Xiao , Gaofei Chen , Xiaoying Liao , Guo Cheng , Yingrui Ji

Deep active learning has emerged as a powerful tool for training deep learning models within a predefined labeling budget. These models have achieved performances comparable to those trained in an offline setting. However, deep active…

Machine Learning · Computer Science 2023-09-21 Moseli Mots'oehli , Kyungim Baek

Active Learning (AL) is a user-interactive approach aimed at reducing annotation costs by selecting the most crucial examples to label. Although AL has been extensively studied for image classification tasks, the specific scenario of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Leah Bar , Boaz Lerner , Nir Darshan , Rami Ben-Ari

Despite recent progress in artificial intelligence and machine learning, many state-of-the-art methods suffer from a lack of explainability and transparency. The ability to interpret the predictions made by machine learning models and…

Machine Learning · Computer Science 2021-11-10 Zihan Wang , Jialin Lu , Oliver Snow , Martin Ester