English
Related papers

Related papers: PromptAL: Sample-Aware Dynamic Soft Prompts for Fe…

200 papers

Neural Network-based active learning (NAL) is a cost-effective data selection technique that utilizes neural networks to select and train on a small subset of samples. While existing work successfully develops various effective or…

Machine Learning · Computer Science 2024-06-07 Dake Bu , Wei Huang , Taiji Suzuki , Ji Cheng , Qingfu Zhang , Zhiqiang Xu , Hau-San Wong

Process Reward Models (PRMs) provide step-level supervision to large language models (LLMs), but scaling up training data annotation remains challenging for both humans and LLMs. To address this limitation, we propose an active learning…

Machine Learning · Computer Science 2025-04-16 Keyu Duan , Zichen Liu , Xin Mao , Tianyu Pang , Changyu Chen , Qiguang Chen , Michael Qizhe Shieh , Longxu Dou

Active learning (AL) aims at reducing labeling effort by identifying the most valuable unlabeled data points from a large pool. Traditional AL frameworks have two limitations: First, they perform data selection in a multi-round manner,…

Machine Learning · Computer Science 2021-08-09 Si Chen , Tianhao Wang , Ruoxi Jia

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

Most existing works in few-shot learning rely on meta-learning the network on a large base dataset which is typically from the same domain as the target dataset. We tackle the problem of cross-domain few-shot learning where there is a large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Ashraful Islam , Chun-Fu Chen , Rameswar Panda , Leonid Karlinsky , Rogerio Feris , Richard J. Radke

Active learning (AL) attempts to maximize the performance gain of the model by marking the fewest samples. Deep learning (DL) is greedy for data and requires a large amount of data supply to optimize massive parameters, so that the model…

Machine Learning · Computer Science 2021-12-07 Pengzhen Ren , Yun Xiao , Xiaojun Chang , Po-Yao Huang , Zhihui Li , Brij B. Gupta , Xiaojiang Chen , Xin Wang

We develop the first active learning method for contextual linear optimization. Specifically, we introduce a label acquisition algorithm that sequentially decides whether to request the ``labels'' of feature samples from an unlabeled data…

Machine Learning · Computer Science 2025-01-31 Mo Liu , Paul Grigas , Heyuan Liu , Zuo-Jun Max Shen

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

Exfiltration of data via email is a serious cybersecurity threat for many organizations. Detecting data exfiltration (anomaly) patterns typically requires labeling, most often done by a human annotator, to reduce the high number of false…

Machine Learning · Computer Science 2023-07-19 Jaturong Kongmanee , Mark Chignell , Khilan Jerath , Abhay Raman

Accurate segmentation of tissue in histopathological images can be very beneficial for defining regions of interest (ROI) for streamline of diagnostic and prognostic tasks. Still, adapting to different domains is essential for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Saul Fuster , Farbod Khoraminia , Trygve Eftestøl , Tahlita C. M. Zuiverloon , Kjersti Engan

Active learning focuses on choosing a subset of unlabeled data to be labeled. However, most such methods assume that a large subset of the data can be annotated. We are interested in low-budget active learning where only a small subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Kossar Pourahmadi , Parsa Nooralinejad , Hamed Pirsiavash

Active learning, which effectively collects informative unlabeled data for annotation, reduces the demand for labeled data. In this work, we propose to retrieve unlabeled samples with a local sensitivity and hardness-aware acquisition…

Computation and Language · Computer Science 2022-09-27 Shujian Zhang , Chengyue Gong , Xingchao Liu , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bardia Safaei , Vishal M. Patel

Active learning aims to train a classifier as fast as possible with as few labels as possible. The core element in virtually any active learning strategy is the criterion that measures the usefulness of the unlabeled data based on which new…

Machine Learning · Statistics 2018-02-13 Yazhou Yang , Marco Loog

Message passing is the core of most graph models such as Graph Convolutional Network (GCN) and Label Propagation (LP), which usually require a large number of clean labeled data to smooth out the neighborhood over the graph. However, the…

Machine Learning · Computer Science 2021-10-29 Wentao Zhang , Yexin Wang , Zhenbang You , Meng Cao , Ping Huang , Jiulong Shan , Zhi Yang , Bin Cui

Active learning (AL) is a subfield of machine learning (ML) in which a learning algorithm could achieve good accuracy with less training samples by interactively querying a user/oracle to label new data points. Pool-based AL is…

Machine Learning · Computer Science 2020-10-19 Xueying Zhan , Antoni Bert Chan

While deep learning succeeds in a wide range of tasks, it highly depends on the massive collection of annotated data which is expensive and time-consuming. To lower the cost of data annotation, active learning has been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Siyu Huang , Tianyang Wang , Haoyi Xiong , Jun Huan , Dejing Dou

Optimal design for model training is a critical topic in machine learning. Active Learning aims at obtaining improved models by querying samples with maximum uncertainty according to the estimation model for artificially labeling; this has…

Weakly supervised learning aims to reduce the cost of labeling data by using expert-designed labeling rules. However, existing methods require experts to design effective rules in a single shot, which is difficult in the absence of proper…

Computation and Language · Computer Science 2024-09-10 Giannis Karamanolakis , Daniel Hsu , Luis Gravano

Training multimodal networks requires a vast amount of data due to their larger parameter space compared to unimodal networks. Active learning is a widely used technique for reducing data annotation costs by selecting only those samples…

Multimedia · Computer Science 2023-08-22 Meng Shen , Yizheng Huang , Jianxiong Yin , Heqing Zou , Deepu Rajan , Simon See