English
Related papers

Related papers: Improve Cost Efficiency of Active Learning over No…

200 papers

Recent advances in one-shot learning have produced models that can learn from a handful of labeled examples, for passive classification and regression tasks. This paper combines reinforcement learning with one-shot learning, allowing the…

Machine Learning · Computer Science 2017-02-23 Mark Woodward , Chelsea Finn

Active learning, which effectively collects informative unlabeled data for annotation, reduces the demand for labeled data. In this work, we propose to retrieve unlabeled samples with a local sensitivity and hardness-aware acquisition…

Computation and Language · Computer Science 2022-09-27 Shujian Zhang , Chengyue Gong , Xingchao Liu , Pengcheng He , Weizhu Chen , Mingyuan Zhou

Neural coreference resolution models trained on one dataset may not transfer to new, low-resource domains. Active learning mitigates this problem by sampling a small subset of data for annotators to label. While active learning is…

Computation and Language · Computer Science 2022-03-30 Michelle Yuan , Patrick Xia , Chandler May , Benjamin Van Durme , Jordan Boyd-Graber

The performance of a machine learning system is usually evaluated by using i.i.d.\ observations with true labels. However, acquiring ground truth labels is expensive, while obtaining unlabeled samples may be cheaper. Stratified sampling can…

Machine Learning · Computer Science 2019-07-29 Tiancheng Yu , Xiyu Zhai , Suvrit Sra

Adaptive sampling theory has shown that, with proper assumptions on the signal class, algorithms exist to reconstruct a signal in $\mathbb{R}^{d}$ with an optimal number of samples. We generalize this problem to the case of spatial signals,…

Machine Learning · Statistics 2017-02-20 John Lipor , Brandon Wong , Donald Scavia , Branko Kerkez , Laura Balzano

The objective of Active Learning is to strategically label a subset of the dataset to maximize performance within a predetermined labeling budget. In this study, we harness features acquired through self-supervised learning. We introduce a…

Machine Learning · Computer Science 2023-12-27 Jingyao Li , Pengguang Chen , Shaozuo Yu , Shu Liu , Jiaya Jia

Active Learning (AL) is a powerful tool for learning with less labeled data, in particular, for specialized domains, like legal documents, where unlabeled data is abundant, but the annotation requires domain expertise and is thus expensive.…

Computation and Language · Computer Science 2022-11-16 Sepideh Mamooler , Rémi Lebret , Stéphane Massonnet , Karl Aberer

In critical machine learning applications, ensuring fairness is essential to avoid perpetuating social inequities. In this work, we address the challenges of reducing bias and improving accuracy in data-scarce environments, where the cost…

Machine Learning · Computer Science 2023-12-15 Romain Camilleri , Andrew Wagenmaker , Jamie Morgenstern , Lalit Jain , Kevin Jamieson

Despite deep learning has achieved great success, it often relies on a large amount of training data with accurate labels, which are expensive and time-consuming to collect. A prominent direction to reduce the cost is to learn with noisy…

Machine Learning · Computer Science 2024-01-31 Chuanyang Hu , Shipeng Yan , Zhitong Gao , Xuming He

At its core, this thesis aims to enhance the practicality of deep learning by improving the label and training efficiency of deep learning models. To this end, we investigate data subset selection techniques, specifically active learning…

Machine Learning · Computer Science 2024-03-11 Andreas Kirsch

In active learning, the user sequentially chooses values for feature $X$ and an oracle returns the corresponding label $Y$. In this paper, we consider the effect of feature noise in active learning, which could arise either because $X$…

Machine Learning · Statistics 2015-05-19 Aaditya Ramdas , Barnabas Poczos , Aarti Singh , Larry Wasserman

In critical applications of anomaly detection including computer security and fraud prevention, the anomaly detector must be configurable by the analyst to minimize the effort on false positives. One important way to configure the anomaly…

Machine Learning · Computer Science 2018-09-19 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

Computation and Language · Computer Science 2020-11-30 Yekyung Kim

We propose a general purpose active learning algorithm for structured prediction, gathering labeled data for training a model that outputs a set of related labels for an image or video. Active learning starts with a limited initial training…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Mehran Khodabandeh , Zhiwei Deng , Mostafa S. Ibrahim , Shinichi Satoh , Greg Mori

Machine learning has emerged as a promising paradigm for enabling connected, automated vehicles to autonomously cruise the streets and react to unexpected situations. A key challenge, however, is to collect and select real-time and reliable…

Networking and Internet Architecture · Computer Science 2020-02-19 Alaa Awad Abdellatif , Carla Fabiana Chiasserini , Francesco Malandrino

Active learning is a type of sequential design for supervised machine learning, in which the learning algorithm sequentially requests the labels of selected instances from a large pool of unlabeled data points. The objective is to produce a…

Statistics Theory · Mathematics 2019-11-14 Steve Hanneke , Liu Yang

An active learner is given a class of models, a large set of unlabeled examples, and the ability to interactively query labels of a subset of these examples; the goal of the learner is to learn a model in the class that fits the data well.…

Machine Learning · Computer Science 2015-06-09 Kamalika Chaudhuri , Sham Kakade , Praneeth Netrapalli , Sujay Sanghavi

Active learning (AL) is a training paradigm for selecting unlabeled samples for annotation to improve model performance on a test set, which is useful when only a limited number of samples can be annotated. These algorithms often work by…

Computation and Language · Computer Science 2026-04-13 Lorenzo Jaime Yu Flores , Cesare Spinoso di-Piano , Ori Ernst , David Ifeoluwa Adelani , Jackie Chi Kit Cheung

Manual labelling of training examples is common practice in supervised learning. When the labelling task is of non-trivial difficulty, the supplied labels may not be equal to the ground-truth labels, and label noise is introduced into the…

Machine Learning · Statistics 2021-04-08 Daniel Ahfock , Geoffrey J. McLachlan

Active learning is relevant and challenging for high-dimensional regression models when the annotation of the samples is expensive. Yet most of the existing sampling methods cannot be applied to large-scale problems, consuming too much time…

Machine Learning · Computer Science 2020-01-24 Evgenii Tsymbalov , Maxim Panov , Alexander Shapeev