English
Related papers

Related papers: Nuclear Discrepancy for Active Learning

200 papers

Active learning aims to develop label-efficient algorithms by querying the most representative samples to be labeled by a human annotator. Current active learning techniques either rely on model uncertainty to select the most uncertain…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Sayna Ebrahimi , William Gan , Dian Chen , Giscard Biamby , Kamyar Salahi , Michael Laielli , Shizhan Zhu , Trevor Darrell

In many applications, data is easy to acquire but expensive and time-consuming to label prominent examples include medical imaging and NLP. This disparity has only grown in recent years as our ability to collect data improves. Under these…

Machine Learning · Computer Science 2021-04-07 Jaya Krishna Mandivarapu , Blake Camp , Rolando Estrada

Multi-label learning draws great interests in many real world applications. It is a highly costly task to assign many labels by the oracle for one instance. Meanwhile, it is also hard to build a good model without diagnosing discriminative…

Machine Learning · Computer Science 2019-04-16 Bo Du , Zengmao Wang , Lefei Zhang , Liangpei Zhang , Dacheng Tao

Active learning aims to train a classifier as fast as possible with as few labels as possible. The core element in virtually any active learning strategy is the criterion that measures the usefulness of the unlabeled data based on which new…

Machine Learning · Statistics 2018-02-13 Yazhou Yang , Marco Loog

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

Computation and Language · Computer Science 2020-11-30 Yekyung Kim

Active Learning is concerned with the question of how to identify the most useful samples for a Machine Learning algorithm to be trained with. When applied correctly, it can be a very powerful tool to counteract the immense data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Lukas Hahn , Lutz Roese-Koerner , Peet Cremer , Urs Zimmermann , Ori Maoz , Anton Kummert

The disagreement coefficient of Hanneke has become a central data independent invariant in proving active learning rates. It has been shown in various ways that a concept class with low complexity together with a bound on the disagreement…

Machine Learning · Computer Science 2012-06-21 Nir Ailon , Ron Begleiter , Esther Ezra

Active learning is a branch of machine learning that deals with problems where unlabeled data is abundant yet obtaining labels is expensive. The learning algorithm has the possibility of querying a limited number of samples to obtain the…

Disordered Systems and Neural Networks · Physics 2020-09-04 Hugo Cui , Luca Saglietti , Lenka Zdeborová

Active learning strives to reduce annotation costs by choosing the most critical examples to label. Typically, the active learning strategy is contingent on the classification model. For instance, uncertainty sampling depends on poorly…

Computation and Language · Computer Science 2020-10-26 Michelle Yuan , Hsuan-Tien Lin , Jordan Boyd-Graber

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts…

Machine Learning · Computer Science 2020-06-02 Max Hopkins , Daniel M. Kane , Shachar Lovett

Active learning is typically used to label data, when the labeling process is expensive. Several active learning algorithms have been theoretically proved to perform better than their passive counterpart. However, these algorithms rely on…

Machine Learning · Computer Science 2021-02-23 Boris Ndjia Njike , Xavier Siebert

Active learning (AL) is a machine learning algorithm that can achieve greater accuracy with fewer labeled training instances, for having the ability to ask oracles to label the most valuable unlabeled data chosen iteratively and…

Machine Learning · Computer Science 2022-09-30 Ruoyu Wang

Active learning is the iterative construction of a classification model through targeted labeling, enabling significant labeling cost savings. As most research on active learning has been carried out before transformer-based language models…

Computation and Language · Computer Science 2022-03-22 Christopher Schröder , Andreas Niekler , Martin Potthast

We investigate active learning in the context of deep neural network models for change detection and map updating. Active learning is a natural choice for a number of remote sensing tasks, including the detection of local surface changes:…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Vít Růžička , Stefano D'Aronco , Jan Dirk Wegner , Konrad Schindler

With the explosion of massive, widely available unlabeled data in the past years, finding label and time efficient, robust learning algorithms has become ever more important in theory and in practice. We study the paradigm of active…

Machine Learning · Computer Science 2020-01-17 Max Hopkins , Daniel Kane , Shachar Lovett , Gaurav Mahajan

We propose a new method for approximating active learning acquisition strategies that are based on retraining with hypothetically-labeled candidate data points. Although this is usually infeasible with deep networks, we use the neural…

Machine Learning · Statistics 2022-07-05 Mohamad Amin Mohamadi , Wonho Bae , Danica J. Sutherland

Active learning is a machine learning method aiming at optimal design for model training. At variance with supervised learning, which labels all samples, active learning provides an improved model by labeling samples with maximal…

Supervised machine learning relies on the availability of good labelled data for model training. Labelled data is acquired by human annotation, which is a cumbersome and costly process, often requiring subject matter experts. Active…

Machine Learning · Computer Science 2023-10-31 Sharath M Shankaranarayana

The remarkable performance of deep neural networks depends on the availability of massive labeled data. To alleviate the load of data annotation, active deep learning aims to select a minimal set of training points to be labelled which…

Machine Learning · Computer Science 2020-03-24 Dan Kushnir , Luca Venturi

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury