English
Related papers

Related papers: Active Labeling: Streaming Stochastic Gradients

200 papers

Active learning generally involves querying the most representative samples for human labeling, which has been widely studied in many fields such as image classification and object detection. However, its potential has not been explored in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jun Wang , Shaoguo Wen , Kaixing Chen , Jianghua Yu , Xin Zhou , Peng Gao , Changsheng Li , Guotong Xie

Active learning aims to reduce the high labeling cost involved in training machine learning models on large datasets by efficiently labeling only the most informative samples. Recently, deep active learning has shown success on various…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Sudhanshu Mittal , Maxim Tatarchenko , Özgün Çiçek , Thomas Brox

Risk-based active learning is an approach to developing statistical classifiers for online decision-support. In this approach, data-label querying is guided according to the expected value of perfect information for incipient data points.…

Machine Learning · Computer Science 2022-06-28 Aidan J. Hughes , Lawrence A. Bull , Paul Gardner , Nikolaos Dervilis , Keith Worden

Active learning is a type of sequential design for supervised machine learning, in which the learning algorithm sequentially requests the labels of selected instances from a large pool of unlabeled data points. The objective is to produce a…

Statistics Theory · Mathematics 2019-11-14 Steve Hanneke , Liu Yang

Labeled data are critical to modern machine learning applications, but obtaining labels can be expensive. To mitigate this cost, machine learning methods, such as transfer learning, semi-supervised learning and active learning, aim to be…

Stochastic gradient algorithm is a key ingredient of many machine learning methods, particularly appropriate for large-scale learning.However, a major caveat of large data is their incompleteness.We propose an averaged stochastic gradient…

Statistics Theory · Mathematics 2020-06-09 Julie Josse , Aude Sportisse , Claire Boyer , Aymeric Dieuleveut

Improving performance in multiple domains is a challenging task, and often requires significant amounts of data to train and test models. Active learning techniques provide a promising solution by enabling models to select the most…

Machine Learning · Computer Science 2023-04-14 Anand Gokul Mahalingam , Aayush Shah , Akshay Gulati , Royston Mascarenhas , Rakshitha Panduranga

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Minghan Li , Xialei Liu , Joost van de Weijer , Bogdan Raducanu

Active learning allows machine learning models to be trained using fewer labels while retaining similar performance to traditional supervised learning. An active learner selects the most informative data points, requests their labels, and…

Machine Learning · Computer Science 2023-11-22 Zac Pullar-Strecker , Katharina Dost , Eibe Frank , Jörg Wicker

With the vigorous development of artificial intelligence technology, various engineering technology applications have been implemented one after another. The gradient descent method plays an important role in solving various optimization…

Machine Learning · Computer Science 2021-04-27 Jinhuan Duan , Xianxian Li , Shiqi Gao , Jinyan Wang , Zili Zhong

It has been found that stochastic algorithms often find good solutions much more rapidly than inherently-batch approaches. Indeed, a very useful rule of thumb is that often, when solving a machine learning problem, an iterative technique…

Machine Learning · Computer Science 2013-08-19 Andrew Cotter

Given $k$ pre-trained classifiers and a stream of unlabeled data examples, how can we actively decide when to query a label so that we can distinguish the best model from the rest while making a small number of queries? Answering this…

Machine Learning · Computer Science 2021-04-20 Mohammad Reza Karimi , Nezihe Merve Gürel , Bojan Karlaš , Johannes Rausch , Ce Zhang , Andreas Krause

Active Feature Acquisition is an instance-wise, sequential decision making problem. The aim is to dynamically select which feature to measure based on current observations, independently for each test instance. Common approaches either use…

Machine Learning · Computer Science 2025-08-07 Alexander Norcliffe , Changhee Lee , Fergus Imrie , Mihaela van der Schaar , Pietro Lio

Data-driven soft sensors are extensively used in industrial and chemical processes to predict hard-to-measure process variables whose real value is difficult to track during routine operations. The regression models used by these sensors…

Machine Learning · Computer Science 2023-04-11 Davide Cacciarelli , Murat Kulahci , John Tyssedal

An active learner is given a class of models, a large set of unlabeled examples, and the ability to interactively query labels of a subset of these examples; the goal of the learner is to learn a model in the class that fits the data well.…

Machine Learning · Computer Science 2015-06-09 Kamalika Chaudhuri , Sham Kakade , Praneeth Netrapalli , Sujay Sanghavi

We consider the problem of offline, pool-based active semi-supervised learning on graphs. This problem is important when the labeled data is scarce and expensive whereas unlabeled data is easily available. The data points are represented by…

Machine Learning · Computer Science 2014-05-20 Akshay Gadde , Aamir Anis , Antonio Ortega

In this work we discuss the problem of active learning. We present an approach that is based on A-optimal experimental design of ill-posed problems and show how one can optimally label a data set by partially probing it, and use it to train…

Machine Learning · Computer Science 2022-11-28 Tue Boesen , Eldad Haber

Neural network based generative models with discriminative components are a powerful approach for semi-supervised learning. However, these techniques a) cannot account for model uncertainty in the estimation of the model's discriminative…

Machine Learning · Statistics 2017-06-30 Jonathan Gordon , José Miguel Hernández-Lobato

In many industrial applications, obtaining labeled observations is not straightforward as it often requires the intervention of human experts or the use of expensive testing equipment. In these circumstances, active learning can be highly…

Machine Learning · Statistics 2023-07-19 Davide Cacciarelli , Murat Kulahci , John Sølve Tyssedal

The cost of drawing object bounding boxes (i.e. labeling) for millions of images is prohibitively high. For instance, labeling pedestrians in a regular urban image could take 35 seconds on average. Active learning aims to reduce the cost of…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Hamed H. Aghdam , Abel Gonzalez-Garcia , Joost van de Weijer , Antonio M. López