English
Related papers

Related papers: Learning User's confidence for active learning

200 papers

Gathering training data is a key step of any supervised learning task, and it is both critical and expensive. Critical, because the quantity and quality of the training data has a high impact on the performance of the learned function.…

Data Structures and Algorithms · Computer Science 2021-10-28 Quentin Lutz , Élie de Panafieu , Alex Scott , Maya Stein

Inspired by the concept of active learning, we propose active inference$\unicode{x2013}$a methodology for statistical inference with machine-learning-assisted data collection. Assuming a budget on the number of labels that can be collected,…

Machine Learning · Statistics 2026-04-09 Tijana Zrnic , Emmanuel J. Candès

Active learning aims to select samples to be annotated that yield the largest performance improvement for the learning algorithm. Many methods approach this problem by measuring the informativeness of samples and do this based on the…

Machine Learning · Computer Science 2021-08-02 Javad Zolfaghari Bengar , Bogdan Raducanu , Joost van de Weijer

Active learning typically focuses on training a model on few labeled examples alone, while unlabeled ones are only used for acquisition. In this work we depart from this setting by using both labeled and unlabeled data during model training…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Oriane Siméoni , Mateusz Budnik , Yannis Avrithis , Guillaume Gravier

Labeling data can be an expensive task as it is usually performed manually by domain experts. This is cumbersome for deep learning, as it is dependent on large labeled datasets. Active learning (AL) is a paradigm that aims to reduce…

Computation and Language · Computer Science 2021-11-05 Pieter Floris Jacobs , Gideon Maillette de Buy Wenniger , Marco Wiering , Lambert Schomaker

Active learning aims to reduce labeling costs by selecting only the most informative samples on a dataset. Few existing works have addressed active learning for object detection. Most of these methods are based on multiple models or are…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jiwoong Choi , Ismail Elezi , Hyuk-Jae Lee , Clement Farabet , Jose M. Alvarez

We explore an active learning approach for dynamic fair resource allocation problems. Unlike previous work that assumes full feedback from all agents on their allocations, we consider feedback from a select subset of agents at each epoch of…

Machine Learning · Computer Science 2024-06-24 Riddhiman Bhattacharya , Thanh Nguyen , Will Wei Sun , Mohit Tawarmalani

Much recent work on visual recognition aims to scale up learning to massive, noisily-annotated datasets. We address the problem of scaling- up the evaluation of such models to large-scale datasets with noisy labels. Current protocols for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Phuc Nguyen , Deva Ramanan , Charless Fowlkes

We consider active learning under incentive compatibility constraints. The main application of our results is to economic experiments, in which a learner seeks to infer the parameters of a subject's preferences: for example their attitudes…

Computer Science and Game Theory · Computer Science 2019-11-15 Federico Echenique , Siddharth Prasad

Obtaining labels can be costly and time-consuming. Active learning allows a learning algorithm to intelligently query samples to be labeled for efficient learning. Fisher information ratio (FIR) has been used as an objective for selecting…

Machine Learning · Statistics 2016-10-18 Jamshid Sourati , Murat Akcakaya , Todd K. Leen , Deniz Erdogmus , Jennifer G. Dy

Classical learning assumes the learner is given a labeled data sample, from which it learns a model. The field of Active Learning deals with the situation where the learner begins not with a training sample, but instead with resources that…

Machine Learning · Computer Science 2012-07-19 Omid Madani , Daniel J. Lizotte , Russell Greiner

Object detection requires substantial labeling effort for learning robust models. Active learning can reduce this effort by intelligently selecting relevant examples to be annotated. However, selecting these examples properly without…

Machine Learning · Computer Science 2022-12-09 Dominik Probst , Hasnain Raza , Erik Rodner

Active learning aims to reduce the high labeling cost involved in training machine learning models on large datasets by efficiently labeling only the most informative samples. Recently, deep active learning has shown success on various…

Computer Vision and Pattern Recognition · Computer Science 2019-12-12 Sudhanshu Mittal , Maxim Tatarchenko , Özgün Çiçek , Thomas Brox

Supervised machine learning based state-of-the-art computer vision techniques are in general data hungry and pose the challenges of not having adequate computing resources and of high costs involved in human labeling efforts. Training data…

Computer Vision and Pattern Recognition · Computer Science 2018-05-30 Vishal Kaushal , Anurag Sahoo , Khoshrav Doctor , Narasimha Raju , Suyash Shetty , Pankaj Singh , Rishabh Iyer , Ganesh Ramakrishnan

Training high-quality instance segmentation models requires an abundance of labeled images with instance masks and classifications, which is often expensive to procure. Active learning addresses this challenge by striving for optimum…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ke Yu , Stephen Albro , Giulia DeSalvo , Suraj Kothawade , Abdullah Rashwan , Sasan Tavakkol , Kayhan Batmanghelich , Xiaoqi Yin

This paper advances the theoretical understanding of active learning label complexity for decision trees as binary classifiers. We make two main contributions. First, we provide the first analysis of the disagreement coefficient for…

Active Learning (AL) techniques have proven to be highly effective in reducing data labeling costs across a range of machine learning tasks. Nevertheless, one known challenge of these methods is their potential to introduce unfairness…

Machine Learning · Computer Science 2023-12-20 Ricky Fajri , Akrati Saxena , Yulong Pei , Mykola Pechenizkiy

Active Learning is concerned with the question of how to identify the most useful samples for a Machine Learning algorithm to be trained with. When applied correctly, it can be a very powerful tool to counteract the immense data…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Lukas Hahn , Lutz Roese-Koerner , Peet Cremer , Urs Zimmermann , Ori Maoz , Anton Kummert

Deep neural networks have great representation power, but typically require large numbers of training examples. This motivates deep active learning methods that can significantly reduce the amount of labeled training data. Empirical…

Machine Learning · Computer Science 2026-01-01 Yinglun Zhu , Robert Nowak

Deep learning is currently reaching outstanding performances on different tasks, including image classification, especially when using large neural networks. The success of these models is tributary to the availability of large collections…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mingyuan Jiu , Xuguang Song , Hichem Sahbi , Shupan Li , Yan Chen , Wei Guo , Lihua Guo , Mingliang Xu