English
Related papers

Related papers: Stochastic Batch Acquisition: A Simple Baseline fo…

200 papers

Most prior work on active learning of classifiers has focused on sequentially selecting one unlabeled example at a time to be labeled in order to reduce the overall labeling effort. In many scenarios, however, it is desirable to label an…

Machine Learning · Computer Science 2012-07-03 Javad Azimi , Alan Fern , Xiaoli Zhang-Fern , Glencora Borradaile , Brent Heeringa

Optimizing deep learning models requires large amounts of annotated images, a process that is both time-intensive and costly. Especially for semantic segmentation models in which every pixel must be annotated. A potential strategy to…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Bart M. van Marrewijk , Charbel Dandjinou , Dan Jeric Arcega Rustia , Nicolas Franco Gonzalez , Boubacar Diallo , Jérôme Dias , Paul Melki , Pieter M. Blok

Attention modules, as simple and effective tools, have not only enabled deep neural networks to achieve state-of-the-art results in many domains, but also enhanced their interpretability. Most current models use deterministic attention…

Machine Learning · Statistics 2020-10-22 Xinjie Fan , Shujian Zhang , Bo Chen , Mingyuan Zhou

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Minghan Li , Xialei Liu , Joost van de Weijer , Bogdan Raducanu

Active learning improves the performance of machine learning methods by judiciously selecting a limited number of unlabeled data points to query for labels, with the aim of maximally improving the underlying classifier's performance. Recent…

Machine Learning · Computer Science 2023-07-21 James Chapman , Bohan Chen , Zheng Tan , Jeff Calder , Kevin Miller , Andrea L. Bertozzi

Active learning is a powerful approach to analyzing data effectively. We show that the feasibility of active learning depends crucially on the choice of measure with respect to which the query is being optimized. The standard information…

Machine Learning · Computer Science 2013-01-07 Harald Steck , Tommi S. Jaakkola

We propose a reinforcement learning based approach to tackle the cost-sensitive learning problem where each input feature has a specific cost. The acquisition process is handled through a stochastic policy which allows features to be…

Machine Learning · Computer Science 2016-07-14 Gabriella Contardo , Ludovic Denoyer , Thierry Artières

The Deep Learning revolution has enabled groundbreaking achievements in recent years. From breast cancer detection to protein folding, deep learning algorithms have been at the core of very important advancements. However, these modern…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Bonaventure F. P. Dossou

A key goal in stochastic contextual linear bandits is to efficiently learn a near-optimal policy. Prior algorithms for this problem learn a policy by strategically sampling actions but naively (passively) sampling contexts from the…

Machine Learning · Computer Science 2026-05-26 Emma Brunskill , Ishani Karmarkar , Zhaoqi Li

Over the past couple of decades, many active learning acquisition functions have been proposed, leaving practitioners with an unclear choice of which to use. Bayesian-based active learning offers principled objectives with explainable…

Machine Learning · Computer Science 2026-05-12 Kangping Hu , Stephen Mussmann

Recent years have witnessed amazing outcomes from "Big Models" trained by "Big Data". Most popular algorithms for model training are iterative. Due to the surging volumes of data, we can usually afford to process only a fraction of the…

Databases · Computer Science 2015-12-15 Jinyang Gao , H. V. Jagadish , Beng Chin Ooi

Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions. When performing demonstrations, experts are not always consistent and might…

Machine Learning · Computer Science 2021-01-05 Sagar Gubbi Venkatesh , Nihesh Rathod , Shishir Kolathaya , Bharadwaj Amrutur

This paper introduces a novel approach to active feature acquisition for classification, which is the task of sequentially selecting the most informative subset of features to achieve optimal prediction performance during testing while…

Machine Learning · Computer Science 2023-06-27 Ali Mirzaei , Vahid Pourahmadi , Hamid Sheikhzadeh , Alireza Abdollahpourrostam

Deep learning models are the state-of-the-art methods for semantic point cloud segmentation, the success of which relies on the availability of large-scale annotated datasets. However, it can be extremely time-consuming and prohibitively…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Xian Shi , Xun Xu , Ke Chen , Lile Cai , Chuan Sheng Foo , Kui Jia

Active learning (AL) is a machine learning (ML) approach that strategically selects the most informative samples for annotation during training, aiming to minimize annotation costs. This strategy not only reduces labeling expenses but also…

Machine Learning · Computer Science 2026-03-25 Cédric Jung , Shirin Salehi , Anke Schmeink

Bayesian optimization (BO) methods choose sample points by optimizing an acquisition function derived from a statistical model of the objective. These acquisition functions are chosen to balance sampling regions with predicted good…

Machine Learning · Computer Science 2024-08-16 Darian Nwankwo , David Bindel

We propose a simple algorithm to train stochastic neural networks to draw samples from given target distributions for probabilistic inference. Our method is based on iteratively adjusting the neural network parameters so that the output…

Machine Learning · Statistics 2016-11-29 Dilin Wang , Qiang Liu

The exploding research interest for neural networks in modeling nonlinear dynamical systems is largely explained by the networks' capacity to model complex input-output relations directly from data. However, they typically need vast…

Artificial Intelligence · Computer Science 2023-02-27 Erlend Torje Berg Lundby , Adil Rasheed , Ivar Johan Halvorsen , Dirk Reinhardt , Sebastien Gros , Jan Tommy Gravdahl

Active learning focuses on choosing a subset of unlabeled data to be labeled. However, most such methods assume that a large subset of the data can be annotated. We are interested in low-budget active learning where only a small subset…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Kossar Pourahmadi , Parsa Nooralinejad , Hamed Pirsiavash

We consider a batch active learning scenario where the learner adaptively issues batches of points to a labeling oracle. Sampling labels in batches is highly desirable in practice due to the smaller number of interactive rounds with the…

Machine Learning · Computer Science 2022-06-14 Claudio Gentile , Zhilei Wang , Tong Zhang