English
Related papers

Related papers: Efficient Active Learning with Abstention

200 papers

Hard optimisation problems such as Boolean Satisfiability typically have long solving times and can usually be solved by many algorithms, although the performance can vary widely in practice. Research has shown that no single algorithm…

Machine Learning · Computer Science 2019-09-10 Riccardo Volpato , Guangyan Song

In multiple instance multiple label learning, each sample, a bag, consists of multiple instances. To alleviate labeling complexity, each sample is associated with a set of bag-level labels leaving instances within the bag unlabeled. This…

Machine Learning · Computer Science 2021-07-28 Tam Nguyen , Raviv Raich

Fine-tuning the pre-trained model with active learning holds promise for reducing annotation costs. However, this combination introduces significant computational costs, particularly with the growing scale of pre-trained models. Recent…

Machine Learning · Computer Science 2024-11-19 Ziting Wen , Oscar Pizarro , Stefan Williams

Learning in the presence of label noise is a challenging yet important task: it is crucial to design models that are robust in the presence of mislabeled datasets. In this paper, we discover that a new class of loss functions called the…

Machine Learning · Computer Science 2020-02-18 Liu Ziyin , Blair Chen , Ru Wang , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency , Masahito Ueda

In critical applications of anomaly detection including computer security and fraud prevention, the anomaly detector must be configurable by the analyst to minimize the effort on false positives. One important way to configure the anomaly…

Machine Learning · Computer Science 2018-09-19 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

We present a practical and statistically consistent scheme for actively learning binary classifiers under general loss functions. Our algorithm uses importance weighting to correct sampling bias, and by controlling the variance, we are able…

Machine Learning · Computer Science 2009-05-20 Alina Beygelzimer , Sanjoy Dasgupta , John Langford

The goal of pool-based active learning is to judiciously select a fixed-sized subset of unlabeled samples from a pool to query an oracle for their labels, in order to maximize the accuracy of a supervised learner. However, the unsaid…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shubhang Bhatnagar , Sachin Goyal , Darshan Tank , Amit Sethi

We investigate the problem of active learning in the streaming setting in non-parametric regimes, where the labels are stochastically generated from a class of functions on which we make no assumptions whatsoever. We rely on recently…

Machine Learning · Computer Science 2021-06-08 Pranjal Awasthi , Christoph Dann , Claudio Gentile , Ayush Sekhari , Zhilei Wang

Neural Network-based active learning (NAL) is a cost-effective data selection technique that utilizes neural networks to select and train on a small subset of samples. While existing work successfully develops various effective or…

Machine Learning · Computer Science 2024-06-07 Dake Bu , Wei Huang , Taiji Suzuki , Ji Cheng , Qingfu Zhang , Zhiqiang Xu , Hau-San Wong

Applied mathematics and machine computations have raised a lot of hope since the recent success of supervised learning. Many practitioners in industries have been trying to switch from their old paradigms to machine learning. Interestingly,…

Machine Learning · Computer Science 2022-09-26 Vivien Cabannes

The availability of large labeled datasets is the key component for the success of deep learning. However, annotating labels on large datasets is generally time-consuming and expensive. Active learning is a research area that addresses the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Felix Buchert , Nassir Navab , Seong Tae Kim

There is a large body of work on convergence rates either in passive or active learning. Here we outline some of the results that have been obtained, more specifically in a nonparametric setting under assumptions about the smoothness and…

Machine Learning · Statistics 2021-05-05 Boris Ndjia Njike , Xavier Siebert

Learning and decision-making in domains with naturally high noise-to-signal ratio, such as Finance or Healthcare, is often challenging, while the stakes are very high. In this paper, we study the problem of learning and acting under a…

Machine Learning · Computer Science 2023-09-26 Yikai Zhang , Songzhu Zheng , Mina Dalirrooyfard , Pengxiang Wu , Anderson Schneider , Anant Raj , Yuriy Nevmyvaka , Chao Chen

In many applications the process of generating label information is expensive and time consuming. We present a new method that combines active and semi-supervised deep learning to achieve high generalization performance from a deep…

Machine Learning · Computer Science 2018-03-06 Matthias Rottmann , Karsten Kahl , Hanno Gottschalk

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces under the Gaussian distribution on $R^d$ in the presence of some form of query access. In the classical pool-based active learning model, where the…

Machine Learning · Computer Science 2025-01-03 Ilias Diakonikolas , Daniel M. Kane , Mingchen Ma

It is widely believed that given the same labeling budget, active learning (AL) algorithms like margin-based active learning achieve better predictive performance than passive learning (PL), albeit at a higher computational cost. Recent…

Machine Learning · Computer Science 2023-06-05 Alexandru Tifrea , Jacob Clarysse , Fanny Yang

Active learning shows promise to decrease test bench time for model-based drivability calibration. This paper presents a new strategy for active output selection, which suits the needs of calibration tasks. The strategy is actively learning…

Machine Learning · Computer Science 2021-02-24 Adrian Prochaska , Julien Pillas , Bernard Bäker

We study the problem of computationally and label efficient PAC active learning $d$-dimensional halfspaces with Tsybakov Noise~\citep{tsybakov2004optimal} under structured unlabeled data distributions. Inspired…

Machine Learning · Computer Science 2024-07-23 Yinan Li , Chicheng Zhang

Active learning is a promising paradigm to reduce the labeling cost by strategically requesting labels to improve model performance. However, existing active learning methods often rely on expensive acquisition function to compute,…

Machine Learning · Computer Science 2023-10-27 Zixin Ding , Si Chen , Ruoxi Jia , Yuxin Chen

Due to the privacy protection or the difficulty of data collection, we cannot observe individual outputs for each instance, but we can observe aggregated outputs that are summed over multiple instances in a set in some real-world…

Machine Learning · Statistics 2022-10-05 Tomoharu Iwata