English
Related papers

Related papers: Query Complexity of Active Learning for Function F…

200 papers

We study the theoretical advantages of active learning over passive learning. Specifically, we prove that, in noise-free classifier learning for VC classes, any passive learning algorithm can be transformed into an active learning algorithm…

Machine Learning · Statistics 2011-08-09 Steve Hanneke

One of the motivations for property testing of boolean functions is the idea that testing can serve as a preprocessing step before learning. However, in most machine learning applications, it is not possible to request for labels of…

Data Structures and Algorithms · Computer Science 2012-04-18 Maria-Florina Balcan , Eric Blais , Avrim Blum , Liu Yang

This paper addresses significant obstacles that arise from the widespread use of machine learning models in the insurance industry, with a specific focus on promoting fairness. The initial challenge lies in effectively leveraging unlabeled…

Machine Learning · Statistics 2024-05-21 Romuald Elie , Caroline Hillairet , François Hu , Marc Juillard

Active learning (AL) for multiple target models aims to reduce labeled data querying while effectively training multiple models concurrently. Existing AL algorithms often rely on iterative model training, which can be computationally…

Machine Learning · Computer Science 2024-10-03 Sheng-Jun Huang , Yi Li , Yiming Sun , Ying-Peng Tang

We construct and analyze active learning algorithms for the problem of binary classification with abstention. We consider three abstention settings: \emph{fixed-cost} and two variants of \emph{bounded-rate} abstention, and for each of them…

Machine Learning · Computer Science 2019-06-04 Shubhanshu Shekhar , Mohammad Ghavamzadeh , Tara Javidi

Enforcing orthonormal or isometric property for the weight matrices has been shown to enhance the training of deep neural networks by mitigating gradient exploding/vanishing and increasing the robustness of the learned networks. However,…

Machine Learning · Computer Science 2024-03-01 Zhen Qin , Xuwei Tan , Zhihui Zhu

In active learning, the user sequentially chooses values for feature $X$ and an oracle returns the corresponding label $Y$. In this paper, we consider the effect of feature noise in active learning, which could arise either because $X$…

Machine Learning · Statistics 2015-05-19 Aaditya Ramdas , Barnabas Poczos , Aarti Singh , Larry Wasserman

Deep Neural Networks trained in a fully supervised fashion are the dominant technology in perception-based autonomous driving systems. While collecting large amounts of unlabeled data is already a major undertaking, only a subset of it can…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Elmar Haussmann , Michele Fenzi , Kashyap Chitta , Jan Ivanecky , Hanson Xu , Donna Roy , Akshita Mittel , Nicolas Koumchatzky , Clement Farabet , Jose M. Alvarez

We propose an active learning algorithm for linear system identification with optimal centered noise excitation. Notably, our algorithm, based on ordinary least squares and semidefinite programming, attains the minimal sample complexity…

Optimization and Control · Mathematics 2026-04-08 Kaito Ito , Alexandre Proutiere

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

Inspired by the concept of active learning, we propose active inference$\unicode{x2013}$a methodology for statistical inference with machine-learning-assisted data collection. Assuming a budget on the number of labels that can be collected,…

Machine Learning · Statistics 2026-04-09 Tijana Zrnic , Emmanuel J. Candès

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

Machine Learning · Computer Science 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

We consider the problem of noisy Bayesian active learning, where we are given a finite set of functions $\mathcal{H}$, a sample space $\mathcal{X}$, and a label set $\mathcal{L}$. One of the functions in $\mathcal{H}$ assigns labels to…

Information Theory · Computer Science 2016-11-15 Mohammad Naghshvar , Tara Javidi , Kamalika Chaudhuri

We propose using active learning based techniques to further improve the state-of-the-art semi-supervised learning MixMatch algorithm. We provide a thorough empirical evaluation of several active-learning and baseline methods, which…

Machine Learning · Computer Science 2019-12-04 Shuang Song , David Berthelot , Afshin Rostamizadeh

Active learning is usually applied to acquire labels of informative data points in supervised learning, to maximize accuracy in a sample-efficient way. However, maximizing the accuracy is not the end goal when the results are used for…

Machine Learning · Statistics 2021-10-22 Louis Filstroff , Iiris Sundin , Petrus Mikkola , Aleksei Tiulpin , Juuso Kylmäoja , Samuel Kaski

We investigate the problem of active learning on a given tree whose nodes are assigned binary labels in an adversarial way. Inspired by recent results by Guillory and Bilmes, we characterize (up to constant factors) the optimal placement of…

Machine Learning · Computer Science 2013-01-23 Nicolo Cesa-Bianchi , Claudio Gentile , Fabio Vitale , Giovanni Zappella

Automated skin lesion analysis is very crucial in clinical practice, as skin cancer is among the most common human malignancy. Existing approaches with deep learning have achieved remarkable performance on this challenging task, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Xueying Shi , Qi Dou , Cheng Xue , Jing Qin , Hao Chen , Pheng-Ann Heng

Labeling a large set of data is expensive. Active learning aims to tackle this problem by asking to annotate only the most informative data from the unlabeled set. We propose a novel active learning approach that utilizes self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 John Seon Keun Yi , Minseok Seo , Jongchan Park , Dong-Geol Choi

Applied mathematics and machine computations have raised a lot of hope since the recent success of supervised learning. Many practitioners in industries have been trying to switch from their old paradigms to machine learning. Interestingly,…

Machine Learning · Computer Science 2022-09-26 Vivien Cabannes

Most meta-learning methods assume that the (very small) context set used to establish a new task at test time is passively provided. In some settings, however, it is feasible to actively select which points to label; the potential gain from…

Machine Learning · Computer Science 2024-07-26 Wonho Bae , Jing Wang , Danica J. Sutherland