English
Related papers

Related papers: UPAL: Unbiased Pool Based Active Learning

200 papers

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

Active learning is a valuable tool for efficiently exploring complex spaces, finding a variety of uses in materials science. However, the determination of convex hulls for phase diagrams does not neatly fit into traditional active learning…

Materials Science · Physics 2024-02-27 Andrew Novick , Diana Cai , Quan Nguyen , Roman Garnett , Ryan Adams , Eric Toberer

AI deployed in many real-world use cases should be capable of adapting to novelties encountered after deployment. Here, we consider a challenging, under-explored and realistic continual adaptation problem: a deployed AI agent is…

Machine Learning · Computer Science 2024-12-16 Amanda Rios , Ibrahima Ndiour , Parual Datta , Jerry Sydir , Omesh Tickoo , Nilesh Ahuja

We consider the problem of learning a binary classifier from only positive and unlabeled observations (called PU learning). Recent studies in PU learning have shown superior performance theoretically and empirically. However, most existing…

Machine Learning · Statistics 2020-02-21 Yongchan Kwon , Wonyoung Kim , Masashi Sugiyama , Myunghee Cho Paik

We derive and analyze a new, efficient, pool-based active learning algorithm for halfspaces, called ALuMA. Most previous algorithms show exponential improvement in the label complexity assuming that the distribution over the instance space…

Machine Learning · Computer Science 2015-03-19 Alon Gonen , Sivan Sabato , Shai Shalev-Shwartz

We study pool-based active learning with abstention feedbacks where a labeler can abstain from labeling a queried example with some unknown abstention rate. This is an important problem with many useful applications. We take a Bayesian…

Machine Learning · Computer Science 2021-01-01 Cuong V. Nguyen , Lam Si Tung Ho , Huan Xu , Vu Dinh , Binh Nguyen

This paper presents simple and efficient methods to mitigate sampling bias in active learning while achieving state-of-the-art accuracy and model robustness. We introduce supervised contrastive active learning by leveraging the contrastive…

Machine Learning · Computer Science 2021-09-15 Ranganath Krishnan , Alok Sinha , Nilesh Ahuja , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Partial label learning is a type of weakly supervised learning, where each training instance corresponds to a set of candidate labels, among which only one is true. In this paper, we introduce ProPaLL, a novel probabilistic approach to this…

Machine Learning · Computer Science 2022-08-23 Łukasz Struski , Jacek Tabor , Bartosz Zieliński

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

Unsupervised active learning has attracted increasing attention in recent years, where its goal is to select representative samples in an unsupervised setting for human annotating. Most existing works are based on shallow linear models by…

Machine Learning · Computer Science 2020-07-29 Changsheng Li , Handong Ma , Zhao Kang , Ye Yuan , Xiao-Yu Zhang , Guoren Wang

Active learning has the potential to be especially useful for messy, uncurated pools where datapoints vary in relevance to the target task. However, state-of-the-art approaches to this problem currently rely on using fixed, unsupervised…

Machine Learning · Computer Science 2026-02-16 Kianoosh Ashouritaklimi , Tom Rainforth

Conventional learning with expert advice methods assumes a learner is always receiving the outcome (e.g., class labels) of every incoming training instance at the end of each trial. In real applications, acquiring the outcome from oracle…

Machine Learning · Computer Science 2013-09-27 Peilin Zhao , Steven Hoi , Jinfeng Zhuang

Labeling data can be an expensive task as it is usually performed manually by domain experts. This is cumbersome for deep learning, as it is dependent on large labeled datasets. Active learning (AL) is a paradigm that aims to reduce…

Computation and Language · Computer Science 2021-11-05 Pieter Floris Jacobs , Gideon Maillette de Buy Wenniger , Marco Wiering , Lambert Schomaker

In the active learning paradigm, using an oracle to label data has always been a complex and expensive task, and with the emersion of large unlabeled data pools, it would be highly beneficial If we could achieve better results without…

Machine Learning · Computer Science 2025-08-12 Hadi Khorsand , Vahid Pourahmadi

Several pool-based active learning algorithms (AL) were employed to model potential energy surfaces (PESs) with a minimum number of electronic structure calculations. Theoretical and empirical results suggest that superior strategies can be…

Chemical Physics · Physics 2021-10-27 Yahya Saleh , Vishnu Sanjay , Armin Iske , Andrey Yachmenev , Jochen Küpper

This paper studies the problem of learning with augmented classes (LAC), where augmented classes unobserved in the training data might emerge in the testing phase. Previous studies generally attempt to discover augmented classes by…

Machine Learning · Computer Science 2020-11-30 Yu-Jie Zhang , Peng Zhao , Zhi-Hua Zhou

An active learner is given a hypothesis class, a large set of unlabeled examples and the ability to interactively query labels to an oracle of a subset of these examples; the goal of the learner is to learn a hypothesis in the class that…

Machine Learning · Computer Science 2015-10-19 Chicheng Zhang , Kamalika Chaudhuri

Active Learning (AL) techniques aim to minimize the training data required to train a model for a given task. Pool-based AL techniques start with a small initial labeled pool and then iteratively pick batches of the most informative samples…

Machine Learning · Computer Science 2021-07-15 Akshay L Chandra , Sai Vikas Desai , Chaitanya Devaguptapu , Vineeth N Balasubramanian

A fundamental task in science is to design experiments that yield valuable insights about the system under study. Mathematically, these insights can be represented as a utility or risk function that shapes the value of conducting each…

Machine Learning · Computer Science 2022-10-24 Christopher Tosh , Mauricio Tec , Wesley Tansey

The increasing size and heterogeneity of exoplanet catalogs have made systematic habitability assessment challenging, particularly given the extreme scarcity of potentially habitable planets and the evolving nature of their labels. In this…

Earth and Planetary Astrophysics · Physics 2026-04-24 R. I. El-Kholy , Z. M. Hayman