English
Related papers

Related papers: Active Learning Using Smooth Relative Regret Appro…

200 papers

Incremental Learning (IL) allows AI systems to adapt to streamed data. Most existing algorithms make two strong hypotheses which reduce the realism of the incremental scenario: (1) new data are assumed to be readily annotated when streamed…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Eden Belouadah , Adrian Popescu , Umang Aggarwal , Léo Saci

In active learning, the user sequentially chooses values for feature $X$ and an oracle returns the corresponding label $Y$. In this paper, we consider the effect of feature noise in active learning, which could arise either because $X$…

Machine Learning · Statistics 2015-05-19 Aaditya Ramdas , Barnabas Poczos , Aarti Singh , Larry Wasserman

The Private Aggregation of Teacher Ensembles (PATE) framework is one of the most promising recent approaches in differentially private learning. Existing theoretical analysis shows that PATE consistently learns any VC-classes in the…

Machine Learning · Computer Science 2022-03-15 Chong Liu , Yuqing Zhu , Kamalika Chaudhuri , Yu-Xiang Wang

Active Learning aims to optimize performance while minimizing annotation costs by selecting the most informative samples from an unlabelled pool. Traditional uncertainty sampling often leads to sampling bias by choosing similar uncertain…

Machine Learning · Computer Science 2024-11-27 Tejaswi Kasarla , Abhishek Jha , Faye Tervoort , Rita Cucchiara , Pascal Mettes

We provide new results concerning label efficient, polynomial time, passive and active learning of linear separators. We prove that active learning provides an exponential improvement over PAC (passive) learning of homogeneous linear…

Machine Learning · Computer Science 2013-04-29 Maria Florina Balcan , Philip M. Long

Active learning is a framework for supervised learning to improve the predictive performance by adaptively annotating a small number of samples. To realize efficient active learning, both an acquisition function that determines the next…

Machine Learning · Statistics 2021-04-12 Hideaki Ishibashi , Hideitsu Hino

We present an active learning strategy for training parametric models of distance metrics, given triplet-based similarity assessments: object $x_i$ is more similar to object $x_j$ than to $x_k$. In contrast to prior work on class-based…

Machine Learning · Computer Science 2020-05-26 Priyadarshini K , Ritesh Goru , Siddhartha Chaudhuri , Subhasis Chaudhuri

Offline reinforcement learning (RL) enables policy learning from static data but often suffers from poor coverage of the state-action space and distributional shift problems. This problem can be addressed by allowing limited online…

Machine Learning · Computer Science 2026-02-03 Soumyadeep Roy , Shashwat Kushwaha , Ambedkar Dukkipati

Effective learning of user preferences is critical to easing user burden in various types of matching problems. Equally important is active query selection to further reduce the amount of preference information users must provide. We…

Machine Learning · Computer Science 2012-06-22 Laurent Charlin , Rich Zemel , Craig Boutilier

Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called…

Machine Learning · Computer Science 2022-04-06 Ching-An Cheng , Jonathan Lee , Ken Goldberg , Byron Boots

Fine-tuning the pre-trained model with active learning holds promise for reducing annotation costs. However, this combination introduces significant computational costs, particularly with the growing scale of pre-trained models. Recent…

Machine Learning · Computer Science 2024-11-19 Ziting Wen , Oscar Pizarro , Stefan Williams

Active learning emerged as an alternative to alleviate the effort to label huge amount of data for data hungry applications (such as image/video indexing and retrieval, autonomous driving, etc.). The goal of active learning is to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Minghan Li , Xialei Liu , Joost van de Weijer , Bogdan Raducanu

A fundamental challenge in interactive learning and decision making, ranging from bandit problems to reinforcement learning, is to provide sample-efficient, adaptive learning algorithms that achieve near-optimal regret. This question is…

Machine Learning · Computer Science 2023-07-12 Dylan J. Foster , Sham M. Kakade , Jian Qian , Alexander Rakhlin

The increasing size and heterogeneity of exoplanet catalogs have made systematic habitability assessment challenging, particularly given the extreme scarcity of potentially habitable planets and the evolving nature of their labels. In this…

Earth and Planetary Astrophysics · Physics 2026-04-24 R. I. El-Kholy , Z. M. Hayman

Active Learning (AL) for regression has been systematically under-researched due to the increased difficulty of measuring uncertainty in regression models. Since normalizing flows offer a full predictive distribution instead of a point…

Machine Learning · Computer Science 2025-01-03 Thorben Werner , Lars Schmidt-Thieme

Selective prediction aims to learn a reliable model that abstains from making predictions when uncertain. These predictions can then be deferred to humans for further evaluation. As an everlasting challenge for machine learning, in many…

Machine Learning · Computer Science 2024-03-04 Jiefeng Chen , Jinsung Yoon , Sayna Ebrahimi , Sercan Arik , Somesh Jha , Tomas Pfister

The central tenet of reinforcement learning (RL) is that agents seek to maximize the sum of cumulative rewards. In contrast, active inference, an emerging framework within cognitive and computational neuroscience, proposes that agents act…

Machine Learning · Computer Science 2020-03-02 Alexander Tschantz , Beren Millidge , Anil K. Seth , Christopher L. Buckley

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

Machine Learning · Computer Science 2020-12-17 Hideitsu Hino

In recent years, active learning has been successfully applied to an array of NLP tasks. However, prior work often assumes that training and test data are drawn from the same distribution. This is problematic, as in real-life settings data…

Computation and Language · Computer Science 2023-02-15 Ard Snijders , Douwe Kiela , Katerina Margatina

To date, the tightest upper and lower-bounds for the active learning of general concept classes have been in terms of a parameter of the learning problem called the splitting index. We provide, for the first time, an efficient algorithm…

Machine Learning · Computer Science 2017-06-12 Christopher Tosh , Sanjoy Dasgupta