中文
相关论文

相关论文: Teaching an Active Learner with Contrastive Exampl…

200 篇论文

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

机器学习 · 计算机科学 2020-12-17 Hideitsu Hino

We study agnostic active learning, where the goal is to learn a classifier in a pre-specified hypothesis class interactively with as few label queries as possible, while making no assumptions on the true function generating the labels. The…

机器学习 · 计算机科学 2014-07-15 Chicheng Zhang , Kamalika Chaudhuri

Machine teaching addresses the problem of finding the best training data that can guide a learning algorithm to a target model with minimal effort. In conventional settings, a teacher provides data that are consistent with the true data…

机器学习 · 计算机科学 2019-11-04 Tomi Peltola , Mustafa Mert Çelikok , Pedram Daee , Samuel Kaski

A new understanding of adversarial examples and adversarial robustness is proposed by decoupling the data generator and the label generator (which we call the teacher). In our framework, adversarial robustness is a conditional concept---the…

机器学习 · 计算机科学 2020-12-15 Chao Ma , Lexing Ying

Active learning allows machine learning models to be trained using fewer labels while retaining similar performance to traditional supervised learning. An active learner selects the most informative data points, requests their labels, and…

机器学习 · 计算机科学 2023-11-22 Zac Pullar-Strecker , Katharina Dost , Eibe Frank , Jörg Wicker

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

机器学习 · 统计学 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

This work proposes a procedure for designing algorithms for specific adaptive data collection tasks like active learning and pure-exploration multi-armed bandits. Unlike the design of traditional adaptive algorithms that rely on…

机器学习 · 计算机科学 2025-03-11 Jifan Zhang , Lalit Jain , Kevin Jamieson

Labeling each instance in a large dataset is extremely labor- and time- consuming . One way to alleviate this problem is active learning, which aims to which discover the most valuable instances for labeling to construct a powerful…

机器学习 · 计算机科学 2018-03-07 Xi Fang , Zengmao Wang , Xinyao Tang , Chen Wu

Classical learning assumes the learner is given a labeled data sample, from which it learns a model. The field of Active Learning deals with the situation where the learner begins not with a training sample, but instead with resources that…

机器学习 · 计算机科学 2012-07-19 Omid Madani , Daniel J. Lizotte , Russell Greiner

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts…

机器学习 · 计算机科学 2020-06-02 Max Hopkins , Daniel M. Kane , Shachar Lovett

Current debiasing approaches often result a degradation in model capabilities such as factual accuracy and knowledge retention. Through systematic evaluation across multiple benchmarks, we demonstrate that existing debiasing methods face…

机器学习 · 计算机科学 2025-05-27 Buse Sibel Korkmaz , Rahul Nair , Elizabeth M. Daly , Antonio del Rio Chanona

Active learning aims to develop label-efficient algorithms by querying the most informative samples to be labeled by an oracle. The design of efficient training methods that require fewer labels is an important research direction that…

计算机视觉与模式识别 · 计算机科学 2019-12-23 Ali Mottaghi , Serena Yeung

We explore an active learning approach for dynamic fair resource allocation problems. Unlike previous work that assumes full feedback from all agents on their allocations, we consider feedback from a select subset of agents at each epoch of…

机器学习 · 计算机科学 2024-06-24 Riddhiman Bhattacharya , Thanh Nguyen , Will Wei Sun , Mohit Tawarmalani

Common acquisition functions for active learning use either uncertainty or diversity sampling, aiming to select difficult and diverse data points from the pool of unlabeled data, respectively. In this work, leveraging the best of both…

计算与语言 · 计算机科学 2021-09-09 Katerina Margatina , Giorgos Vernikos , Loïc Barrault , Nikolaos Aletras

The goal of active learning is to achieve the same accuracy achievable by passive learning, while using much fewer labels. Exponential savings in terms of label complexity have been proved in very special cases, but fundamental lower bounds…

机器学习 · 统计学 2026-01-01 Yinglun Zhu , Robert Nowak

Supervised learning typically relies on manual annotation of the true labels. When there are many potential classes, searching for the best one can be prohibitive for a human annotator. On the other hand, comparing two candidate labels is…

机器学习 · 计算机科学 2022-08-16 Gal Yona , Shay Moran , Gal Elidan , Amir Globerson

How can you sample good negative examples for contrastive learning? We argue that, as with metric learning, contrastive learning of representations benefits from hard negative samples (i.e., points that are difficult to distinguish from an…

机器学习 · 计算机科学 2021-01-26 Joshua Robinson , Ching-Yao Chuang , Suvrit Sra , Stefanie Jegelka

In this work we discuss the problem of active learning. We present an approach that is based on A-optimal experimental design of ill-posed problems and show how one can optimally label a data set by partially probing it, and use it to train…

机器学习 · 计算机科学 2022-11-28 Tue Boesen , Eldad Haber

We analyze the problem of active covering, where the learner is given an unlabeled dataset and can sequentially label query examples. The objective is to label query all of the positive examples in the fewest number of total label queries.…

机器学习 · 计算机科学 2021-06-07 Heinrich Jiang , Afshin Rostamizadeh

We present a novel interactive learning protocol that enables training request-fulfilling agents by verbally describing their activities. Unlike imitation learning (IL), our protocol allows the teaching agent to provide feedback in a…

计算与语言 · 计算机科学 2021-06-16 Khanh Nguyen , Dipendra Misra , Robert Schapire , Miro Dudík , Patrick Shafto