中文
相关论文

相关论文: Pool-based Active Learning as Noisy Lossy Compress…

200 篇论文

We introduce a new and improved characterization of the label complexity of disagreement-based active learning, in which the leading quantity is the version space compression set size. This quantity is defined as the size of the smallest…

机器学习 · 计算机科学 2014-04-08 Yair Wiener , Steve Hanneke , Ran El-Yaniv

Noisy Labels are commonly present in data sets automatically collected from the internet, mislabeled by non-specialist annotators, or even specialists in a challenging task, such as in the medical field. Although deep learning models have…

机器学习 · 计算机科学 2020-12-08 Filipe R. Cordeiro , Gustavo Carneiro

In many domains, collecting sufficient labeled training data for supervised machine learning requires easily accessible but noisy sources, such as crowdsourcing services or tagged Web data. Noisy labels occur frequently in data sets…

机器学习 · 计算机科学 2018-11-16 Matthew Klawonn , Eric Heim , James Hendler

Deep active learning has emerged as a powerful tool for training deep learning models within a predefined labeling budget. These models have achieved performances comparable to those trained in an offline setting. However, deep active…

机器学习 · 计算机科学 2023-09-21 Moseli Mots'oehli , Kyungim Baek

Active learning is a machine learning approach for reducing the data labeling effort. Given a pool of unlabeled samples, it tries to select the most useful ones to label so that a model built from them can achieve the best possible…

机器学习 · 计算机科学 2020-03-31 Dongrui Wu

Recent advances in natural language processing (NLP) in online social media are evidently owed to large-scale datasets. However, labeling, storing, and processing a large number of textual data points, e.g., tweets, has remained…

计算与语言 · 计算机科学 2022-02-02 Toktam A. Oghaz , Ivan Garibay

Deep neural networks are highly susceptible to overfitting noisy labels, which leads to degraded performance. Existing methods address this issue by employing manually defined criteria, aiming to achieve optimal partitioning in each…

计算机视觉与模式识别 · 计算机科学 2025-02-04 Wenzhen Zhang , Debo Cheng , Guangquan Lu , Bo Zhou , Jiaye Li , Shichao Zhang

We derive and analyze a new, efficient, pool-based active learning algorithm for halfspaces, called ALuMA. Most previous algorithms show exponential improvement in the label complexity assuming that the distribution over the instance space…

机器学习 · 计算机科学 2015-03-19 Alon Gonen , Sivan Sabato , Shai Shalev-Shwartz

Active learning (AL) aims to improve model performance within a fixed labeling budget by choosing the most informative data points to label. Existing AL focuses on the single-domain setting, where all data come from the same domain (e.g.,…

机器学习 · 计算机科学 2024-02-12 Guang-Yuan Hao , Hengguan Huang , Haotian Wang , Jie Gao , Hao Wang

Supervised machine learning methods usually require a large set of labeled examples for model training. However, in many real applications, there are plentiful unlabeled data but limited labeled data; and the acquisition of labels is…

机器学习 · 计算机科学 2019-01-15 Ying-Peng Tang , Guo-Xiang Li , Sheng-Jun Huang

In this paper, we study the pooled data problem of identifying the labels associated with a large collection of items, based on a sequence of pooled tests revealing the counts of each label within the pool. In the noiseless setting, we…

机器学习 · 统计学 2017-10-19 Jonathan Scarlett , Volkan Cevher

Several works in computer vision have demonstrated the effectiveness of active learning for adapting the recognition model when new unlabeled data becomes available. Most of these works consider that labels obtained from the annotator are…

计算机视觉与模式识别 · 计算机科学 2020-10-20 Sudipta Paul , Shivkumar Chandrasekaran , B. S. Manjunath , Amit K. Roy-Chowdhury

Deep neural networks have great representation power, but typically require large numbers of training examples. This motivates deep active learning methods that can significantly reduce the amount of labeled training data. Empirical…

机器学习 · 计算机科学 2026-01-01 Yinglun Zhu , Robert Nowak

This paper investigates, from information theoretic grounds, a learning problem based on the principle that any regularity in a given dataset can be exploited to extract compact features from data, i.e., using fewer bits than needed to…

机器学习 · 统计学 2018-11-14 Matías Vera , Leonardo Rey Vega , Pablo Piantanida

Deep neural networks have incredible capacity and expressibility, and can seemingly memorize any training set. This introduces a problem when training in the presence of noisy labels, as the noisy examples cannot be distinguished from clean…

机器学习 · 计算机科学 2022-10-04 Daniel Shwartz , Uri Stern , Daphna Weinshall

Learning with reduced labeling standards, such as noisy label, partial label, and multiple label candidates, which we generically refer to as \textit{imprecise} labels, is a commonplace challenge in machine learning tasks. Previous methods…

机器学习 · 计算机科学 2024-10-31 Hao Chen , Ankit Shah , Jindong Wang , Ran Tao , Yidong Wang , Xing Xie , Masashi Sugiyama , Rita Singh , Bhiksha Raj

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

We consider some computationally efficient and provably correct algorithms with near-optimal sample-complexity for the problem of noisy non-adaptive group testing. Group testing involves grouping arbitrary subsets of items into pools. Each…

信息论 · 计算机科学 2016-11-18 Chun Lam Chan , Sidharth Jaggi , Venkatesh Saligrama , Samar Agnihotri

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

机器学习 · 统计学 2022-05-13 Amanda Olmin , Fredrik Lindsten

Active learning has the potential to be especially useful for messy, uncurated pools where datapoints vary in relevance to the target task. However, state-of-the-art approaches to this problem currently rely on using fixed, unsupervised…

机器学习 · 计算机科学 2026-02-16 Kianoosh Ashouritaklimi , Tom Rainforth