中文
相关论文

相关论文: Active Learning with Neural Networks: Insights fro…

200 篇论文

In many applications of classifier learning, training data suffers from label noise. Deep networks are learned using huge training data where the problem of noisy labels is particularly relevant. The current techniques proposed for learning…

机器学习 · 统计学 2017-12-29 Aritra Ghosh , Himanshu Kumar , P. S. Sastry

Deep Neural Networks (DNNs) have been shown to be susceptible to memorization or overfitting in the presence of noisily-labelled data. For the problem of robust learning under such noisy data, several algorithms have been proposed. A…

机器学习 · 计算机科学 2022-12-06 Deep Patel , P. S. Sastry

Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we analyze the performance of a variety of AL algorithms on…

机器学习 · 计算机科学 2022-10-11 Dara Bahri , Heinrich Jiang , Tal Schuster , Afshin Rostamizadeh

Counterfactual learning from observational data involves learning a classifier on an entire population based on data that is observed conditioned on a selection policy. This work considers this problem in an active setting, where the…

机器学习 · 统计学 2019-10-29 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Pre-trained Vision Language Models (VLMs) have demonstrated notable progress in various zero-shot tasks, such as classification and retrieval. Despite their performance, because improving performance on new tasks requires task-specific…

计算机视觉与模式识别 · 计算机科学 2024-03-22 Jihwan Bang , Sumyeong Ahn , Jae-Gil Lee

Deep predictive models rely on human supervision in the form of labeled training data. Obtaining large amounts of annotated training data can be expensive and time consuming, and this becomes a critical bottleneck while building such models…

机器学习 · 统计学 2020-10-01 Bindya Venkatesh , Jayaraman J. Thiagarajan

Imperfections in data annotation, known as label noise, are detrimental to the training of machine learning models and have an often-overlooked confounding effect on the assessment of model performance. Nevertheless, employing experts to…

Labelling of data for supervised learning can be costly and time-consuming and the risk of incorporating label noise in large data sets is imminent. When training a flexible discriminative model using a strictly proper loss, such noise will…

机器学习 · 统计学 2022-05-13 Amanda Olmin , Fredrik Lindsten

We present a new active learning algorithm that adaptively partitions the input space into a finite number of regions, and subsequently seeks a distinct predictor for each region, both phases actively requesting labels. We prove theoretical…

机器学习 · 计算机科学 2020-02-19 Corinna Cortes , Giulia DeSalvo , Claudio Gentile , Mehryar Mohri , Ningshan Zhang

Active learning algorithms automatically identify the most informative samples from large amounts of unlabeled data and tremendously reduce human annotation effort in inducing a machine learning model. In a conventional active learning…

机器学习 · 计算机科学 2026-04-28 Varun Totakura , Ankita Singh , Yushun Dong , Shayok Chakraborty

Active learning seeks to achieve strong performance with fewer training samples. It does this by iteratively asking an oracle to label new selected samples in a human-in-the-loop manner. This technique has gained increasing popularity due…

机器学习 · 计算机科学 2024-07-16 Dongyuan Li , Zhen Wang , Yankai Chen , Renhe Jiang , Weiping Ding , Manabu Okumura

Label efficiency has become an increasingly important objective in deep learning applications. Active learning aims to reduce the number of labeled examples needed to train deep networks, but the empirical performance of active learning…

机器学习 · 计算机科学 2023-12-19 Jifan Zhang , Shuai Shao , Saurabh Verma , Robert Nowak

Deep learning is currently reaching outstanding performances on different tasks, including image classification, especially when using large neural networks. The success of these models is tributary to the availability of large collections…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Mingyuan Jiu , Xuguang Song , Hichem Sahbi , Shupan Li , Yan Chen , Wei Guo , Lihua Guo , Mingliang Xu

Deep neural networks trained on large supervised datasets have led to impressive results in image classification and other tasks. However, well-annotated datasets can be time-consuming and expensive to collect, lending increased interest to…

机器学习 · 计算机科学 2018-02-27 David Rolnick , Andreas Veit , Serge Belongie , Nir Shavit

Collecting large-scale datasets is crucial for training deep models, annotating the data, however, inevitably yields noisy labels, which poses challenges to deep learning algorithms. Previous efforts tend to mitigate this problem via…

计算机视觉与模式识别 · 计算机科学 2023-02-16 Yuanpeng Tu , Boshen Zhang , Yuxi Li , Liang Liu , Jian Li , Jiangning Zhang , Yabiao Wang , Chengjie Wang , Cai Rong Zhao

Social scientists often classify text documents to use the resulting labels as an outcome or a predictor in empirical research. Automated text classification has become a standard tool, since it requires less human coding. However, scholars…

计算与语言 · 计算机科学 2025-05-14 Mitchell Bosley , Saki Kuzushima , Ted Enamorado , Yuki Shiraito

Neural networks trained with stochastic gradient descent exhibit an inductive bias towards simpler decision boundaries, typically converging to a narrow family of functions, and often fail to capture more complex features. This phenomenon…

机器学习 · 计算机科学 2024-11-08 Rahul Vashisht , P. Krishna Kumar , Harsha Vardhan Govind , Harish G. Ramaswamy

Deep learning (DL) algorithms rely on massive amounts of labeled data. Semi-supervised learning (SSL) and active learning (AL) aim to reduce this label complexity by leveraging unlabeled data or carefully acquiring labels, respectively. In…

机器学习 · 计算机科学 2023-02-16 Seo Taek Kong , Soomin Jeon , Dongbin Na , Jaewon Lee , Hong-Seok Lee , Kyu-Hwan Jung

While deep learning (DL) is data-hungry and usually relies on extensive labeled data to deliver good performance, Active Learning (AL) reduces labeling costs by selecting a small proportion of samples from unlabeled data for labeling and…

机器学习 · 计算机科学 2022-07-20 Xueying Zhan , Qingzhong Wang , Kuan-hao Huang , Haoyi Xiong , Dejing Dou , Antoni B. Chan

Deep supervised learning has achieved remarkable success across a wide range of tasks, yet it remains susceptible to overfitting when confronted with noisy labels. To address this issue, noise-robust loss functions offer an effective…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Xichen Ye , Yifan Wu , Yiqi Wang , Xiaoqiang Li , Weizhong Zhang , Yifan Chen