中文
相关论文

相关论文: Active Learning in Bayesian Neural Networks with B…

200 篇论文

Active learning is an effective technique for reducing the labeling cost by improving data efficiency. In this work, we propose a novel batch acquisition strategy for active learning in the setting where the model training is performed in a…

机器学习 · 计算机科学 2020-10-20 Zalán Borsos , Marco Tagliasacchi , Andreas Krause

The acquisition of labels for supervised learning can be expensive. To improve the sample efficiency of neural network regression, we study active learning methods that adaptively select batches of unlabeled data for labeling. We present a…

机器学习 · 统计学 2023-08-02 David Holzmüller , Viktor Zaverkin , Johannes Kästner , Ingo Steinwart

The goal of active learning is to achieve the same accuracy achievable by passive learning, while using much fewer labels. Exponential savings in terms of label complexity have been proved in very special cases, but fundamental lower bounds…

机器学习 · 统计学 2026-01-01 Yinglun Zhu , Robert Nowak

Deep neural networks have great representation power, but typically require large numbers of training examples. This motivates deep active learning methods that can significantly reduce the amount of labeled training data. Empirical…

机器学习 · 计算机科学 2026-01-01 Yinglun Zhu , Robert Nowak

Semi-supervised classification, one of the most prominent fields in machine learning, studies how to combine the statistical knowledge of the often abundant unlabeled data with the often limited labeled data in order to maximize overall…

信息论 · 计算机科学 2020-02-07 Vahid Jamali , Antonia Tulino , Jaime Llorca , Elza Erkip

Inspired by the concept of active learning, we propose active inference$\unicode{x2013}$a methodology for statistical inference with machine-learning-assisted data collection. Assuming a budget on the number of labels that can be collected,…

机器学习 · 统计学 2026-04-09 Tijana Zrnic , Emmanuel J. Candès

Recently, several studies have investigated active learning (AL) for natural language processing tasks to alleviate data dependency. However, for query selection, most of these studies mainly rely on uncertainty-based sampling, which…

计算与语言 · 计算机科学 2020-11-30 Yekyung Kim

Active learning (AL) algorithms aim to identify an optimal subset of data for annotation, such that deep neural networks (DNN) can achieve better performance when trained on this labeled subset. AL is especially impactful in industrial…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Zeyad Ali Sami Emam , Hong-Min Chu , Ping-Yeh Chiang , Wojciech Czaja , Richard Leapman , Micah Goldblum , Tom Goldstein

Large amounts of labeled training data are one of the main contributors to the great success that deep models have achieved in the past. Label acquisition for tasks other than benchmarks can pose a challenge due to requirements of both…

计算机视觉与模式识别 · 计算机科学 2020-01-22 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

State-of-the-art machine learning models require access to significant amount of annotated data in order to achieve the desired level of performance. While unlabelled data can be largely available and even abundant, annotation process can…

机器学习 · 计算机科学 2020-10-15 Rahaf Aljundi , Nikolay Chumerin , Daniel Olmeda Reino

Active Learning (AL) is increasingly important in a broad range of applications. Two main AL principles to obtain accurate classification with few labeled data are refinement of the current decision boundary and exploration of poorly…

机器学习 · 计算机科学 2012-10-19 Jens Roeder , Boaz Nadler , Kevin Kunzmann , Fred A. Hamprecht

Central to active learning (AL) is what data should be selected for annotation. Existing works attempt to select highly uncertain or informative data for annotation. Nevertheless, it remains unclear how selected data impacts the test…

机器学习 · 计算机科学 2022-01-25 Tianyang Wang , Xingjian Li , Pengkun Yang , Guosheng Hu , Xiangrui Zeng , Siyu Huang , Cheng-Zhong Xu , Min Xu

At its core, this thesis aims to enhance the practicality of deep learning by improving the label and training efficiency of deep learning models. To this end, we investigate data subset selection techniques, specifically active learning…

机器学习 · 计算机科学 2024-03-11 Andreas Kirsch

Semi-supervised image classification, leveraging pseudo supervision and consistency regularization, has demonstrated remarkable success. However, the ongoing challenge lies in fully exploiting the potential of unlabeled data. To address…

计算机视觉与模式识别 · 计算机科学 2024-05-14 Qi Han , Zhibo Tian , Chengwei Xia , Kun Zhan

Clinical settings are often characterized by abundant unlabelled data and limited labelled data. This is typically driven by the high burden placed on oracles (e.g., physicians) to provide annotations. One way to mitigate this burden is via…

机器学习 · 计算机科学 2022-05-19 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Recently proposed methods in data subset selection, that is active learning and active sampling, use Fisher information, Hessians, similarity matrices based on gradients, and gradient lengths to estimate how informative data is for a…

机器学习 · 计算机科学 2022-11-08 Andreas Kirsch , Yarin Gal

Uncertainty Sampling is an Active Learning strategy that aims to improve the data efficiency of machine learning models by iteratively acquiring labels of data points with the highest uncertainty. While it has proven effective for…

Information-theoretic approaches to active learning have traditionally focused on maximising the information gathered about the model parameters, most commonly by optimising the BALD score. We highlight that this can be suboptimal from the…

机器学习 · 计算机科学 2023-04-18 Freddie Bickford Smith , Andreas Kirsch , Sebastian Farquhar , Yarin Gal , Adam Foster , Tom Rainforth

Supervised machine learning relies on the availability of good labelled data for model training. Labelled data is acquired by human annotation, which is a cumbersome and costly process, often requiring subject matter experts. Active…

机器学习 · 计算机科学 2023-10-31 Sharath M Shankaranarayana

Domain adaptive active learning is leading the charge in label-efficient training of neural networks. For semantic segmentation, state-of-the-art models jointly use two criteria of uncertainty and diversity to select training labels,…

计算机视觉与模式识别 · 计算机科学 2023-11-27 Marc Schachtsiek , Simone Rossi , Thomas Hannagan