English
Related papers

Related papers: Smooth Sailing: Improving Active Learning for Pre-…

200 papers

Supervised learning deals with the inference of a distribution over an output or label space $\CY$ conditioned on points in an observation space $\CX$, given a training dataset $D$ of pairs in $\CX \times \CY$. However, in a lot of…

Machine Learning · Computer Science 2007-11-15 Christos Dimitrakakis , Christian Savu-Krohn

The advent of large language models (LLMs) capable of producing general-purpose representations lets us revisit the practicality of deep active learning (AL): By leveraging frozen LLM embeddings, we can mitigate the computational costs of…

Computation and Language · Computer Science 2025-06-04 Lukas Rauch , Moritz Wirth , Denis Huseljic , Marek Herde , Bernhard Sick , Matthias Aßenmacher

Gaining insights into the preferences of new users and subsequently personalizing recommendations necessitate managing user interactions intelligently, namely, posing pertinent questions to elicit valuable information effectively. In this…

Machine Learning · Computer Science 2023-09-04 Furkan Cantürk , Reyhan Aydoğan

Active Learning (AL) techniques have proven to be highly effective in reducing data labeling costs across a range of machine learning tasks. Nevertheless, one known challenge of these methods is their potential to introduce unfairness…

Machine Learning · Computer Science 2023-12-20 Ricky Fajri , Akrati Saxena , Yulong Pei , Mykola Pechenizkiy

Speech emotion recognition (SER) has drawn increasing attention for its applications in human-machine interaction. However, existing SER methods ignore the information gap between the pre-training speech recognition task and the downstream…

Sound · Computer Science 2023-10-03 Dongyuan Li , Yusong Wang , Kotaro Funakoshi , Manabu Okumura

Active learning aims to reduce labeling efforts by selectively asking humans to annotate the most important data points from an unlabeled pool and is an example of human-machine interaction. Though active learning has been extensively…

Machine Learning · Computer Science 2020-01-31 Hongjing Zhang , S. S. Ravi , Ian Davidson

Active learning is able to reduce the amount of labelling effort by using a machine learning model to query the user for specific inputs. While there are many papers on new active learning techniques, these techniques rarely satisfy the…

Machine Learning · Computer Science 2020-06-18 Parmida Atighehchian , Frédéric Branchaud-Charron , Alexandre Lacoste

Which volume to annotate next is a challenging problem in building medical imaging datasets for deep learning. One of the promising methods to approach this question is active learning (AL). However, AL has been a hard nut to crack in terms…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Vishwesh Nath , Dong Yang , Holger R. Roth , Daguang Xu

Given a labeled training set and a collection of unlabeled data, the goal of active learning (AL) is to identify the best unlabeled points to label. In this comprehensive study, we analyze the performance of a variety of AL algorithms on…

Machine Learning · Computer Science 2022-10-11 Dara Bahri , Heinrich Jiang , Tal Schuster , Afshin Rostamizadeh

Active learning (AL) selects the most beneficial unlabeled samples to label, and hence a better machine learning model can be trained from the same number of labeled samples. Most existing active learning for regression (ALR) approaches are…

Machine Learning · Computer Science 2022-11-15 Ziang Liu , Xue Jiang , Hanbin Luo , Weili Fang , Jiajing Liu , Dongrui Wu

One of the goals of natural language understanding is to develop models that map sentences into meaning representations. However, training such models requires expensive annotation of complex structures, which hinders their adoption.…

Computation and Language · Computer Science 2019-10-08 Omri Koshorek , Gabriel Stanovsky , Yichu Zhou , Vivek Srikumar , Jonathan Berant

Power-law scaling indicates that large-scale training with uniform sampling is prohibitively slow. Active learning methods aim to increase data efficiency by prioritizing learning on the most relevant examples. Despite their appeal, these…

Artificial Intelligence · Computer Science 2024-10-17 Talfan Evans , Shreya Pathak , Hamza Merzic , Jonathan Schwarz , Ryutaro Tanno , Olivier J. Henaff

The performance of learning-based algorithms improves with the amount of labelled data used for training. Yet, manually annotating data is particularly difficult for medical image segmentation tasks because of the limited expert…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Supervised neural approaches are hindered by their dependence on large, meticulously annotated datasets, a requirement that is particularly cumbersome for sequential tasks. The quality of annotations tends to deteriorate with the transition…

Active learning (AL) is a label-efficient machine learning paradigm that focuses on selectively annotating high-value instances to maximize learning efficiency. Its effectiveness can be further enhanced by incorporating weak supervision,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Shinnosuke Matsuo , Riku Togashi , Ryoma Bise , Seiichi Uchida , Masahiro Nomura

Training deep models with limited annotations poses a significant challenge when applied to diverse practical domains. Employing semi-supervised learning alongside the self-supervised model offers the potential to enhance label efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Ziting Wen , Oscar Pizarro , Stefan Williams

This paper addresses significant obstacles that arise from the widespread use of machine learning models in the insurance industry, with a specific focus on promoting fairness. The initial challenge lies in effectively leveraging unlabeled…

Machine Learning · Statistics 2024-05-21 Romuald Elie , Caroline Hillairet , François Hu , Marc Juillard

We derive and analyze a new, efficient, pool-based active learning algorithm for halfspaces, called ALuMA. Most previous algorithms show exponential improvement in the label complexity assuming that the distribution over the instance space…

Machine Learning · Computer Science 2015-03-19 Alon Gonen , Sivan Sabato , Shai Shalev-Shwartz

Ordering the selection of training data using active learning can lead to improvements in learning efficiently from smaller corpora. We present an exploration of active learning approaches applied to three grounded language problems of…

Robotics · Computer Science 2020-11-17 Nisha Pillai , Edward Raff , Francis Ferraro , Cynthia Matuszek

In this paper, we address customer review understanding problems by using supervised machine learning approaches, in order to achieve a fully automatic review aspects categorisation and sentiment analysis. In general, such supervised…

Computation and Language · Computer Science 2019-11-05 Yanwei Cui , Xavier Illy