English
Related papers

Related papers: Average-Case Active Learning with Costs

200 papers

We perform an experimental study of algorithms for online bipartite matching under the known i.i.d. input model with integral types. In the last decade, there has been substantial effort in designing complex algorithms with the goal of…

Data Structures and Algorithms · Computer Science 2018-08-16 Allan Borodin , Christodoulos Karavasilis , Denis Pankratov

We tackle the fundamental problem of Bayesian active learning with noise, where we need to adaptively select from a number of expensive tests in order to identify an unknown hypothesis sampled from a known prior distribution. In the case of…

Machine Learning · Computer Science 2013-12-17 Daniel Golovin , Andreas Krause , Debajyoti Ray

We introduce and analyse active learning markets as a way to purchase labels, in situations where analysts aim to acquire additional data to improve model fitting, or to better train models for predictive analytics applications. This comes…

Machine Learning · Computer Science 2026-02-11 Xiwen Huang , Pierre Pinson

Counterfactual learning from observational data involves learning a classifier on an entire population based on data that is observed conditioned on a selection policy. This work considers this problem in an active setting, where the…

Machine Learning · Statistics 2019-10-29 Songbai Yan , Kamalika Chaudhuri , Tara Javidi

Active learning is a branch of machine learning that deals with problems where unlabeled data is abundant yet obtaining labels is expensive. The learning algorithm has the possibility of querying a limited number of samples to obtain the…

Disordered Systems and Neural Networks · Physics 2020-09-04 Hugo Cui , Luca Saglietti , Lenka Zdeborová

Active learning (AL) is a principled strategy to reduce annotation cost in data-hungry deep learning. However, existing AL algorithms focus almost exclusively on unimodal data, overlooking the substantial annotation burden in multimodal…

Machine Learning · Computer Science 2026-04-24 Jiancheng Zhang , Yinglun Zhu

The cost of labeling data often limits the performance of machine learning systems. In multi-task learning, related tasks provide information to each other and improve overall performance, but the label cost can vary among tasks. How should…

Machine Learning · Computer Science 2023-08-25 Ximeng Sun , Kihyuk Sohn , Kate Saenko , Clayton Mellina , Xiao Bian

Labeling data correctly is an expensive and challenging task in machine learning, especially for on-line data streams. Deep learning models especially require a large number of clean labeled data that is very difficult to acquire in…

Machine Learning · Computer Science 2020-10-28 Taraneh Younesian , Dick Epema , Lydia Y. Chen

Active learning is a machine learning method aiming at optimal design for model training. At variance with supervised learning, which labels all samples, active learning provides an improved model by labeling samples with maximal…

The advent of large language models (LLMs) capable of producing general-purpose representations lets us revisit the practicality of deep active learning (AL): By leveraging frozen LLM embeddings, we can mitigate the computational costs of…

Computation and Language · Computer Science 2025-06-04 Lukas Rauch , Moritz Wirth , Denis Huseljic , Marek Herde , Bernhard Sick , Matthias Aßenmacher

Active learning enables efficient model training by leveraging interactions between machine learning agents and human annotators. We study and propose a novel framework that formulates batch active learning from the sparse approximation's…

Machine Learning · Computer Science 2022-11-08 Maohao Shen , Bowen Jiang , Jacky Yibo Zhang , Oluwasanmi Koyejo

We present a general-purpose active learning scheme for data in metric spaces. The algorithm maintains a collection of neighborhoods of different sizes and uses label queries to identify those that have a strong bias towards one particular…

Machine Learning · Computer Science 2023-03-07 Sanjoy Dasgupta , Yoav Freund

Multi-agent active search requires autonomous agents to choose sensing actions that efficiently locate targets. In a realistic setting, agents also must consider the costs that their decisions incur. Previously proposed active search…

Machine Learning · Computer Science 2022-10-06 Arundhati Banerjee , Ramina Ghods , Jeff Schneider

Despite considerable recent progress, the creation of well-balanced and diverse resources remains a time-consuming and costly challenge in Argument Mining. Active Learning reduces the amount of data necessary for the training of machine…

Computation and Language · Computer Science 2021-09-29 Nikolai Solmsdorf , Dietrich Trautmann , Hinrich Schütze

This note explores probabilistic sampling weighted by uncertainty in active learning. This method has been previously used and authors have tangentially remarked on its efficacy. The scheme has several benefits: (1) it is computationally…

Machine Learning · Computer Science 2019-09-12 Vinay Jethava

Active learning for regression reduces labeling costs by selecting the most informative samples. Improved Greedy Sampling is a prominent method that balances feature-space diversity and output-space uncertainty using a static,…

Machine Learning · Statistics 2026-03-12 Simon D. Nguyen , Troy Russo , Kentaro Hoffman , Tyler H. McCormick

The primary challenge of multi-label active learning, differing it from multi-class active learning, lies in assessing the informativeness of an indefinite number of labels while also accounting for the inherited label correlation. Existing…

Machine Learning · Computer Science 2025-09-05 Yuanyuan Qi , Jueqing Lu , Xiaohao Yang , Joanne Enticott , Lan Du

This paper advances the theoretical understanding of active learning label complexity for decision trees as binary classifiers. We make two main contributions. First, we provide the first analysis of the disagreement coefficient for…

Although deep learning has made great progress in recent years, the exploding economic and environmental costs of training neural networks are becoming unsustainable. To address this problem, there has been a great deal of research on…

Machine Learning · Computer Science 2023-03-22 Brian R. Bartoldson , Bhavya Kailkhura , Davis Blalock

Annotating data for supervised learning can be costly. When the annotation budget is limited, active learning can be used to select and annotate those observations that are likely to give the most gain in model performance. We propose an…

Machine Learning · Statistics 2024-08-19 Amanda Olmin , Jakob Lindqvist , Lennart Svensson , Fredrik Lindsten