English
Related papers

Related papers: Model Exploration with Cost-Aware Learning

200 papers

We consider the problem of Cost-Aware Learning, where sampling different component functions of a finite-sum objective incurs different costs. The objective is to reach a target error while minimizing the total cost. First, we propose the…

Machine Learning · Computer Science 2026-05-01 Clara Mohri , Amir Globerson , Haim Kaplan , Tomer Koren , Yishay Mansour

Despite the availability of ever more data enabled through modern sensor and computer technology, it still remains an open problem to learn dynamical systems in a sample-efficient way. We propose active learning strategies that leverage…

Machine Learning · Computer Science 2020-12-08 Mona Buisson-Fenet , Friedrich Solowjow , Sebastian Trimpe

Traditional learning approaches for classification implicitly assume that each mistake has the same cost. In many real-world problems though, the utility of a decision depends on the underlying context $x$ and decision $y$. However,…

Machine Learning · Computer Science 2021-04-20 Kush Bhatia , Peter L. Bartlett , Anca D. Dragan , Jacob Steinhardt

In the world of big data, large but costly to label datasets dominate many fields. Active learning, a semi-supervised alternative to the standard PAC-learning model, was introduced to explore whether adaptive labeling could learn concepts…

Machine Learning · Computer Science 2020-06-02 Max Hopkins , Daniel M. Kane , Shachar Lovett

Active learning aims to reduce annotation cost by predicting which samples are useful for a human expert to label. Although this field is quite old, several important challenges to using active learning in real-world settings still remain…

Machine Learning · Computer Science 2021-04-27 Louis Desreumaux , Vincent Lemaire

Active learning, a powerful paradigm in machine learning, aims at reducing labeling costs by selecting the most informative samples from an unlabeled dataset. However, the traditional active learning process often demands extensive…

Machine Learning · Computer Science 2024-01-17 Gábor Németh , Tamás Matuszka

In missions constrained by finite resources, efficient data collection is critical. Informative path planning, driven by automated decision-making, optimizes exploration by reducing the costs associated with accurate characterization of a…

Robotics · Computer Science 2024-11-04 Sapphira Akins , Hans Mertens , Frances Zhu

In this work, we define cost-free learning (CFL) formally in comparison with cost-sensitive learning (CSL). The main difference between them is that a CFL approach seeks optimal classification results without requiring any cost information,…

Machine Learning · Computer Science 2013-07-23 Xiaowan Zhang , Bao-Gang Hu

In many practical applications of learning algorithms, unlabeled data is cheap and abundant whereas labeled data is expensive. Active learning algorithms developed to achieve better performance with lower cost. Usually Representativeness…

Machine Learning · Computer Science 2016-08-26 Hossein Ghafarian , Hadi Sadoghi Yazdi

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

We propose a new active learning algorithm for parametric linear regression with random design. We provide finite sample convergence guarantees for general distributions in the misspecified model. This is the first active learner for this…

Machine Learning · Statistics 2018-11-21 Sivan Sabato , Remi Munos

Frequently, acquiring training data has an associated cost. We consider the situation where the learner may purchase data during training, subject TO a budget. IN particular, we examine the CASE WHERE each feature label has an associated…

Machine Learning · Computer Science 2012-12-12 Daniel J. Lizotte , Omid Madani , Russell Greiner

It is widely believed that given the same labeling budget, active learning (AL) algorithms like margin-based active learning achieve better predictive performance than passive learning (PL), albeit at a higher computational cost. Recent…

Machine Learning · Computer Science 2023-06-05 Alexandru Tifrea , Jacob Clarysse , Fanny Yang

Continual learning is an emerging paradigm in machine learning, wherein a model is exposed in an online fashion to data from multiple different distributions (i.e. environments), and is expected to adapt to the distribution change.…

Machine Learning · Computer Science 2022-03-29 Binghui Peng , Andrej Risteski

Recent studies in active learning, particularly in uncertainty sampling, have focused on the decomposition of model uncertainty into reducible and irreducible uncertainties. In this paper, the aim is to simplify the computational process…

Machine Learning · Computer Science 2024-05-28 Arthur Hoarau , Vincent Lemaire , Arnaud Martin , Jean-Christophe Dubois , Yolande Le Gall

Discriminative learning machines often need a large set of labeled samples for training. Active learning (AL) settings assume that the learner has the freedom to ask an oracle to label its desired samples. Traditional AL algorithms…

Machine Learning · Statistics 2018-05-24 Arash Mehrjou , Mehran Khodabandeh , Greg Mori

Active learning is of great interest for many practical applications, especially in industry and the physical sciences, where there is a strong need to minimize the number of costly experiments necessary to train predictive models. However,…

Machine Learning · Computer Science 2021-12-23 Maryam Pardakhti , Nila Mandal , Anson W. K. Ma , Qian Yang

Over the years, a plethora of cost-sensitive methods have been proposed for learning on data when different types of misclassification errors incur different costs. Our contribution is a unifying framework that provides a comprehensive and…

Machine Learning · Computer Science 2020-07-16 George Petrides , Wouter Verbeke

Prediction APIs offered for a fee are a fast-growing industry and an important part of machine learning as a service. While many such services are available, the heterogeneity in their price and performance makes it challenging for users to…

Machine Learning · Computer Science 2020-06-16 Lingjiao Chen , Matei Zaharia , James Zou

Active learning allows machine learning models to be trained using fewer labels while retaining similar performance to traditional supervised learning. An active learner selects the most informative data points, requests their labels, and…

Machine Learning · Computer Science 2023-11-22 Zac Pullar-Strecker , Katharina Dost , Eibe Frank , Jörg Wicker