English
Related papers

Related papers: Nonparametric active learning for cost-sensitive c…

200 papers

We develop the first active learning method for contextual linear optimization. Specifically, we introduce a label acquisition algorithm that sequentially decides whether to request the ``labels'' of feature samples from an unlabeled data…

Machine Learning · Computer Science 2025-01-31 Mo Liu , Paul Grigas , Heyuan Liu , Zuo-Jun Max Shen

In missions constrained by finite resources, efficient data collection is critical. Informative path planning, driven by automated decision-making, optimizes exploration by reducing the costs associated with accurate characterization of a…

Robotics · Computer Science 2024-11-04 Sapphira Akins , Hans Mertens , Frances Zhu

We propose an active learning algorithm for linear system identification with optimal centered noise excitation. Notably, our algorithm, based on ordinary least squares and semidefinite programming, attains the minimal sample complexity…

Optimization and Control · Mathematics 2026-04-08 Kaito Ito , Alexandre Proutiere

When solving decision and optimisation problems, many competing algorithms (model and solver choices) have complementary strengths. Typically, there is no single algorithm that works well for all instances of a problem. Automated algorithm…

Machine Learning · Computer Science 2025-06-11 Erdem Kuş , Özgür Akgün , Nguyen Dang , Ian Miguel

Conformal prediction (CP) is a general framework to quantify the predictive uncertainty of machine learning models that uses a set prediction to include the true label with a valid probability. To align the uncertainty measured by CP,…

Machine Learning · Computer Science 2025-11-25 Xuesong Jia , Yuanjie Shi , Ziquan Liu , Yi Xu , Yan Yan

Cost-sensitive classification is critical in applications where misclassification errors widely vary in cost. However, over-parameterization poses fundamental challenges to the cost-sensitive modeling of deep neural networks (DNNs). The…

Machine Learning · Computer Science 2024-04-01 Qiyuan Chen , Raed Al Kontar , Maher Nouiehed , Jessie Yang , Corey Lester

A framework is introduced for actively and adaptively solving a sequence of machine learning problems, which are changing in bounded manner from one time step to the next. An algorithm is developed that actively queries the labels of the…

Machine Learning · Computer Science 2018-05-31 Yuheng Bu , Jiaxun Lu , Venugopal V. Veeravalli

Nonparametric learning is a fundamental concept in machine learning that aims to capture complex patterns and relationships in data without making strong assumptions about the underlying data distribution. Owing to simplicity and…

Machine Learning · Computer Science 2024-02-06 Amartya Banerjee , Christopher J. Hazard , Jacob Beel , Cade Mack , Jack Xia , Michael Resnick , Will Goddin

Cost-Sensitive Online Classification has drawn extensive attention in recent years, where the main approach is to directly online optimize two well-known cost-sensitive metrics: (i) weighted sum of sensitivity and specificity; (ii) weighted…

Machine Learning · Computer Science 2019-11-19 Peilin Zhao , Yifan Zhang , Min Wu , Steven C. H. Hoi , Mingkui Tan , Junzhou Huang

It is necessary to improve the performance of some special classes or to particularly protect them from attacks in adversarial learning. This paper proposes a framework combining cost-sensitive classification and adversarial learning…

Machine Learning · Computer Science 2022-06-24 Haojing Shen , Sihong Chen , Ran Wang , Xizhao Wang

We study agnostic active learning, where the goal is to learn a classifier in a pre-specified hypothesis class interactively with as few label queries as possible, while making no assumptions on the true function generating the labels. The…

Machine Learning · Computer Science 2014-07-15 Chicheng Zhang , Kamalika Chaudhuri

Labeling data correctly is an expensive and challenging task in machine learning, especially for on-line data streams. Deep learning models especially require a large number of clean labeled data that is very difficult to acquire in…

Machine Learning · Computer Science 2020-10-28 Taraneh Younesian , Dick Epema , Lydia Y. Chen

Deep neural networks have reached high accuracy on object detection but their success hinges on large amounts of labeled data. To reduce the labels dependency, various active learning strategies have been proposed, typically based on the…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Ismail Elezi , Zhiding Yu , Anima Anandkumar , Laura Leal-Taixe , Jose M. Alvarez

In supervised learning, acquiring labeled training data for a predictive model can be very costly, but acquiring a large amount of unlabeled data is often quite easy. Active learning is a method of obtaining predictive models with high…

Machine Learning · Computer Science 2020-12-17 Hideitsu Hino

Distributed minimax estimation and distributed adaptive estimation under communication constraints for Gaussian sequence model and white noise model are studied. The minimax rate of convergence for distributed estimation over a given Besov…

Statistics Theory · Mathematics 2021-07-02 T. Tony Cai , Hongji Wei

We study the problem of computationally and label efficient PAC active learning $d$-dimensional halfspaces with Tsybakov Noise~\citep{tsybakov2004optimal} under structured unlabeled data distributions. Inspired…

Machine Learning · Computer Science 2024-07-23 Yinan Li , Chicheng Zhang

Class imbalance poses a major challenge for machine learning as most supervised learning models might exhibit bias towards the majority class and under-perform in the minority class. Cost-sensitive learning tackles this problem by treating…

Machine Learning · Computer Science 2022-09-20 Vasileios Iosifidis , Symeon Papadopoulos , Bodo Rosenhahn , Eirini Ntoutsi

Active learning (AL) is a sequential learning scheme aiming to select the most informative data. AL reduces data consumption and avoids the cost of labeling large amounts of data. However, AL trains the model and solves an acquisition…

Machine Learning · Computer Science 2025-01-13 Cen-You Li , Marc Toussaint , Barbara Rakitsch , Christoph Zimmer

Over the years, a plethora of cost-sensitive methods have been proposed for learning on data when different types of misclassification errors incur different costs. Our contribution is a unifying framework that provides a comprehensive and…

Machine Learning · Computer Science 2020-07-16 George Petrides , Wouter Verbeke

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith