English
Related papers

Related papers: Cost-Sensitive Stacking: an Empirical Evaluation

200 papers

We present a simple unified framework for multi-class cost-sensitive boosting. The minimum-risk class is estimated directly, rather than via an approximation of the posterior distribution. Our method jointly optimizes binary weak learners…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Ron Appel , Xavier Burgos-Artizzu , Pietro Perona

Stacking (or stacked generalization) is an ensemble learning method with one main distinctiveness from the rest: even though several base models are trained on the original data set, their predictions are further used as input data for one…

Machine Learning · Computer Science 2024-04-19 Ilya Ploshchik , Angelos Chatzimparmpas , Andreas Kerren

We consider the problem of Cost-Aware Learning, where sampling different component functions of a finite-sum objective incurs different costs. The objective is to reach a target error while minimizing the total cost. First, we propose the…

Machine Learning · Computer Science 2026-05-01 Clara Mohri , Amir Globerson , Haim Kaplan , Tomer Koren , Yishay Mansour

Label embedding (LE) is an important family of multi-label classification algorithms that digest the label information jointly for better performance. Different real-world applications evaluate performance by different cost functions of…

Machine Learning · Computer Science 2019-02-07 Kuan-Hao Huang , Hsuan-Tien Lin

In several applications of automatic diagnosis and active learning a central problem is the evaluation of a discrete function by adaptively querying the values of its variables until the values read uniquely determine the value of the…

Data Structures and Algorithms · Computer Science 2014-07-29 Ferdinando Cicalese , Eduardo Laber , Aline Medeiros Saettler

The gradient boosting machine is one of the powerful tools for solving regression problems. In order to cope with its shortcomings, an approach for constructing ensembles of gradient boosting models is proposed. The main idea behind the…

Machine Learning · Computer Science 2020-10-14 Andrei V. Konstantinov , Lev V. Utkin

Classification tasks play a fundamental role in various applications, spanning domains such as healthcare, natural language processing and computer vision. With the growing popularity and capacity of machine learning models, people can…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Dujian Ding , Bicheng Xu , Laks V. S. Lakshmanan

Consequential decision-making incentivizes individuals to strategically adapt their behavior to the specifics of the decision rule. While a long line of work has viewed strategic adaptation as gaming and attempted to mitigate its effects,…

Machine Learning · Computer Science 2020-02-19 John Miller , Smitha Milli , Moritz Hardt

The problem of detecting a single anomalous process among multiple independent processes is considered. Under a constraint on the number of processes that can be probed simultaneously, the decision maker should decide which processes to…

Signal Processing · Electrical Eng. & Systems 2021-01-15 Fengfan Qin , Da Chen , Hui Feng , Qing Zhao , Tao Yang , Bo Hu

Model uncertainty is pervasive in real world analysis situations and is an often-neglected issue in applied statistics. However, standard approaches to the research process do not address the inherent uncertainty in model building and,…

Methodology · Statistics 2024-03-01 Mariana Nold , Florian Meinfelder , David Kaplan

We consider the problem of sequentially making decisions that are rewarded by "successes" and "failures" which can be predicted through an unknown relationship that depends on a partially controllable vector of attributes for each instance.…

Machine Learning · Statistics 2017-09-18 Yingfei Wang , Chu Wang , Warren Powell

Early Classification of Time Series (ECTS) addresses decision-making problems in which predictions must be made as early as possible while maintaining high accuracy. Most existing ECTS methods assume that the time-dependent decision costs…

Machine Learning · Computer Science 2026-04-06 Aurélien Renault , Alexis Bondu , Antoine Cornuéjols , Vincent Lemaire

As data sets continue to grow in size and complexity, effective and efficient techniques are needed to target important features in the variable space. Many of the variable selection techniques that are commonly used alongside clustering…

Computation · Statistics 2013-03-22 Jeffrey L. Andrews , Paul D. McNicholas

It is increasingly common to encounter prediction tasks in the biomedical sciences for which multiple datasets are available for model training. Common approaches such as pooling datasets and applying standard statistical learning methods…

Machine Learning · Statistics 2021-10-05 Gabriel Loewinger , Rolando Acosta Nunez , Rahul Mazumder , Giovanni Parmigiani

In this paper, we present a novel sequential paradigm for classification in crowdsourcing systems. Considering that workers are unreliable and they perform the tests with errors, we study the construction of decision trees so as to minimize…

Machine Learning · Computer Science 2018-05-03 Baocheng Geng , Qunwei Li , Pramod K. Varshney

We study the problem of learning classifiers with a fairness constraint, with three main contributions towards the goal of quantifying the problem's inherent tradeoffs. First, we relate two existing fairness measures to cost-sensitive…

Machine Learning · Computer Science 2017-05-26 Aditya Krishna Menon , Robert C. Williamson

While there are many well-developed data science methods for classification and regression, there are relatively few methods for working with right-censored data. Here, we present "survival stacking": a method for casting survival analysis…

Methodology · Statistics 2021-07-29 Erin Craig , Chenyang Zhong , Robert Tibshirani

Background and objective: Stacking is an ensemble machine learning method that averages predictions from multiple other algorithms, such as generalized linear models and regression trees. An implementation of stacking, called super…

Machine Learning · Statistics 2019-08-01 Alexander P. Keil , Daniel Westreich , Jessie K Edwards , Stephen R Cole

Training high-quality instance segmentation models requires an abundance of labeled images with instance masks and classifications, which is often expensive to procure. Active learning addresses this challenge by striving for optimum…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Ke Yu , Stephen Albro , Giulia DeSalvo , Suraj Kothawade , Abdullah Rashwan , Sasan Tavakkol , Kayhan Batmanghelich , Xiaoqi Yin

Class imbalance is one of the challenging problems for machine learning in many real-world applications, such as coal and gas burst accident monitoring: the burst premonition data is extreme smaller than the normal data, however, which is…

Machine Learning · Computer Science 2017-02-07 Qiuyan Yan , Shixiong Xia , Fanrong Meng