English
Related papers

Related papers: Cost-Sensitive Stacking: an Empirical Evaluation

200 papers

In predictive maintenance, model performance is usually assessed by means of precision, recall, and F1-score. However, employing the model with best performance, e.g. highest F1-score, does not necessarily result in minimum maintenance…

Machine Learning · Computer Science 2018-10-01 Stephan Spiegel , Fabian Mueller , Dorothea Weismann , John Bird

For large, real-world inductive learning problems, the number of training examples often must be limited due to the costs associated with procuring, preparing, and storing the training examples and/or the computational costs associated with…

Artificial Intelligence · Computer Science 2011-06-24 F. Provost , G. M. Weiss

Dataset scaling, also known as normalization, is an essential preprocessing step in a machine learning pipeline. It is aimed at adjusting attributes scales in a way that they all vary within the same range. This transformation is known to…

Machine Learning · Computer Science 2022-12-26 Lucas B. V. de Amorim , George D. C. Cavalcanti , Rafael M. O. Cruz

Ensembling methods are well known for improving prediction accuracy. However, they are limited in the sense that they cannot discriminate among component models effectively. In this paper, we propose stacking with auxiliary features that…

Computation and Language · Computer Science 2016-05-30 Nazneen Fatema Rajani , Raymond J. Mooney

In this paper, we explore a method for treating survival analysis as a classification problem. The method uses a "stacking" idea that collects the features and outcomes of the survival data in a large data frame, and then treats it as a…

Methodology · Statistics 2019-09-27 Chenyang Zhong , Robert Tibshirani

Ensemble Machine Learning (EML) techniques, especially stacking, have been shown to improve predictive performance by combining multiple base models. However, they are often criticized for their lack of interpretability. In this paper, we…

Machine Learning · Computer Science 2025-09-16 Moncef Garouani , Ayah Barhrhouj , Olivier Teste

The cost-sensitive classification problem plays a crucial role in mission-critical machine learning applications, and differs with traditional classification by taking the misclassification costs into consideration. Although being studied…

Machine Learning · Computer Science 2018-05-22 Parameswaran Kamalaruban , Robert C. Williamson

We propose a reinforcement learning based approach to tackle the cost-sensitive learning problem where each input feature has a specific cost. The acquisition process is handled through a stochastic policy which allows features to be…

Machine Learning · Computer Science 2016-07-14 Gabriella Contardo , Ludovic Denoyer , Thierry Artières

Many real-world combinatorial problems involve uncertain parameters, which can be predicted given contextual features and historical data. These `predict-then-optimize' or `contextual optimization' problems have gained significant…

Machine Learning · Computer Science 2026-05-19 Noah Schutte , Senne Berden , Tias Guns , Krzysztof Postek , Neil Yorke-Smith

Cost-sensitive learning relies on the availability of a known and fixed cost matrix. However, in some scenarios, the cost matrix is uncertain during training, and re-train a classifier after the cost matrix is specified would not be an…

Machine Learning · Computer Science 2012-09-11 Rui Wang , Ke Tang

Stakeholders make various types of decisions with respect to requirements, design, management, and so on during the software development life cycle. Nevertheless, these decisions are typically not well documented and classified due to…

Software Engineering · Computer Science 2021-05-05 Liming Fu , Peng Liang , Xueying Li , Chen Yang

Class imbalance poses a major challenge for machine learning as most supervised learning models might exhibit bias towards the majority class and under-perform in the minority class. Cost-sensitive learning tackles this problem by treating…

Machine Learning · Computer Science 2022-09-20 Vasileios Iosifidis , Symeon Papadopoulos , Bodo Rosenhahn , Eirini Ntoutsi

Decision tree is an effective classification approach in data mining and machine learning. In applications, test costs and misclassification costs should be considered while inducing decision trees. Recently, some cost-sensitive learning…

Artificial Intelligence · Computer Science 2012-11-20 Zilong Xu , Fan Min , William Zhu

Postselection is the process of discarding outcomes from statistical trials that are not the event one desires. Postselection can be useful in many applications where the cost of getting the wrong event is implicitly high. However, unless…

Quantum Physics · Physics 2015-09-01 Joshua Combes , Christopher Ferrie

While both cost-sensitive learning and online learning have been studied extensively, the effort in simultaneously dealing with these two issues is limited. Aiming at this challenge task, a novel learning framework is proposed in this…

Machine Learning · Computer Science 2013-10-31 Boyu Wang , Joelle Pineau

Conventional active learning algorithms assume a single labeler that produces noiseless label at a given, fixed cost, and aim to achieve the best generalization performance for given classifier under a budget constraint. However, in many…

Machine Learning · Computer Science 2021-05-25 Ruijiang Gao , Maytal Saar-tsechansky

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

This study proposes a novel approach to ensemble prediction, called "covariate-dependent stacking" (CDST). Unlike traditional stacking and model averaging methods, CDST allows model weights to vary flexibly as a function of covariates,…

Methodology · Statistics 2025-09-29 Tomoya Wakayama , Shonosuke Sugasawa

Real-world applications that involve missing values are often constrained by the cost to obtain data. Test-cost sensitive, or costly feature, methods additionally consider the cost of acquiring features. Such methods have been extensively…

Machine Learning · Computer Science 2020-10-09 Seung Gyu Hyun , Christopher Leung

Some deep convolutional neural networks were proposed for time-series classification and class imbalanced problems. However, those models performed degraded and even failed to recognize the minority class of an imbalanced temporal sequences…

Machine Learning · Computer Science 2018-01-16 Yue Geng , Xinyu Luo