English
Related papers

Related papers: Popular Ensemble Methods: An Empirical Study

200 papers

Recommending appropriate algorithms to a classification problem is one of the most challenging issues in the field of data mining. The existing algorithm recommendation models are generally constructed on only one kind of meta-features by…

Information Retrieval · Computer Science 2021-06-08 Guangtao Wang , Qinbao Song , Xiaoyan Zhu

Classifier ensembles are pattern recognition structures composed of a set of classification algorithms (members), organized in a parallel way, and a combination method with the aim of increasing the classification accuracy of a…

Stakeholders make various types of decisions with respect to requirements, design, management, and so on during the software development life cycle. Nevertheless, these decisions are typically not well documented and classified due to…

Software Engineering · Computer Science 2021-05-05 Liming Fu , Peng Liang , Xueying Li , Chen Yang

Vote-boosting is a sequential ensemble learning method in which the individual classifiers are built on different weighted versions of the training data. To build a new classifier, the weight of each training instance is determined in terms…

Machine Learning · Computer Science 2018-02-22 Maryam Sabzevari , Gonzalo Martínez-Muñoz , Alberto Suárez

In this paper we examine the effect of applying ensemble learning to the performance of collaborative filtering methods. We present several systematic approaches for generating an ensemble of collaborative filtering models based on a single…

Information Retrieval · Computer Science 2012-11-14 Ariel Bar , Lior Rokach , Guy Shani , Bracha Shapira , Alon Schclar

Ensembles are a straightforward, remarkably effective method for improving the accuracy,calibration, and robustness of models on classification tasks; yet, the reasons that underlie their success remain an active area of research. We build…

Machine Learning · Statistics 2022-06-22 Neha Gupta , Jamie Smith , Ben Adlam , Zelda Mariet

Label ranking is a prediction task which deals with learning a mapping between an instance and a ranking (i.e., order) of labels from a finite set, representing their relevance to the instance. Boosting is a well-known and reliable ensemble…

Machine Learning · Computer Science 2020-09-24 Lihi Dery , Erez Shmueli

We present the checkpoint ensembles method that can learn ensemble models on a single training process. Although checkpoint ensembles can be applied to any parametric iterative learning technique, here we focus on neural networks. Neural…

Machine Learning · Computer Science 2017-10-11 Hugh Chen , Scott Lundberg , Su-In Lee

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

We present Classy Ensemble, a novel ensemble-generation algorithm for classification tasks, which aggregates models through a weighted combination of per-class accuracy. Tested over 153 machine learning datasets we demonstrate that Classy…

Machine Learning · Computer Science 2024-01-12 Moshe Sipper

Classic results establish that encouraging predictive diversity improves performance in ensembles of low-capacity models, e.g. through bagging or boosting. Here we demonstrate that these intuitions do not apply to high-capacity neural…

Machine Learning · Computer Science 2024-01-11 Taiga Abe , E. Kelly Buchanan , Geoff Pleiss , John P. Cunningham

Bagging and boosting are proved to be the best methods of building multiple classifiers in classification combination problems. In the area of "flat clustering" problems, it is also recognized that multi-clustering methods based on boosting…

Machine Learning · Computer Science 2018-05-31 Elaheh Rashedi , Abdolreza Mirzaei

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

Ensemble learning has been a focal point of machine learning research due to its potential to improve predictive performance. This study revisits the foundational work on ensemble error decomposition, historically confined to…

Machine Learning · Computer Science 2024-02-13 João Mendes-Moreira , Tiago Mendes-Neves

Ensemble learning combines several individual models to obtain a better generalization performance. In this work we present a practical method for estimating the joint power of several classifiers. It differs from existing approaches which…

Artificial Intelligence · Computer Science 2023-12-22 Simi Haber , Yonatan Wexler

Accuracy predictor is trained to predict the validation accuracy of an network from its architecture encoding. It can effectively assist in designing networks and improving Neural Architecture Search(NAS) efficiency. However, a…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Ruyi Zhang , Ziwei Yang , Zhi Yang , Xubo Yang , Lei Wang , Zheyang Li

Ensemble classifiers have been investigated by many in the artificial intelligence and machine learning community. Majority voting and weighted majority voting are two commonly used combination schemes in ensemble learning. However,…

Machine Learning · Computer Science 2021-06-17 Shengli Wu , Weimin Ding

Ensemble weather forecasts enable a measure of uncertainty to be attached to each forecast, by computing the ensemble's spread. However, generating an ensemble with a good spread-error relationship is far from trivial, and a wide range of…

Atmospheric and Oceanic Physics · Physics 2021-01-05 Sebastian Scher , Gabriele Messori

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

Predicting students' academic performance has been a research area of interest in recent years with many institutions focusing on improving the students' performance and the education quality. The analysis and prediction of students'…

Computers and Society · Computer Science 2020-06-11 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami