English
Related papers

Related papers: Aggregation of Classifiers: A Justifiable Informat…

200 papers

In this study, we propose a multicriteria group decision making (MCGDM) algorithm under uncertainty where data is collected as intervals. The proposed MCGDM algorithm aggregates the data, determines the optimal weights for criteria and…

Artificial Intelligence · Computer Science 2020-12-04 Hadi A. Khorshidi , Uwe Aickelin

We propose a method for combining probabilistic outputs of classifiers to make a single consensus class prediction when no further information about the individual classifiers is available, beyond that they have been trained for the same…

Machine Learning · Computer Science 2020-09-02 Jordan F. Masakuna , Simukai W. Utete , Steve Kroon

Ensembles of artificial neural networks show improved generalization capabilities that outperform those of single networks. However, for aggregation to be effective, the individual networks must be as accurate and diverse as possible. An…

Artificial Intelligence · Computer Science 2007-05-23 P. M. Granitto , P. F. Verdes , H. A. Ceccatto

An ensemble of classifiers combines several single classifiers to deliver a final prediction or classification decision. An increasingly provoking question is whether such systems can outperform the single best classifier. If so, what form…

Machine Learning · Computer Science 2022-09-07 Bhekisipho Twala , Eamon Molloy

A common approach to aggregate classification estimates in an ensemble of decision trees is to either use voting or to average the probabilities for each class. The latter takes uncertainty into account, but not the reliability of the…

Machine Learning · Computer Science 2022-08-17 Florian Busch , Moritz Kulessa , Eneldo Loza Mencía , Hendrik Blockeel

The dynamic ensemble selection of classifiers is an effective approach for processing label-imbalanced data classifications. However, such a technique is prone to overfitting, owing to the lack of regularization methods and the dependence…

Machine Learning · Computer Science 2020-11-09 Chen Wang , Chengyuan Deng , Zhoulu Yu , Dafeng Hui , Xiaofeng Gong , Ruisen Luo

With the huge success of deep learning, other machine learning paradigms have had to take back seat. Yet other models, particularly rule-based, are more readable and explainable and can even be competitive when labelled data is not…

Machine Learning · Computer Science 2020-07-07 Nitakshi Sood , Osmar Zaiane

Dynamic ensemble selection systems work by estimating the level of competence of each classifier from a pool of classifiers. Only the most competent ones are selected to classify a given test sample. This is achieved by defining a criterion…

Machine Learning · Computer Science 2020-03-06 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti , Tsang Ing Ren

An ensemble method should cleverly combine a group of base classifiers to yield an improved classifier. The majority vote is an example of a methodology used to combine classifiers in an ensemble method. In this paper, we propose to combine…

Machine Learning · Computer Science 2020-09-21 Rodolfo Anibal Lobo , Marcos Eduardo Valle

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

This paper proposes a simple yet powerful ensemble classifier, called Random Hyperboxes, constructed from individual hyperbox-based classifiers trained on the random subsets of sample and feature spaces of the training set. We also show a…

Machine Learning · Computer Science 2022-04-05 Thanh Tung Khuat , Bogdan Gabrys

Unsupervised learning, and more specifically clustering, suffers from the need for expertise in the field to be of use. Researchers must make careful and informed decisions on which algorithm to use with which set of hyperparameters for a…

Machine Learning · Computer Science 2021-12-28 Antoine Zambelli

In a broad range of classification and decision making problems, one is given the advice or predictions of several classifiers, of unknown reliability, over multiple questions or queries. This scenario is different from the standard…

Machine Learning · Statistics 2014-02-07 Fabio Parisi , Francesco Strino , Boaz Nadler , Yuval Kluger

A plethora of research has been done in the past focusing on predicting student's performance in order to support their development. Many institutions are focused on improving the performance and the education quality; and this can be…

Computers and Society · Computer Science 2020-05-15 MohammadNoor Injadat , Abdallah Moubayed , Ali Bou Nassif , Abdallah Shami

We investigate ensemble methods for prediction in an online setting. Unlike all the literature in ensembling, for the first time, we introduce a new approach using a meta learner that effectively combines the base model predictions via…

Machine Learning · Computer Science 2022-12-01 Arda Fazla , Mustafa Enes Aydin , Orhun Tamyigit , Suleyman Serdar Kozat

The exponential growth of scientific publications in recent years has posed a significant challenge in effective and efficient categorization. This paper introduces a novel approach that combines instance-based learning and ensemble…

Digital Libraries · Computer Science 2024-09-24 Fang Zhang , Shengli Wu

Data stream mining problem has caused widely concerns in the area of machine learning and data mining. In some recent studies, ensemble classification has been widely used in concept drift detection, however, most of them regard…

Data Structures and Algorithms · Computer Science 2017-08-14 Junhong Wang , Shuliang Xu , Bingqian Duan , Caifeng Liu , Jiye Liang

Uncertainty quantification is essential in decision-making, especially when joint distributions of random variables are involved. While conformal prediction provides distribution-free prediction sets with valid coverage guarantees, it…

Machine Learning · Computer Science 2025-01-03 Rui Luo , Zhixin Zhou

The importance of accurately quantifying forecast uncertainty has motivated much recent research on probabilistic forecasting. In particular, a variety of deep learning approaches has been proposed, with forecast distributions obtained as…

Machine Learning · Statistics 2024-11-11 Benedikt Schulz , Lutz Köhler , Sebastian Lerch

In this paper, we present an information-theoretic method for clustering mixed-type data, that is, data consisting of both continuous and categorical variables. The proposed approach extends the Information Bottleneck principle to…

Methodology · Statistics 2026-02-02 Efthymios Costa , Ioanna Papatsouma , Angelos Markos