English
Related papers

Related papers: Developing parsimonious ensembles using ensemble d…

200 papers

We investigate ensemble methods for prediction in an online setting. Unlike all the literature in ensembling, for the first time, we introduce a new approach using a meta learner that effectively combines the base model predictions via…

Machine Learning · Computer Science 2022-12-01 Arda Fazla , Mustafa Enes Aydin , Orhun Tamyigit , Suleyman Serdar Kozat

Ensemble methods in machine learning aim to improve prediction accuracy by combining multiple models. This is achieved by ensuring diversity among predictors to capture different data aspects. Homogeneous ensembles use identical models,…

Quantum Physics · Physics 2025-11-04 Emiliano Tolotti , Enrico Blanzieri , Davide Pastorello

The combination of multiple classifiers using ensemble methods is increasingly important for making progress in a variety of difficult prediction problems. We present a comparative analysis of several ensemble methods through two case…

Machine Learning · Computer Science 2013-09-20 Sean Whalen , Gaurav Pandey

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Ensemble learning is a very prevalent method employed in machine learning. The relative success of ensemble methods is attributed to their ability to tackle a wide range of instances and complex problems that require different low-level…

Machine Learning · Computer Science 2021-05-18 Rohan Saphal , Balaraman Ravindran , Dheevatsa Mudigere , Sasikanth Avancha , Bharat Kaul

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

This work proposes a unified framework for portfolio allocation, covering both asset selection and optimization, based on a multiple-hypothesis predict-then-optimize approach. The portfolio is modeled as a structured ensemble, where each…

Portfolio Management · Quantitative Finance 2025-11-19 Alejandro Rodriguez Dominguez , Muhammad Shahzad , Xia Hong

Ensemble classifiers have been investigated by many in the artificial intelligence and machine learning community. Majority voting and weighted majority voting are two commonly used combination schemes in ensemble learning. However,…

Machine Learning · Computer Science 2021-06-17 Shengli Wu , Weimin Ding

It is well known that ensemble methods often provide enhanced performance in reinforcement learning. In this paper, we explore this concept further by using group-aided training within the distributional reinforcement learning paradigm.…

Machine Learning · Computer Science 2020-05-25 Björn Lindenberg , Jonas Nordqvist , Karl-Olof Lindahl

Ensemble learning has gain attention in resent deep learning research as a way to further boost the accuracy and generalizability of deep neural network (DNN) models. Recent ensemble training method explores different training algorithms or…

Machine Learning · Computer Science 2023-01-20 Jingchi Zhang , Huanrui Yang , Hai Li

Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift. \emph{Deep ensembles}, a state-of-the-art method for uncertainty…

Machine Learning · Computer Science 2022-02-23 Sheheryar Zaidi , Arber Zela , Thomas Elsken , Chris Holmes , Frank Hutter , Yee Whye Teh

The ensemble methods are meta-algorithms that combine several base machine learning techniques to increase the effectiveness of the classification. Many existing committees of classifiers use the classifier selection process to determine…

Machine Learning · Computer Science 2021-06-15 Robert Burduk

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

We present a novel approach for the construction of ensemble classifiers based on dimensionality reduction. Dimensionality reduction methods represent datasets using a small number of attributes while preserving the information conveyed by…

Machine Learning · Computer Science 2013-05-21 Alon Schclar , Lior Rokach , Amir Amit

Ensemble learning is a method that leverages weak learners to produce a strong learner. However, obtaining a large number of base learners requires substantial time and computational resources. Therefore, it is meaningful to study how to…

Machine Learning · Computer Science 2024-08-13 Jinghui Yuan , Weijin Jiang , Zhe Cao , Fangyuan Xie , Rong Wang , Feiping Nie , Yuan Yuan

Deep ensembles have recently gained popularity in the deep learning community for their conceptual simplicity and efficiency. However, maintaining functional diversity between ensemble members that are independently trained with gradient…

Machine Learning · Computer Science 2023-03-29 Francesco D'Angelo , Vincent Fortuin

Ensemble learning combines several individual models to obtain a better generalization performance. In this work we present a practical method for estimating the joint power of several classifiers. It differs from existing approaches which…

Artificial Intelligence · Computer Science 2023-12-22 Simi Haber , Yonatan Wexler

Ensemble of predictions is known to perform better than individual predictions taken separately. However, for tasks that require heavy computational resources, e.g. semantic segmentation, creating an ensemble of learners that needs to be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Walid Bousselham , Guillaume Thibault , Lucas Pagano , Archana Machireddy , Joe Gray , Young Hwan Chang , Xubo Song

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

Machine Learning · Computer Science 2021-10-19 Gaëlle Candel , David Naccache

For many practical, high-risk applications, it is essential to quantify uncertainty in a model's predictions to avoid costly mistakes. While predictive uncertainty is widely studied for neural networks, the topic seems to be under-explored…

Machine Learning · Computer Science 2021-04-05 Andrey Malinin , Liudmila Prokhorenkova , Aleksei Ustimenko