English
Related papers

Related papers: Divide, Specialize, and Route: A New Approach to E…

200 papers

Convolutional Neural Networks have achieved state-of-the-art performance on a wide range of tasks. Most benchmarks are led by ensembles of these powerful learners, but ensembling is typically treated as a post-hoc procedure implemented by…

Computer Vision and Pattern Recognition · Computer Science 2015-11-20 Stefan Lee , Senthil Purushwalkam , Michael Cogswell , David Crandall , Dhruv Batra

In this paper, a robust online sequential extreme learning machine (ROS-ELM) is proposed. It is based on the original OS-ELM with an adaptive selective ensemble framework. Two novel insights are proposed in this paper. First, a novel…

Machine Learning · Computer Science 2014-08-14 Yang Liu , Bo He , Diya Dong , Yue Shen , Tianhong Yan , Rui Nian , Amaury Lendase

Deep ensembles have emerged as a powerful technique for improving predictive performance and enhancing model robustness across various applications by leveraging model diversity. However, traditional deep ensemble methods are often…

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

Machine Learning · Computer Science 2024-12-23 Arnav Kharbanda , Advait Chandorkar

Decision-making in complex systems often relies on machine learning models, yet highly accurate models such as XGBoost and neural networks can obscure the reasoning behind their predictions. In operations research applications,…

Machine Learning · Computer Science 2025-02-28 Gaurav Arwade , Sigurdur Olafsson

In this age of Big Data, machine learning based data mining methods are extensively used to inspect large scale data sets. Deriving applicable predictive modeling from these type of data sets is a challenging obstacle because of their high…

Machine Learning · Computer Science 2015-04-14 Ferhat Özgür Çatak

Ensemble Machine Learning (EML) techniques, especially stacking, have been shown to improve predictive performance by combining multiple base models. However, they are often criticized for their lack of interpretability. In this paper, we…

Machine Learning · Computer Science 2025-09-16 Moncef Garouani , Ayah Barhrhouj , Olivier Teste

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Deep neural networks represent the gold standard for image classification. However, they usually need large amounts of data to reach superior performance. In this work, we focus on image classification problems with a few labeled examples…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Lorenzo Brigato , Luca Iocchi

Ensemble methods for supervised machine learning have become popular due to their ability to accurately predict class labels with groups of simple, lightweight "base learners." While ensembles offer computationally efficient models that…

Machine Learning · Statistics 2011-09-01 Orianna DeMasi , Juan Meza , David H. Bailey

A powerful way to improve performance in machine learning is to construct an ensemble that combines the predictions of multiple models. Ensemble methods are often much more accurate and lower variance than the individual classifiers that…

Machine Learning · Computer Science 2024-12-03 Antonio Macaluso , Luca Clissa , Stefano Lodi , Claudio Sartori

While both cost-sensitive learning and online learning have been studied extensively, the effort in simultaneously dealing with these two issues is limited. Aiming at this challenge task, a novel learning framework is proposed in this…

Machine Learning · Computer Science 2013-10-31 Boyu Wang , Joelle Pineau

Ensembles are popular methods for solving practical supervised learning problems. They reduce the risk of having underperforming models in production-grade software. Although critical, methods for learning heterogeneous regression ensembles…

Machine Learning · Computer Science 2018-04-18 Jihed Khiari , Luis Moreira-Matias , Ammar Shaker , Bernard Zenko , Saso Dzeroski

Automated Machine Learning with ensembling (or AutoML with ensembling) seeks to automatically build ensembles of Deep Neural Networks (DNNs) to achieve qualitative predictions. Ensemble of DNNs are well known to avoid over-fitting but they…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Recommending appropriate algorithms to a classification problem is one of the most challenging issues in the field of data mining. The existing algorithm recommendation models are generally constructed on only one kind of meta-features by…

Information Retrieval · Computer Science 2021-06-08 Guangtao Wang , Qinbao Song , Xiaoyan Zhu

Modern machine learning models (such as deep neural networks and boosting decision tree models) have become increasingly popular in financial market prediction, due to their superior capacity to extract complex non-linear patterns. However,…

Machine Learning · Computer Science 2021-02-02 Chuheng Zhang , Yuanqi Li , Xi Chen , Yifei Jin , Pingzhong Tang , Jian Li

Directly inspired by findings in biological vision, high-dimensional hypercolumns are feature vectors built by concatenating multi-scale activations of convolutional neural networks for a single image pixel location. Together with powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Julia Dietlmeier , Vayangi Ganepola , Oluwabukola G. Adegboro , Mayug Maniparambil , Claudia Mazo , Noel E. O'Connor

Representation learning and unsupervised learning are two central topics of machine learning and signal processing. Deep learning is one of the most effective unsupervised representation learning approach. The main contributions of this…

Machine Learning · Computer Science 2014-01-06 Xiao-Lei Zhang , Ji Wu

Advances in data collecting technologies in genomics have significantly increased the need for tools designed to study the genetic basis of many diseases. Effective statistical methods should excel in both prediction accuracy and biomarker…

Methodology · Statistics 2025-11-13 Anthony-Alexander Christidis , Stefan Van Aelst , Ruben Zamar

In big data applications, classical ensemble learning is typically infeasible on the raw input data and dimensionality reduction techniques are necessary. To this end, novel framework that generalises classic flat-view ensemble learning to…

Signal Processing · Electrical Eng. & Systems 2018-12-18 Ilia Kisil , Ahmad Moniri , Danilo P. Mandic