English
Related papers

Related papers: COMET: A Recipe for Learning and Using Large Ensem…

200 papers

We propose a novel "tree-averaging" model that utilizes the ensemble of classification and regression trees (CART). Each constituent tree is estimated with a subset of similar data. We treat this grouping of subsets as Bayesian ensemble…

Machine Learning · Statistics 2014-08-20 Leo L. Duan , John P. Clancy , Rhonda D. Szczesniak

Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending,…

Machine Learning · Statistics 2020-11-03 Mohsen Shahhosseini , Guiping Hu , Hieu Pham

Predictions in the form of probability distributions are crucial for effective decision-making. Quantile regression enables such predictions within spatial prediction settings that aim to create improved precipitation datasets by merging…

Machine Learning · Computer Science 2025-08-05 Georgia Papacharalampous , Hristos Tyralis , Nikolaos Doulamis , Anastasios Doulamis

Ensembles are popular methods for solving practical supervised learning problems. They reduce the risk of having underperforming models in production-grade software. Although critical, methods for learning heterogeneous regression ensembles…

Machine Learning · Computer Science 2018-04-18 Jihed Khiari , Luis Moreira-Matias , Ammar Shaker , Bernard Zenko , Saso Dzeroski

Ensemble methods for supervised machine learning have become popular due to their ability to accurately predict class labels with groups of simple, lightweight "base learners." While ensembles offer computationally efficient models that…

Machine Learning · Statistics 2011-09-01 Orianna DeMasi , Juan Meza , David H. Bailey

Ensemble learning remains a cornerstone of machine learning, with stacking used to integrate predictions from multiple base learners through a meta-model. However, deep stacking remains uncommon due to feature redundancy, complexity, and…

Machine Learning · Computer Science 2026-03-03 Çağatay Demirel

Random forests and, more generally, (decision\nobreakdash-)tree ensembles are widely used methods for classification and regression. Recent algorithmic advances allow to compute decision trees that are optimal for various measures such as…

Machine Learning · Computer Science 2024-09-25 Christian Komusiewicz , Pascal Kunz , Frank Sommer , Manuel Sorge

In this age of Big Data, machine learning based data mining methods are extensively used to inspect large scale data sets. Deriving applicable predictive modeling from these type of data sets is a challenging obstacle because of their high…

Machine Learning · Computer Science 2015-04-14 Ferhat Özgür Çatak

Multiple Object Tracking (MOT) has rapidly progressed in recent years. Existing works tend to design a single tracking algorithm to perform both detection and association. Though ensemble learning has been exploited in many tasks, i.e,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Yunhao Du , Zihang Liu , Fei Su

New proposals in the field of multi-label learning algorithms have been growing in number steadily over the last few years. The experimentation associated with each of them always goes through the same phases: selection of datasets,…

Machine Learning · Computer Science 2018-02-13 Francisco Charte , Antonio J. Rivera , David Charte , María J. del Jesus , Francisco Herrera

Ensemble clustering is a fundamental problem in the machine learning field, combining multiple base clusterings into a better clustering result. However, most of the existing methods are unsuitable for large-scale ensemble clustering tasks…

Machine Learning · Computer Science 2024-10-15 Hongmin Li , Xiucai Ye , Akira Imakura , Tetsuya Sakurai

In this paper, Bayesian based aggregation of decision trees in an ensemble (decision forest) is investigated. The focus is laid on multi-class classification with number of samples significantly skewed toward one of the classes. The…

Machine Learning · Computer Science 2021-07-27 Jan Brabec , Lukas Machlica

This thesis investigates dataset downsampling as a strategy to optimize energy efficiency in recommender systems while maintaining competitive performance. With increasing dataset sizes posing computational and environmental challenges,…

Information Retrieval · Computer Science 2025-02-17 Ardalan Arabzadeh

Mixed-effects models are fundamental tools for analyzing clustered and repeated-measures data, but existing high-dimensional methods largely focus on penalized estimation with vector-valued covariates. Bayesian alternatives in this regime…

Methodology · Statistics 2026-02-24 Sreya Sarkar , Kshitij Khare , Sanvesh Srivastava

We investigate ensemble methods for prediction in an online setting. Unlike all the literature in ensembling, for the first time, we introduce a new approach using a meta learner that effectively combines the base model predictions via…

Machine Learning · Computer Science 2022-12-01 Arda Fazla , Mustafa Enes Aydin , Orhun Tamyigit , Suleyman Serdar Kozat

We introduce hybrid classical-quantum algorithms for problems involving a large classical data set X and a space of models Y such that a quantum computer has superposition access to Y but not X. These algorithms use data reduction…

Quantum Physics · Physics 2020-04-07 Aram W. Harrow

Ensemble techniques in recommender systems have demonstrated accuracy improvements of 10-30%, yet their environmental impact remains unmeasured. While deep learning recommendation algorithms can generate up to 3,297 kg CO2 per paper,…

Information Retrieval · Computer Science 2025-11-18 Jannik Nitschke

Current quantum systems have significant limitations affecting the processing of large datasets with high dimensionality, typical of high energy physics. In the present paper, feature and data prototype selection techniques were studied to…

High Energy Physics - Phenomenology · Physics 2023-12-18 Miguel Caçador Peixoto , Nuno Filipe Castro , Miguel Crispim Romão , Maria Gabriela Jordão Oliveira , Inês Ochoa

Ensemble learning methods are designed to benefit from multiple learning algorithms for better predictive performance. The tradeoff of this improved performance is slower speed and larger size of ensemble learning systems compared to single…

Machine Learning · Computer Science 2021-01-22 Abolfazl Nadi , Hadi Moradi , Khalil Taheri

Falls are one of the important causes of accidental or unintentional injury death worldwide. Therefore, this paper presents a reliable fall detection algorithm and a mobile cloud collaboration system for fall detection. The algorithm is an…

Signal Processing · Electrical Eng. & Systems 2019-07-11 Tong Wu , Yang Gu , Yiqiang Chen , Yunlong Xiao , Jiwei Wang