English
Related papers

Related papers: An empirical evaluation of ensemble adjustment met…

200 papers

Ensemble methods in machine learning aim to improve prediction accuracy by combining multiple models. This is achieved by ensuring diversity among predictors to capture different data aspects. Homogeneous ensembles use identical models,…

Quantum Physics · Physics 2025-11-04 Emiliano Tolotti , Enrico Blanzieri , Davide Pastorello

Through this project, we researched on transfer learning methods and their applications on real world problems. By implementing and modifying various methods in transfer learning for our problem, we obtained an insight in the advantages and…

Machine Learning · Computer Science 2017-07-11 Hailin Chen , Shengping Cui , Sebastian Li

Ensemble models can be used to estimate prediction uncertainties in machine learning models. However, an ensemble of N models is approximately N times more computationally demanding compared to a single model when it is used for inference.…

Machine Learning · Computer Science 2026-03-04 Vidit Agrawal , Shixin Zhang , Lane E. Schultz , Dane Morgan

With the advance of large language models (LLMs), LLMs have been utilized for the various tasks. However, the issues of variability and reproducibility of results from each trial of LLMs have been largely overlooked in existing literature…

Computation and Language · Computer Science 2025-05-08 Junichiro Niimi

A powerful way to improve performance in machine learning is to construct an ensemble that combines the predictions of multiple models. Ensemble methods are often much more accurate and lower variance than the individual classifiers that…

Machine Learning · Computer Science 2024-12-03 Antonio Macaluso , Luca Clissa , Stefano Lodi , Claudio Sartori

Extracting actionable intelligence from distributed, heterogeneous, correlated and high-dimensional data sources requires run-time processing and learning both locally and globally. In the last decade, a large number of meta-learning…

Machine Learning · Computer Science 2016-11-01 Cem Tekin , Jinsung Yoon , Mihaela van der Schaar

Tree-based ensemble methods such as random forests, gradient-boosted trees, and Bayesianadditive regression trees have been successfully used for regression problems in many applicationsand research studies. In this paper, we study ensemble…

Machine Learning · Statistics 2024-06-21 Alexandre Seiller , Éric Gaussier , Emilie Devijver , Marianne Clausel , Sami Alkhoury

Ensemble-based adversarial training is a principled approach to achieve robustness against adversarial attacks. An important technique of this approach is to control the transferability of adversarial examples among ensemble members. We…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Anh Bui , Trung Le , He Zhao , Paul Montague , Olivier deVel , Tamas Abraham , Dinh Phung

We describe various moment-based ensemble interpretation models for the construction of probabilistic temperature forecasts from ensembles. We apply the methods to one year of medium range ensemble forecasts and perform in and out of sample…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Stephen Jewson

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

Machine Learning · Computer Science 2021-10-19 Gaëlle Candel , David Naccache

Accurate time series forecasting is critical for a wide range of problems with temporal data. Ensemble modeling is a well-established technique for leveraging multiple predictive models to increase accuracy and robustness, as the…

Machine Learning · Computer Science 2023-04-11 Dimitris Bertsimas , Leonard Boussioux

Ensembles of neural networks achieve superior performance compared to stand-alone networks in terms of accuracy, uncertainty calibration and robustness to dataset shift. \emph{Deep ensembles}, a state-of-the-art method for uncertainty…

Machine Learning · Computer Science 2022-02-23 Sheheryar Zaidi , Arber Zela , Thomas Elsken , Chris Holmes , Frank Hutter , Yee Whye Teh

Statistical and structural modeling represent two distinct approaches to data analysis. In this paper, we propose a set of novel methods for combining statistical and structural models for improved prediction and causal inference. Our first…

Econometrics · Economics 2020-06-11 Jiaming Mao , Jingzhi Xu

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning…

Machine Learning · Computer Science 2022-08-09 M. A. Ganaie , Minghui Hu , A. K. Malik , M. Tanveer , P. N. Suganthan

Creating models from past observations and ensuring their effectiveness on new data is the essence of machine learning. However, selecting models that generalize well remains a challenging task. Related to this topic, the Rashomon Effect…

Machine Learning · Computer Science 2025-10-14 Gianlucca Zuin , Adriano Veloso

Ensembles of artificial neural networks show improved generalization capabilities that outperform those of single networks. However, for aggregation to be effective, the individual networks must be as accurate and diverse as possible. An…

Artificial Intelligence · Computer Science 2007-05-23 P. M. Granitto , P. F. Verdes , H. A. Ceccatto

The chaotic nature of fluid flow and the uncertainties in initial conditions limit predictability. Small errors that occur in the initial condition can grow exponentially until they saturate at $\mathcal{O}$(1). Ensemble forecasting…

Numerical Analysis · Mathematics 2024-07-16 Rui Fang

In recent years, multi-label classification problem has become a controversial issue. In this kind of classification, each sample is associated with a set of class labels. Ensemble approaches are supervised learning algorithms in which an…

Machine Learning · Computer Science 2018-01-09 Amirreza Mahdavi-Shahri , Mahboobeh Houshmand , Mahdi Yaghoobi , Mehrdad Jalali

Speech classification has attracted increasing attention due to its wide applications, particularly in classifying physical and mental states. However, these tasks are challenging due to the high variability in speech signals. Ensemble…

Audio and Speech Processing · Electrical Eng. & Systems 2024-07-25 Bagus Tris Atmaja , Felix Burkhardt

Ensemble Machine Learning (EML) techniques, especially stacking, have been shown to improve predictive performance by combining multiple base models. However, they are often criticized for their lack of interpretability. In this paper, we…

Machine Learning · Computer Science 2025-09-16 Moncef Garouani , Ayah Barhrhouj , Olivier Teste