English
Related papers

Related papers: An empirical evaluation of ensemble adjustment met…

200 papers

Ensembling has a long history in statistical data analysis, with many impactful applications. However, in many modern machine learning settings, the benefits of ensembling are less ubiquitous and less obvious. We study, both theoretically…

Machine Learning · Statistics 2023-05-23 Ryan Theisen , Hyunsuk Kim , Yaoqing Yang , Liam Hodgkinson , Michael W. Mahoney

Ensembling is a simple and popular technique for boosting evaluation performance by training multiple models (e.g., with different initializations) and aggregating their predictions. This approach is commonly reserved for the largest…

Machine Learning · Computer Science 2020-05-05 Dan Kondratyuk , Mingxing Tan , Matthew Brown , Boqing Gong

Ensemble methods can deliver surprising performance gains but also bring significantly higher computational costs, e.g., can be up to 2048X in large-scale ensemble tasks. However, we found that the majority of computations in ensemble…

Machine Learning · Computer Science 2023-01-31 Ziyue Li , Kan Ren , Yifan Yang , Xinyang Jiang , Yuqing Yang , Dongsheng Li

Ensembling is a powerful technique for improving the accuracy of machine learning models, with methods like stacking achieving strong results in tabular tasks. In time series forecasting, however, ensemble methods remain underutilized, with…

Machine Learning · Computer Science 2025-11-20 Nathanael Bosch , Oleksandr Shchur , Nick Erickson , Michael Bohlke-Schneider , Caner Türkmen

As a common method in Machine Learning, Ensemble Method is used to train multiple models from a data set and obtain better results through certain combination strategies. Stacking method, as representatives of Ensemble Learning methods, is…

Machine Learning · Computer Science 2020-09-15 Jiacheng Ruan , Jiahao Li

Machine Reading Comprehension (MRC) is an active field in natural language processing with many successful developed models in recent years. Despite their high in-distribution accuracy, these models suffer from two issues: high training…

Computation and Language · Computer Science 2021-07-16 Razieh Baradaran , Hossein Amirkhani

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

Improvement of time series forecasting accuracy through combining multiple models is an important as well as a dynamic area of research. As a result, various forecasts combination methods have been developed in literature. However, most of…

Artificial Intelligence · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

Ensemble techniques are powerful approaches that combine several weak learners to build a stronger one. As a meta-learning framework, ensemble techniques can easily be applied to many machine learning methods. Inspired by ensemble…

Machine Learning · Computer Science 2018-10-29 Hamideh Hajiabadi , Reza Monsefi , Hadi Sadoghi Yazdi

Given the continuous increase in dataset sizes and the complexity of forecasting models, the trade-off between forecast accuracy and computational cost is emerging as an extremely relevant topic, especially in the context of ensemble…

Machine Learning · Computer Science 2025-07-10 Marco Zanotti

We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from low robustness against…

Computation and Language · Computer Science 2025-04-22 Behzad Shayegh , Hobie H. -B. Lee , Xiaodan Zhu , Jackie Chi Kit Cheung , Lili Mou

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

In machine learning, ensembles are important tools for improving the model performance. In natural language processing specifically, ensembles boost the performance of a method due to multiple large models available in open source. However,…

Machine Learning · Computer Science 2025-01-30 Polina Proskura , Alexey Zaytsev

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

Machine learning-based Deepfake detection models have achieved impressive results on benchmark datasets, yet their performance often deteriorates significantly when evaluated on out-of-distribution data. In this work, we investigate an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haroon Wahab , Hassan Ugail , Lujain Jaleel

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assigns to base models a set of deterministic, constant model weights that (1) do not fully account for variations in base model accuracy…

Machine Learning · Computer Science 2018-12-20 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

It is well known that ensemble methods often provide enhanced performance in reinforcement learning. In this paper, we explore this concept further by using group-aided training within the distributional reinforcement learning paradigm.…

Machine Learning · Computer Science 2020-05-25 Björn Lindenberg , Jonas Nordqvist , Karl-Olof Lindahl

Semantic similarity measures are a key component in natural language processing tasks such as document analysis, requirement matching, and user input interpretation. However, the performance of individual measures varies considerably across…

Computation and Language · Computer Science 2025-04-28 Jorge Martinez-Gil

Software testing is one of the important ways to ensure the quality of software. It is found that testing cost more than 50% of overall project cost. Effective and efficient software testing utilizes the minimum resources of software.…

Machine Learning · Computer Science 2020-09-01 Ali Nawaz , Attique Ur Rehman , Muhammad Abbas

Ensemble models are powerful model building tools that are developed with a focus to improve the accuracy of model predictions. They find applications in time series forecasting in varied scenarios including but not limited to process…