English
Related papers

Related papers: MetaBags: Bagged Meta-Decision Trees for Regressio…

200 papers

Ensembles are a straightforward, remarkably effective method for improving the accuracy,calibration, and robustness of models on classification tasks; yet, the reasons that underlie their success remain an active area of research. We build…

Machine Learning · Statistics 2022-06-22 Neha Gupta , Jamie Smith , Ben Adlam , Zelda Mariet

Deep neural network ensembles hold the potential of improving generalization performance for complex learning tasks. This paper presents formal analysis and empirical evaluation to show that heterogeneous deep ensembles with high ensemble…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Yanzhao Wu , Ka-Ho Chow , Wenqi Wei , Ling Liu

Meta-learning is a tool that allows us to build sample-efficient learning systems. Here we show that, once meta-trained, LSTM Meta-Learners aren't just faster learners than their sample-inefficient deep learning (DL) and reinforcement…

Machine Learning · Computer Science 2019-05-07 Neil C. Rabinowitz

Extracting actionable intelligence from distributed, heterogeneous, correlated and high-dimensional data sources requires run-time processing and learning both locally and globally. In the last decade, a large number of meta-learning…

Machine Learning · Computer Science 2016-11-01 Cem Tekin , Jinsung Yoon , Mihaela van der Schaar

Ensemble learning has proven effective in boosting predictive performance, but traditional methods such as bagging, boosting, and dynamic ensemble selection (DES) suffer from high computational cost and limited adaptability to heterogeneous…

While deep learning has achieved phenomenal successes in many AI applications, its enormous model size and intensive computation requirements pose a formidable challenge to the deployment in resource-limited nodes. There has recently been…

Machine Learning · Computer Science 2020-12-01 Sen Lin , Li Yang , Zhezhi He , Deliang Fan , Junshan Zhang

The ensemble methods are meta-algorithms that combine several base machine learning techniques to increase the effectiveness of the classification. Many existing committees of classifiers use the classifier selection process to determine…

Machine Learning · Computer Science 2021-06-15 Robert Burduk

Compared to humans, machine learning models generally require significantly more training examples and fail to extrapolate from experience to solve previously unseen challenges. To help close this performance gap, we augment single-task…

Machine Learning · Computer Science 2018-07-27 Tailin Wu , John Peurifoy , Isaac L. Chuang , Max Tegmark

Learning ensembles by bagging can substantially improve the generalization performance of low-bias, high-variance estimators, including those evolved by Genetic Programming (GP). To be efficient, modern GP algorithms for evolving (bagging)…

Neural and Evolutionary Computing · Computer Science 2021-02-08 Marco Virgolin

As with any task, the process of building machine learning models can benefit from prior experience. Meta-learning for classifier selection leverages knowledge about the characteristics of different datasets and/or the past performance of…

Machine Learning · Computer Science 2025-08-26 Sebastian Maldonado , Carla Vairetti , Ignacio Figueroa

Supervised Learning is a way of developing Artificial Intelligence systems in which a computer algorithm is trained on labeled data inputs. Effectiveness of a Supervised Learning algorithm is determined by its performance on a given dataset…

Computers and Society · Computer Science 2024-10-29 Shubhi Bansal , Atharva Tendulkar , Nagendra Kumar

Ensemble learning has been a focal point of machine learning research due to its potential to improve predictive performance. This study revisits the foundational work on ensemble error decomposition, historically confined to…

Machine Learning · Computer Science 2024-02-13 João Mendes-Moreira , Tiago Mendes-Neves

Batch active learning is a popular approach for efficiently training machine learning models on large, initially unlabelled datasets by repeatedly acquiring labels for batches of data points. However, many recent batch active learning…

Machine Learning · Computer Science 2023-07-10 Andreas Kirsch

Dynamic ensemble selection (DES) techniques work by estimating the level of competence of each classifier from a pool of classifiers. Only the most competent ones are selected to classify a given test sample. Hence, the key issue in DES is…

Machine Learning · Computer Science 2015-09-14 Rafael M. O. Cruz , Robert Sabourin , George D. C. Cavalcanti

Meta-learning, or learning-to-learn, seeks to design algorithms that can utilize previous experience to rapidly learn new skills or adapt to new environments. Representation learning -- a key tool for performing meta-learning -- learns a…

Machine Learning · Computer Science 2022-01-04 Nilesh Tripuraneni , Chi Jin , Michael I. Jordan

Meta-learning is a popular framework for learning with limited data in which an algorithm is produced by training over multiple few-shot learning tasks. For classification problems, these tasks are typically constructed by sampling a small…

Machine Learning · Computer Science 2021-10-08 Amrith Setlur , Oscar Li , Virginia Smith

Deep learning has revolutionized many industries by enabling models to automatically learn complex patterns from raw data, reducing dependence on manual feature engineering. However, deep learning algorithms are sensitive to input data, and…

Machine Learning · Computer Science 2025-07-21 Mert Sehri , Zehui Hua , Francisco de Assis Boldt , Patrick Dumond

Several real-world classification problems are example-dependent cost-sensitive in nature, where the costs due to misclassification vary between examples and not only within classes. However, standard classification methods do not take…

Machine Learning · Computer Science 2015-05-19 Alejandro Correa Bahnsen , Djamila Aouada , Bjorn Ottersten

Ensemble of predictions is known to perform better than individual predictions taken separately. However, for tasks that require heavy computational resources, e.g. semantic segmentation, creating an ensemble of learners that needs to be…

Computer Vision and Pattern Recognition · Computer Science 2022-03-23 Walid Bousselham , Guillaume Thibault , Lucas Pagano , Archana Machireddy , Joe Gray , Young Hwan Chang , Xubo Song

Meta-learning is a framework for learning learning algorithms through repeated interactions with an environment as opposed to designing them by hand. In recent years, this framework has established itself as a promising tool for building…

Artificial Intelligence · Computer Science 2023-04-17 Marcel Binz , Ishita Dasgupta , Akshay Jagadish , Matthew Botvinick , Jane X. Wang , Eric Schulz