English
Related papers

Related papers: How Ensemble Learning Balances Accuracy and Overfi…

200 papers

Most machine learning classifiers give predictions for new examples accurately, yet without indicating how trustworthy predictions are. In the medical domain, this hampers their integration in decision support systems, which could be useful…

Machine Learning · Computer Science 2018-07-06 Telma Pereira , Sandra Cardoso , Dina Silva , Manuela Guerreiro , Alexandre de Mendonça , Sara C. Madeira

Diffusion models now generate high-quality, diverse samples, with an increasing focus on more powerful models. Although ensembling is a well-known way to improve supervised models, its application to unconditional score-based diffusion…

Machine Learning · Computer Science 2026-01-22 Raphaël Razafindralambo , Rémy Sun , Frédéric Precioso , Damien Garreau , Pierre-Alexandre Mattei

Deep learning has become very popular for tasks such as predictive modeling and pattern recognition in handling big data. Deep learning is a powerful machine learning method that extracts lower level features and feeds them forward for the…

Machine Learning · Computer Science 2018-03-07 Steven Young , Tamer Abdou , Ayse Bener

This work presents a novel approach for selecting the optimal ensemble-based classification method and features with a primarly focus on achieving generalization, based on the state-of-the-art, to provide diagnostic support for Sickle Cell…

Machine Learning · Computer Science 2026-01-21 Nataša Petrović , Gabriel Moyà-Alcover , Antoni Jaume-i-Capó , Jose Maria Buades Rubio

We consider the problem of uncertainty quantification in high dimensional regression and classification for which deep ensemble have proven to be promising methods. Recent observations have shown that deep ensemble often return…

Machine Learning · Computer Science 2023-04-11 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez

Data augmentation forms the cornerstone of many modern machine learning training pipelines; yet, the mechanisms by which it works are not clearly understood. Much of the research on data augmentation (DA) has focused on improving existing…

Machine Learning · Computer Science 2023-04-13 Damien A. Dablain , Nitesh V. Chawla

Ensemble methods can deliver surprising performance gains but also bring significantly higher computational costs, e.g., can be up to 2048X in large-scale ensemble tasks. However, we found that the majority of computations in ensemble…

Machine Learning · Computer Science 2023-01-31 Ziyue Li , Kan Ren , Yifan Yang , Xinyang Jiang , Yuqing Yang , Dongsheng Li

Classification models for the automatic detection of abnormalities on histological samples do exists, with an active debate on the cost associated with false negative diagnosis (underdiagnosis) and false positive diagnosis (overdiagnosis).…

Computer Vision and Pattern Recognition · Computer Science 2015-05-18 Giancarlo Crocetti , Michael Coakley , Phil Dressner , Wanda Kellum , Tamba Lamin

Removing or filtering outliers and mislabeled instances prior to training a learning algorithm has been shown to increase classification accuracy. A popular approach for handling outliers and mislabeled instances is to remove any instance…

Machine Learning · Computer Science 2013-12-17 Michael R. Smith , Tony Martinez

We address unsupervised dependency parsing by building an ensemble of diverse existing models through post hoc aggregation of their output dependency parse structures. We observe that these ensembles often suffer from low robustness against…

Computation and Language · Computer Science 2025-04-22 Behzad Shayegh , Hobie H. -B. Lee , Xiaodan Zhu , Jackie Chi Kit Cheung , Lili Mou

Directly inspired by findings in biological vision, high-dimensional hypercolumns are feature vectors built by concatenating multi-scale activations of convolutional neural networks for a single image pixel location. Together with powerful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Julia Dietlmeier , Vayangi Ganepola , Oluwabukola G. Adegboro , Mayug Maniparambil , Claudia Mazo , Noel E. O'Connor

Ensemble classifiers have been investigated by many in the artificial intelligence and machine learning community. Majority voting and weighted majority voting are two commonly used combination schemes in ensemble learning. However,…

Machine Learning · Computer Science 2021-06-17 Shengli Wu , Weimin Ding

Tree-based ensemble methods such as random forests, gradient-boosted trees, and Bayesianadditive regression trees have been successfully used for regression problems in many applicationsand research studies. In this paper, we study ensemble…

Machine Learning · Statistics 2024-06-21 Alexandre Seiller , Éric Gaussier , Emilie Devijver , Marianne Clausel , Sami Alkhoury

We investigate the finite sample performance of sample splitting, cross-fitting and averaging for the estimation of the conditional average treatment effect. Recently proposed methods, so-called meta-learners, make use of machine learning…

Methodology · Statistics 2020-08-27 Daniel Jacob

Novel and high-performance medical image classification pipelines are heavily utilizing ensemble learning strategies. The idea of ensemble learning is to assemble diverse models or multiple predictions and, thus, boost prediction…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Dominik Müller , Iñaki Soto-Rey , Frank Kramer

Our work focuses on the problem of predicting the transfer of pediatric patients from the general ward of a hospital to the pediatric intensive care unit. Using data collected over 5.5 years from the electronic health records of two medical…

Machine Learning · Computer Science 2017-07-18 Jonathan Rubin , Cristhian Potes , Minnan Xu-Wilson , Junzi Dong , Asif Rahman , Hiep Nguyen , David Moromisato

Precise breast cancer classification on histopathological images has the potential to greatly improve the diagnosis and patient outcome in oncology. The data imbalance problem largely stems from the inherent imbalance within medical image…

Image and Video Processing · Electrical Eng. & Systems 2024-11-28 Majid Behzadpour , Bengie L. Ortiz , Ebrahim Azizi , Kai Wu

Many modern machine learning models are trained to achieve zero or near-zero training error in order to obtain near-optimal (but non-zero) test error. This phenomenon of strong generalization performance for "overfitted" / interpolated…

Machine Learning · Statistics 2018-10-29 Mikhail Belkin , Daniel Hsu , Partha Mitra

The motivation of this work is to improve the performance of standard stacking approaches or ensembles, which are composed of simple, heterogeneous base models, through the integration of the generation and selection stages for regression…

Machine Learning · Statistics 2014-03-31 Roberto Aldave , Jean-Pierre Dussault