English
Related papers

Related papers: Adaptive Ensemble Prediction for Deep Neural Netwo…

200 papers

Recent work has shown that models trained to the same objective, and which achieve similar measures of accuracy on consistent test data, may nonetheless behave very differently on individual predictions. This inconsistency is undesirable in…

Machine Learning · Computer Science 2021-11-17 Emily Black , Klas Leino , Matt Fredrikson

Large Language Models (LLMs) have demonstrated impressive performance across various tasks, with different models excelling in distinct domains and specific abilities. Effectively combining the predictions of multiple LLMs is crucial for…

Computation and Language · Computer Science 2025-08-01 Jizhou Guo

Transferring a deep neural network trained on one problem to another requires only a small amount of data and little additional computation time. The same behaviour holds for ensembles of deep learning models typically superior to a single…

Machine Learning · Computer Science 2022-06-28 Ilya Shashkov , Nikita Balabin , Evgeny Burnaev , Alexey Zaytsev

Ensembles over neural network weights trained from different random initialization, known as deep ensembles, achieve state-of-the-art accuracy and calibration. The recently introduced batch ensembles provide a drop-in replacement that is…

Machine Learning · Computer Science 2021-01-11 Florian Wenzel , Jasper Snoek , Dustin Tran , Rodolphe Jenatton

Ensemble learning is a mainstay in modern data science practice. Conventional ensemble algorithms assign to base models a set of deterministic, constant model weights that (1) do not fully account for individual models' varying accuracy…

Methodology · Statistics 2019-04-02 Jeremiah Zhe Liu , John Paisley , Marianthi-Anna Kioumourtzoglou , Brent A. Coull

In machine learning ensembles predictions from multiple models are aggregated. Despite widespread use and strong performance of ensembles in applied problems little is known about the mathematical properties of aggregating models and…

Machine Learning · Computer Science 2024-08-27 Jeremy Kedziora

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial…

Machine Learning · Statistics 2017-04-07 Cheng Ju , Aurélien Bibaut , Mark J. van der Laan

Deep neural networks represent the gold standard for image classification. However, they usually need large amounts of data to reach superior performance. In this work, we focus on image classification problems with a few labeled examples…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Lorenzo Brigato , Luca Iocchi

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Deep neural networks are behind many of the recent successes in machine learning applications. However, these models can produce overconfident decisions while encountering out-of-distribution (OOD) examples or making a wrong prediction.…

Machine Learning · Computer Science 2021-06-24 Navid Kardan , Ankit Sharma , Kenneth O. Stanley

Averaging predictions over a set of models -- an ensemble -- is widely used to improve predictive performance and uncertainty estimation of deep learning models. At the same time, many machine learning systems, such as search, matching, and…

Machine Learning · Computer Science 2021-07-15 Arsenii Ashukha , Andrei Atanov , Dmitry Vetrov

Ensembles of independently trained neural networks are a state-of-the-art approach to estimate predictive uncertainty in Deep Learning, and can be interpreted as an approximation of the posterior distribution via a mixture of delta…

Machine Learning · Computer Science 2022-07-11 Aleksei Tiulpin , Matthew B. Blaschko

Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for…

Machine Learning · Computer Science 2023-04-11 Yangjun Ruan , Saurabh Singh , Warren Morningstar , Alexander A. Alemi , Sergey Ioffe , Ian Fischer , Joshua V. Dillon

Ensemble learning serves as a straightforward way to improve the performance of almost any machine learning algorithm. Existing deep ensemble methods usually naively train many different models and then aggregate their predictions. This is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-15 Le Zhang , Qibin Hou , Yun Liu , Jia-Wang Bian , Xun Xu , Joey Tianyi Zhou , Ce Zhu

Neural network (NN) ensembles can reduce large prediction variance of NN and improve prediction accuracy. For highly nonlinear problems with insufficient data set, the prediction accuracy of NN models becomes unstable, resulting in a…

Machine Learning · Computer Science 2022-10-20 Ungki Lee , Namwoo Kang

Deep neural networks have become the method of choice for solving many classification tasks, largely because they can fit very complex functions defined over raw data. The downside of such powerful learners is the danger of overfit. In this…

Machine Learning · Computer Science 2023-12-29 Uri Stern , Daniel Shwartz , Daphna Weinshall

It is well recognized that the project productivity is a key driver in estimating software project effort from Use Case Point size metric at early software development stages. Although, there are few proposed models for predicting…

Machine Learning · Computer Science 2018-12-18 Mohammad Azzeh , Ali Bou Nassif , Shadi Banitaan , Cuauhtemoc Lopez-Martin

In resource-constrained and low-latency settings, uncertainty estimates must be efficiently obtained. Deep Ensembles provide robust epistemic uncertainty (EU) but require training multiple full-size models. BatchEnsemble aims to deliver…

Machine Learning · Computer Science 2026-01-26 Anton Zamyatin , Patrick Indri , Sagar Malhotra , Thomas Gärtner

The aim of this paper is to propose a suitable method for constructing prediction intervals for the output of neural network models. To do this, we adapt the extremely randomized trees method originally developed for random forests to…

Machine Learning · Statistics 2021-05-14 Tullio Mancini , Hector Calvo-Pardo , Jose Olmo

The Learning Rate (LR) has a high impact on deep learning training performance. A common practice is to train a Deep Neural Network (DNN) multiple times with different LR policies to find the optimal LR policy, which has been widely…

Machine Learning · Computer Science 2024-10-11 Hongpeng Jin , Yanzhao Wu