English
Related papers

Related papers: Beyond Point Estimate: Inferring Ensemble Predicti…

200 papers

Efficiently and meaningfully estimating prediction uncertainty is important for exploration in active learning campaigns in materials discovery, where samples with high uncertainty are interpreted as containing information missing from the…

Materials Science · Physics 2025-11-25 Ashley S. Dale , Kangming Li , Brian DeCost , Hao Wan , Yuchen Han , Yao Fehlis , Jason Hattrick-Simpers

In this work, we propose an ensemble forecasting approach based on randomized neural networks. Improved randomized learning streamlines the fitting abilities of individual learners by generating network parameters in accordance with the…

Machine Learning · Computer Science 2021-07-12 Grzegorz Dudek , Paweł Pełka

While deep neural networks (DNN) have become an effective computational tool, the prediction results are often criticized by the lack of interpretability, which is essential in many real-world applications such as health informatics.…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Mengnan Du , Ninghao Liu , Qingquan Song , Xia Hu

Ensemble prediction systems are an invaluable tool for weather forecasting. Practically, ensemble predictions are obtained by running several perturbations of the deterministic control forecast. However, ensemble prediction is associated…

Machine Learning · Computer Science 2023-02-22 Rüdiger Brecht , Alex Bihlo

This work studies ensemble learning for graph neural networks (GNNs) under the popular semi-supervised setting. Ensemble learning has shown superiority in improving the accuracy and robustness of traditional machine learning by combining…

Machine Learning · Computer Science 2024-05-07 Xin Zhang , Daochen Zha , Qiaoyu Tan

Predicting a driver's cognitive state, or more specifically, modeling a driver's reaction time (RT) in response to the appearance of a potential hazard warrants urgent research. In the last two decades, the electric field that is generated…

Human-Computer Interaction · Computer Science 2019-05-28 Chun-Hsiang Chuang , Zehong Cao , Po-Tsang Chen , Chih-Sheng Huang , Nikhil R. Pal , Chin-Teng Lin

Ensemble learning is a method of combining multiple trained models to improve model accuracy. We propose the usage of such methods, specifically ensemble average, inside Convolutional Neural Network (CNN) architectures by replacing the…

Machine Learning · Computer Science 2019-08-08 Abduallah Mohamed , Xinrui Hua , Xianda Zhou , Christian Claudel

The widespread use of Deep Neural Networks (DNNs) has recently resulted in their application to challenging scientific visualization tasks. While advanced DNNs demonstrate impressive generalization abilities, understanding factors like…

Graphics · Computer Science 2024-08-13 Atul Kumar , Siddharth Garg , Soumya Dutta

The success of deep active learning hinges on the choice of an effective acquisition function, which ranks not yet labeled data points according to their expected informativeness. Many acquisition functions are (partly) based on the…

Machine Learning · Computer Science 2023-11-08 Mohamadsadegh Khosravani , Sandra Zilles

In this paper, we propose a novel ensembling technique for deep neural networks, which is able to drastically reduce the required memory compared to alternative approaches. In particular, we propose to extract multiple sub-networks from a…

Machine Learning · Computer Science 2022-10-07 Jary Pomponi , Simone Scardapane , Aurelio Uncini

In the low-data regime, it is difficult to train good supervised models from scratch. Instead practitioners turn to pre-trained models, leveraging transfer learning. Ensembling is an empirically and theoretically appealing way to construct…

Machine Learning · Computer Science 2020-10-20 Basil Mustafa , Carlos Riquelme , Joan Puigcerver , André Susano Pinto , Daniel Keysers , Neil Houlsby

In Domain Generalization (DG) settings, models trained independently on a given set of training domains have notoriously chaotic performance on distribution shifted test domains, and stochasticity in optimization (e.g. seed) plays a big…

Machine Learning · Computer Science 2022-10-14 Devansh Arpit , Huan Wang , Yingbo Zhou , Caiming Xiong

Ensemble weather predictions require statistical post-processing of systematic errors to obtain reliable and accurate probabilistic forecasts. Traditionally, this is accomplished with distributional regression models in which the parameters…

Machine Learning · Statistics 2019-04-01 Stephan Rasp , Sebastian Lerch

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

Ensemble learning has been a focal point of machine learning research due to its potential to improve predictive performance. This study revisits the foundational work on ensemble error decomposition, historically confined to…

Machine Learning · Computer Science 2024-02-13 João Mendes-Moreira , Tiago Mendes-Neves

This work addresses the challenge of providing consistent explanations for predictive models in the presence of model indeterminacy, which arises due to the existence of multiple (nearly) equally well-performing models for a given dataset…

Machine Learning · Computer Science 2023-06-14 Dan Ley , Leonard Tang , Matthew Nazari , Hongjin Lin , Suraj Srinivas , Himabindu Lakkaraju

Objective: This paper investigates the potential of ensemble learning for variants of adjustment methods used in analogy-based effort estimation. The number k of analogies to be used is also investigated. Method We perform a large scale…

Software Engineering · Computer Science 2017-03-20 Mohammad Azzeh , Ali Bou Nassif , Leandro L Minku

Deep neural networks (DNN) are versatile parametric models utilised successfully in a diverse number of tasks and domains. However, they have limitations---particularly from their lack of robustness and over-sensitivity to out of…

Machine Learning · Statistics 2020-01-01 John Mitros , Brian Mac Namee

In the field of machine learning, ensemble learning is widely recognized as a pivotal strategy for pushing the boundaries of predictive performance. Traditional static ensemble methods typically assign weights by treating each base learner…

Machine Learning · Computer Science 2026-03-06 Yanxin Liu , Yunqi Zhang

The ability to estimate epistemic uncertainty is often crucial when deploying machine learning in the real world, but modern methods often produce overconfident, uncalibrated uncertainty predictions. A common approach to quantify epistemic…