English
Related papers

Related papers: Self-Weighted Ensemble Method to Adjust the Influe…

200 papers

In machine learning, ensembles are important tools for improving the model performance. In natural language processing specifically, ensembles boost the performance of a method due to multiple large models available in open source. However,…

Machine Learning · Computer Science 2025-01-30 Polina Proskura , Alexey Zaytsev

This paper investigates novel classifier ensemble techniques for uncertainty calibration applied to various deep neural networks for image classification. We evaluate both accuracy and calibration metrics, focusing on Expected Calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Michael Schulze , Nikolas Ebert , Laurenz Reichardt , Oliver Wasenmüller

Mixture modeling, which considers the potential heterogeneity in data, is widely adopted for classification and clustering problems. Mixture models can be estimated using the Expectation-Maximization algorithm, which works with the complete…

Methodology · Statistics 2022-03-18 Shonosuke Sugasawa , Genya Kobayashi

Software effort estimation accuracy is a key factor in effective planning, controlling and to deliver a successful software project within budget and schedule. The overestimation and underestimation both are the key challenges for future…

Software Engineering · Computer Science 2021-01-27 Yasir Mahmood , Nazri Kama , Azri Azmi , Ahmad Salman Khan , Mazlan Ali

Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems…

Uncertainty estimation and ensembling methods go hand-in-hand. Uncertainty estimation is one of the main benchmarks for assessment of ensembling performance. At the same time, deep learning ensembles have provided state-of-the-art results…

Machine Learning · Statistics 2021-07-20 Arsenii Ashukha , Alexander Lyzhov , Dmitry Molchanov , Dmitry Vetrov

We give a mathematical framework for weighted ensemble (WE) sampling, a binning and resampling technique for efficiently computing probabilities in molecular dynamics. We prove that WE sampling is unbiased in a very general setting that…

Numerical Analysis · Mathematics 2018-10-17 David Aristoff

Sharing medical data between institutions is difficult in practice due to data protection laws and official procedures within institutions. Therefore, most existing algorithms are trained on relatively small electroencephalogram (EEG) data…

Uncertainty estimation in deep learning has become a leading research field in medical image analysis due to the need for safe utilisation of AI algorithms in clinical practice. Most approaches for uncertainty estimation require sampling…

Image and Video Processing · Electrical Eng. & Systems 2022-04-12 Kaisar Kushibar , Víctor Manuel Campello , Lidia Garrucho Moras , Akis Linardos , Petia Radeva , Karim Lekadir

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

Machine Learning · Computer Science 2021-10-19 Gaëlle Candel , David Naccache

We extend the weighted ensemble (WE) path sampling method to perform rigorous statistical sampling for systems at steady state. The straightforward steady-state implementation of WE is directly practical for simple landscapes, but not when…

Biological Physics · Physics 2015-05-14 Divesh Bhatt , Bin W. Zhang , Daniel M. Zuckerman

It remains difficult to evaluate machine learning classifiers in the absence of a large, labeled dataset. While labeled data can be prohibitively expensive or impossible to obtain, unlabeled data is plentiful. Here, we introduce…

Machine Learning · Computer Science 2025-10-15 Divya Shanmugam , Shuvom Sadhuka , Manish Raghavan , John Guttag , Bonnie Berger , Emma Pierson

The performance of deep neural networks scales with dataset size and label quality, rendering the efficient mitigation of low-quality data annotations crucial for building robust and cost-effective systems. Existing strategies to address…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Francesco Di Salvo , Sebastian Doerrich , Ines Rieger , Christian Ledig

Improvement of time series forecasting accuracy through combining multiple models is an important as well as a dynamic area of research. As a result, various forecasts combination methods have been developed in literature. However, most of…

Artificial Intelligence · Computer Science 2013-02-28 Ratnadip Adhikari , R. K. Agrawal

Deep ensembles (DE) have been successful in improving model performance by learning diverse members via the stochasticity of random initialization. While recent works have attempted to promote further diversity in DE via hyperparameters or…

Ensembling is a successful technique to improve the performance of machine learning (ML) models. Conf-Ensemble is an adaptation to Boosting to create ensembles based on model confidence instead of model errors to better classify difficult…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Rafael Rosales , Peter Popov , Michael Paulitsch

We propose an approach for adversarial attacks on dense prediction models (such as object detectors and segmentation). It is well known that the attacks generated by a single surrogate model do not transfer to arbitrary (blackbox) victim…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Zikui Cai , Yaoteng Tan , M. Salman Asif

Real-world robotics applications demand object pose estimation methods that work reliably across a variety of scenarios. Modern learning-based approaches require large labeled datasets and tend to perform poorly outside the training domain.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Jingnan Shi , Rajat Talak , Dominic Maggio , Luca Carlone

Ensemble learning has gain attention in resent deep learning research as a way to further boost the accuracy and generalizability of deep neural network (DNN) models. Recent ensemble training method explores different training algorithms or…

Machine Learning · Computer Science 2023-01-20 Jingchi Zhang , Huanrui Yang , Hai Li

Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, and obtaining diverse…

Machine Learning · Statistics 2019-06-10 Waldyn Martinez