English
Related papers

Related papers: Unsupervised Estimation of Ensemble Accuracy

200 papers

Classifier ensembles are pattern recognition structures composed of a set of classification algorithms (members), organized in a parallel way, and a combination method with the aim of increasing the classification accuracy of a…

One of the most promising approaches for complex technical systems analysis employs ensemble methods of classification. Ensemble methods enable to build a reliable decision rules for feature space classification in the presence of many…

Artificial Intelligence · Computer Science 2016-01-11 Alexei Zhukov , Victor Kurbatsky , Nikita Tomin , Denis Sidorov , Daniil Panasetsky , Aoife Foley

Training reliable respiratory sound classification models remains challenging due to the limited size and subject diversity of datasets. Ensemble methods can improve robustness, but when base models are trained on identical data, models…

Machine Learning · Computer Science 2026-04-28 June-Woo Kim , Miika Toikkanen , Heejoon Koo , Yoon Tae Kim , Doyoung Kwon , Kyunghoon Kim

Consider making a prediction over new test data without any opportunity to learn from a training set of labelled data - instead given access to a set of expert models and their predictions alongside some limited information about the…

Machine Learning · Computer Science 2022-10-12 Alex J. Chan , Mihaela van der Schaar

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

Ensemble methods can deliver surprising performance gains but also bring significantly higher computational costs, e.g., can be up to 2048X in large-scale ensemble tasks. However, we found that the majority of computations in ensemble…

Machine Learning · Computer Science 2023-01-31 Ziyue Li , Kan Ren , Yifan Yang , Xinyang Jiang , Yuqing Yang , Dongsheng Li

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning…

Machine Learning · Computer Science 2022-08-09 M. A. Ganaie , Minghui Hu , A. K. Malik , M. Tanveer , P. N. Suganthan

Modern deep neural networks can produce badly calibrated predictions, especially when train and test distributions are mismatched. Training an ensemble of models and averaging their predictions can help alleviate these issues. We propose a…

Machine Learning · Computer Science 2020-07-09 Asa Cooper Stickland , Iain Murray

The use of ensembles of neural networks (NNs) for the quantification of predictive uncertainty is widespread. However, the current justification is intuitive rather than analytical. This work proposes one minor modification to the normal…

Machine Learning · Statistics 2018-07-03 Tim Pearce , Nicolas Anastassacos , Mohamed Zaki , Andy Neely

Uncertainty estimation is essential to make neural networks trustworthy in real-world applications. Extensive research efforts have been made to quantify and reduce predictive uncertainty. However, most existing works are designed for…

Machine Learning · Computer Science 2022-10-07 Myong Chol Jung , He Zhao , Joanna Dipnall , Belinda Gabbe , Lan Du

Ensemble learning is widely applied in Machine Learning (ML) to improve model performance and to mitigate decision risks. In this approach, predictions from a diverse set of learners are combined to obtain a joint decision. Recently,…

Machine Learning · Computer Science 2020-07-14 Yingshui Tan , Baihong Jin , Xiangyu Yue , Yuxin Chen , Alberto Sangiovanni Vincentelli

We present a method for calibrating the Ensemble of Exemplar SVMs model. Unlike the standard approach, which calibrates each SVM independently, our method optimizes their joint performance as an ensemble. We formulate joint calibration as a…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Davide Modolo , Alexander Vezhnevets , Olga Russakovsky , Vittorio Ferrari

Deep ensembles are a powerful tool in machine learning, improving both model performance and uncertainty calibration. While ensembles are typically formed by training and tuning models individually, evidence suggests that jointly tuning the…

Machine Learning · Computer Science 2025-11-10 Laurits Fredsgaard , Mikkel N. Schmidt

A necessary characteristic for the deployment of deep learning models in real world applications is resistance to small adversarial perturbations while maintaining accuracy on non-malicious inputs. While robust training provides models that…

Machine Learning · Statistics 2020-02-27 Aditya Saligrama , Guillaume Leclerc

A common approach to aggregate classification estimates in an ensemble of decision trees is to either use voting or to average the probabilities for each class. The latter takes uncertainty into account, but not the reliability of the…

Machine Learning · Computer Science 2022-08-17 Florian Busch , Moritz Kulessa , Eneldo Loza Mencía , Hendrik Blockeel

We present new methods for multilabel classification, relying on ensemble learning on a collection of random output graphs imposed on the multilabel and a kernel-based structured output learner as the base classifier. For ensemble learning,…

Machine Learning · Computer Science 2013-11-19 Hongyu Su , Juho Rousu

The applications of artificial intelligence (AI) are rapidly evolving, and they are also commonly used in safety-critical domains, such as autonomous driving and medical diagnosis, where functional safety is paramount. In AI-driven systems,…

Machine Learning · Computer Science 2024-05-12 Soyed Tuhin Ahmed , Michael Hefenbrock , Mehdi B. Tahoori

Ensemble learning has been a focal point of machine learning research due to its potential to improve predictive performance. This study revisits the foundational work on ensemble error decomposition, historically confined to…

Machine Learning · Computer Science 2024-02-13 João Mendes-Moreira , Tiago Mendes-Neves

Classification is one of the most important tasks in Machine Learning (ML) and with recent advancements in artificial intelligence (AI) it is important to find efficient ways to implement it. Generally, the choice of classification…

Machine Learning · Computer Science 2023-12-27 Anuja Dixit , Shreya Byreddy , Guanqun Song , Ting Zhu

In this paper, we propose a novel framework that combines ensemble learning with augmented graph structures to improve the performance and robustness of semi-supervised node classification in graphs. By creating multiple augmented views of…

Machine Learning · Computer Science 2025-03-25 Maryam Abdolali , Romina Zakerian , Behnam Roshanfekr , Fardin Ayar , Mohammad Rahmati