English
Related papers

Related papers: The Relative Performance of Ensemble Methods with …

200 papers

Deep learning has become the state of the art approach in many machine learning problems such as classification. It has recently been shown that deep learning is highly vulnerable to adversarial perturbations. Taking the camera systems of…

Machine Learning · Statistics 2018-02-09 Thilo Strauss , Markus Hanselmann , Andrej Junginger , Holger Ulmer

Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Kashyap Chitta , Jose M. Alvarez , Adam Lesnikowski

Obtaining labeled data for machine learning tasks can be prohibitively expensive. Active learning mitigates this issue by exploring the unlabeled data space and prioritizing the selection of data that can best improve the model performance.…

Machine Learning · Computer Science 2021-04-21 Vineeth Rakesh , Swayambhoo Jain

Deep ensembles have been empirically shown to be a promising approach for improving accuracy, uncertainty and out-of-distribution robustness of deep learning models. While deep ensembles were theoretically motivated by the bootstrap,…

Machine Learning · Statistics 2020-06-26 Stanislav Fort , Huiyi Hu , Balaji Lakshminarayanan

Automated Machine Learning with ensembling (or AutoML with ensembling) seeks to automatically build ensembles of Deep Neural Networks (DNNs) to achieve qualitative predictions. Ensemble of DNNs are well known to avoid over-fitting but they…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Unsupervised learning has always been appealing to machine learning researchers and practitioners, allowing them to avoid an expensive and complicated process of labeling the data. However, unsupervised learning of complex data is…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Evgenii Zheltonozhskii , Chaim Baskin , Alex M. Bronstein , Avi Mendelson

An ensemble method that fuses the output decision vectors of multiple feedforward-designed convolutional neural networks (FF-CNNs) to solve the image classification problem is proposed in this work. To enhance the performance of the…

Computer Vision and Pattern Recognition · Computer Science 2019-01-09 Yueru Chen , Yijing Yang , Wei Wang , C. -C. Jay Kuo

Ensemble methods for supervised machine learning have become popular due to their ability to accurately predict class labels with groups of simple, lightweight "base learners." While ensembles offer computationally efficient models that…

Machine Learning · Statistics 2011-09-01 Orianna DeMasi , Juan Meza , David H. Bailey

Ensemble learning combines several individual models to obtain better generalization performance. Currently, deep learning architectures are showing better performance compared to the shallow or traditional models. Deep ensemble learning…

Machine Learning · Computer Science 2022-08-09 M. A. Ganaie , Minghui Hu , A. K. Malik , M. Tanveer , P. N. Suganthan

In recent years, Convolutional Neural Networks (CNNs), MLP-mixers, and Vision Transformers have risen to prominence as leading neural architectures in image classification. Prior research has underscored the distinct advantages of each…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Mk Bashar , Ocean Monjur , Samia Islam , Mohammad Galib Shams , Niamul Quader

Neural network ensembles have been effectively used to improve generalization by combining the predictions of multiple independently trained models. However, the growing scale and complexity of deep neural networks have led to these methods…

Machine Learning · Computer Science 2024-07-09 Tim Whitaker

In multiclass deep network classifiers, the burden of classifying samples of different classes is put on a single classifier. As the result the optimum classification accuracy is not obtained. Also training times are large due to running…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Abdul Mueed Hafiz , Mahmoud Hassaballah

Ensemble techniques are frequently encountered in machine learning and engineering problems since the method combines different models and produces an optimal predictive solution. The ensemble concept can be adapted to deep learning models…

Recognizing text in the wild is a really challenging task because of complex backgrounds, various illuminations and diverse distortions, even with deep neural networks (convolutional neural networks and recurrent neural networks). In the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-11 Chun Yang , Xu-Cheng Yin , Zejun Li , Jianwei Wu , Chunchao Guo , Hongfa Wang , Lei Xiao

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

Convolutional Networks have dominated the field of computer vision for the last ten years, exhibiting extremely powerful feature extraction capabilities and outstanding classification performance. The main strategy to prolong this trend…

Computer Vision and Pattern Recognition · Computer Science 2021-06-07 Javier Huertas-Tato , Alejandro Martín , Julián Fierrez , David Camacho

Ensemble learning, the machine learning paradigm where multiple algorithms are combined, has exhibited promising perfomance in a variety of tasks. The present work focuses on unsupervised ensemble classification. The term unsupervised…

Machine Learning · Computer Science 2020-12-22 Panagiotis A. Traganitis , Georgios B. Giannakis

Deep neural networks have achieved outstanding performance over various tasks, but they have a critical issue: over-confident predictions even for completely unknown samples. Many studies have been proposed to successfully filter out these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Jihyo Kim , Jiin Koo , Sangheum Hwang

We investigate ensemble methods for prediction in an online setting. Unlike all the literature in ensembling, for the first time, we introduce a new approach using a meta learner that effectively combines the base model predictions via…

Machine Learning · Computer Science 2022-12-01 Arda Fazla , Mustafa Enes Aydin , Orhun Tamyigit , Suleyman Serdar Kozat

Deep neural networks have enhanced the performance of decision making systems in many applications including image understanding, and further gains can be achieved by constructing ensembles. However, designing an ensemble of deep networks…

Machine Learning · Computer Science 2021-11-16 Sara Atito Ali Ahmed , Cemre Zor , Berrin Yanikoglu , Muhammad Awais , Josef Kittler