English
Related papers

Related papers: Generating Efficient DNN-Ensembles with Evolutiona…

200 papers

The ensemble of deep neural networks has been shown, both theoretically and empirically, to improve generalization accuracy on the unseen test set. However, the high training cost hinders its efficiency since we need a sufficient number of…

Machine Learning · Computer Science 2021-12-28 Wentao Zhang , Jiawei Jiang , Yingxia Shao , Bin Cui

This paper proposes a new extension to Deep Evolutionary Network Structured Evolution (DENSER), called Fast-DENSER++ (F-DENSER++). The vast majority of NeuroEvolution methods that optimise Deep Artificial Neural Networks (DANNs) only…

Neural and Evolutionary Computing · Computer Science 2019-05-09 Filipe Assunção , Nuno Lourenço , Penousal Machado , Bernardete Ribeiro

Ensemble techniques are frequently encountered in machine learning and engineering problems since the method combines different models and produces an optimal predictive solution. The ensemble concept can be adapted to deep learning models…

The potential effects of conservation actions on threatened species can be predicted using ensemble ecosystem models by forecasting populations with and without intervention. These model ensembles commonly assume stable coexistence of…

Populations and Evolution · Quantitative Biology 2024-03-22 Sarah A. Vollert , Christopher Drovandi , Matthew P. Adams

Deep neural networks continue to show improved performance with increasing depth, an encouraging trend that implies an explosion in the possible permutations of network architectures and hyperparameters for which there is little intuitive…

Machine Learning · Statistics 2017-09-27 Emmanuel Dufourq , Bruce A. Bassett

The recent success of Deep Neural Networks (DNNs) has drastically improved the state of the art for many application domains. While achieving high accuracy performance, deploying state-of-the-art DNNs is a challenge since they typically…

Neural and Evolutionary Computing · Computer Science 2018-01-24 Hokchhay Tann , Soheil Hashemi , Sherief Reda

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

This paper presents a new approach for training two-stage object detection ensemble models, more specifically, Faster R-CNN models to estimate uncertainty. We propose training one Region Proposal Network(RPN) and multiple Fast R-CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Denis Mbey Akola , Gianni Franchi

Ensemble methods, traditionally built with independently trained de-correlated models, have proven to be efficient methods for reducing the remaining residual generalization error, which results in robust and accurate methods for real-world…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Henrique Siqueira , Sven Magg , Stefan Wermter

Data-efficient image classification is a challenging task that aims to solve image classification using small training data. Neural network-based deep learning methods are effective for image classification, but they typically require…

Neural and Evolutionary Computing · Computer Science 2022-12-05 Ying Bi , Bing Xue , Mengjie Zhang

Deep Neural Networks (DNNs) often rely on very large datasets for training. Given the large size of such datasets, it is conceivable that they contain certain samples that either do not contribute or negatively impact the DNN's…

Machine Learning · Computer Science 2020-11-10 Kashyap Chitta , Jose M. Alvarez , Elmar Haussmann , Clement Farabet

Graph matching is a commonly used technique in computer vision and pattern recognition. Recent data-driven approaches have improved the graph matching accuracy remarkably, whereas some traditional algorithm-based methods are more robust to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Haoru Tan , Chuang Wang , Sitong Wu , Xu-Yao Zhang , Fei Yin , Cheng-Lin Liu

Ensemble learning is a meta-learning approach that combines the predictions of multiple learners, demonstrating improved accuracy and robustness. Nevertheless, ensembling models like Convolutional Neural Networks (CNNs) result in high…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-16 Le Zhang , Onat Gungor , Flavio Ponzina , Tajana Rosing

Many evolutionary algorithms (EAs) take advantage of parallel evaluation of candidates. However, if evaluation times vary significantly, many worker nodes (i.e.,\ compute clients) are idle much of the time, waiting for the next generation…

Neural and Evolutionary Computing · Computer Science 2024-01-02 Jason Liang , Hormoz Shahrzad , Risto Miikkulainen

Ensemble learning is a process by which multiple base learners are strategically generated and combined into one composite learner. There are two features that are essential to an ensemble's performance, the individual accuracies of the…

Machine Learning · Computer Science 2021-09-30 Wenjing Li , Randy C. Paffenroth , David Berthiaume

In this paper, we present an Adaptive Ensemble Learning framework that aims to boost the performance of deep neural networks by intelligently fusing features through ensemble learning techniques. The proposed framework integrates ensemble…

Artificial Intelligence · Computer Science 2023-04-07 Neelesh Mungoli

Traditional machine learning approaches may fail to perform satisfactorily when dealing with complex data. In this context, the importance of data mining evolves w.r.t. building an efficient knowledge discovery and mining framework.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Abdul Mueed Hafiz , Ghulam Mohiuddin Bhat

Ensembling deep learning models is a shortcut to promote its implementation in new scenarios, which can avoid tuning neural networks, losses and training algorithms from scratch. However, it is difficult to collect sufficient accurate and…

Machine Learning · Computer Science 2020-12-04 Jun Yang , Fei Wang

Deep neural networks have enhanced the performance of decision making systems in many applications including image understanding, and further gains can be achieved by constructing ensembles. However, designing an ensemble of deep networks…

Machine Learning · Computer Science 2021-11-16 Sara Atito Ali Ahmed , Cemre Zor , Berrin Yanikoglu , Muhammad Awais , Josef Kittler