English
Related papers

Related papers: Generating Efficient DNN-Ensembles with Evolutiona…

200 papers

Multivariate time series anomaly detection is a very common problem in the field of failure prevention. Fast prevention means lower repair costs and losses. The amount of sensors in novel industry systems makes the anomaly detection process…

Machine Learning · Computer Science 2021-11-24 Kamil Faber , Dominik Żurek , Marcin Pietroń , Kamil Piętak

For deep neural network accelerators, memory movement is both energetically expensive and can bound computation. Therefore, optimal mapping of tensors to memory hierarchies is critical to performance. The growing complexity of neural…

Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of domains. However, DNNs are becoming computationally intensive and energy hungry at an exponential pace, while at the same time, there is a vast demand for…

Deep Ensemble (DE) approach is a straightforward technique used to enhance the performance of deep neural networks by training them from different initial points, converging towards various local optima. However, a limitation of this…

Machine Learning · Computer Science 2024-04-25 Hyunsu Kim , Jongmin Yoon , Juho Lee

In this paper, we present MLEANN (Meta-Learning Evolutionary Artificial Neural Network), an automatic computational framework for the adaptive optimization of artificial neural networks wherein the neural network architecture, activation…

Artificial Intelligence · Computer Science 2007-05-23 Ajith Abraham

Data mining and data classification over biomedical data are two of the most important research fields in computer science. Among the great diversity of techniques that can be used for this purpose, Artifical Neural Networks (ANNs) is one…

Entity resolution targets at identifying records that represent the same real-world entity from one or more datasets. A major challenge in learning-based entity resolution is how to reduce the label cost for training. Due to the quadratic…

Machine Learning · Computer Science 2020-12-21 Jingyu Shao , Qing Wang , Asiri Wijesinghe , Erhard Rahm

Annotating the right data for training deep neural networks is an important challenge. Active learning using uncertainty estimates from Bayesian Neural Networks (BNNs) could provide an effective solution to this. Despite being theoretically…

Computer Vision and Pattern Recognition · Computer Science 2019-02-22 Kashyap Chitta , Jose M. Alvarez , Adam Lesnikowski

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

Ensemble learning is a general technique to improve accuracy in machine learning. However, the heavy computation of a ConvNets ensemble limits its usage in deep learning. In this paper, we present Group Ensemble Network (GENet), an…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hao Chen , Abhinav Shrivastava

The advancement of generative AI, particularly in medical imaging, confronts the trilemma of ensuring high fidelity, diversity, and efficiency in synthetic data generation. While Generative Adversarial Networks (GANs) have shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Lorenzo Tronchin , Tommy Löfstedt , Paolo Soda , Valerio Guarrasi

In temporal-difference reinforcement learning algorithms, variance in value estimation can cause instability and overestimation of the maximal target value. Many algorithms have been proposed to reduce overestimation, including several…

Machine Learning · Computer Science 2022-09-19 Litian Liang , Yaosheng Xu , Stephen McAleer , Dailin Hu , Alexander Ihler , Pieter Abbeel , Roy Fox

Learning ensembles by bagging can substantially improve the generalization performance of low-bias, high-variance estimators, including those evolved by Genetic Programming (GP). To be efficient, modern GP algorithms for evolving (bagging)…

Neural and Evolutionary Computing · Computer Science 2021-02-08 Marco Virgolin

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

Machine Learning · Computer Science 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

The evolutionary processes of complex systems contain critical information regarding their functional characteristics. The generation time of edges provides insights into the historical evolution of various networked complex systems, such…

Artificial Intelligence · Computer Science 2025-01-14 En Xu , Can Rong , Jingtao Ding , Yong Li

Time-series forecasting is one of the most active research topics in artificial intelligence. Applications in real-world time series should consider two factors for achieving reliable predictions: modeling dynamic dependencies among…

Machine Learning · Computer Science 2021-05-28 Gabriel Spadon , Shenda Hong , Bruno Brandoli , Stan Matwin , Jose F. Rodrigues-Jr , Jimeng Sun

Deep Ensembles, as a type of Bayesian Neural Networks, can be used to estimate uncertainty on the prediction of multiple neural networks by collecting votes from each network and computing the difference in those predictions. In this paper,…

Machine Learning · Computer Science 2023-07-10 Illia Oleksiienko , Alexandros Iosifidis

Neural network ensembles is a simple yet effective approach for enhancing generalization capabilities. The most common method involves independently training multiple neural networks initialized with different weights and then averaging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Shunsuke Sakai , Shunsuke Tsuge , Tatsuhito Hasegawa

The performance of deep neural networks is enhanced by ensemble methods, which average the output of several models. However, this comes at an increased cost at inference. Weight averaging methods aim at balancing the generalization of…

Machine Learning · Computer Science 2024-05-29 Louis Fournier , Adel Nabli , Masih Aminbeidokhti , Marco Pedersoli , Eugene Belilovsky , Edouard Oyallon