English
Related papers

Related papers: A Deep Neural Networks ensemble workflow from hype…

200 papers

With the growth of deep learning, how to describe deep neural networks unifiedly is becoming an important issue. We first formalize neural networks mathematically with their directed graph representations, and prove a generation theorem…

Machine Learning · Computer Science 2018-05-11 Yujian Li , Chuanhui Shan

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

Much research work in computer vision is being spent on optimizing existing network architectures to obtain a few more percentage points on benchmarks. Recent AutoML approaches promise to relieve us from this effort. However, they are…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Tonmoy Saikia , Yassine Marrakchi , Arber Zela , Frank Hutter , Thomas Brox

As a human choosing a supervised learning algorithm, it is natural to begin by reading a text description of the dataset and documentation for the algorithms you might use. We demonstrate that the same idea improves the performance of…

Machine Learning · Computer Science 2019-10-10 Iddo Drori , Lu Liu , Yi Nian , Sharath C. Koorathota , Jie S. Li , Antonio Khalil Moretti , Juliana Freire , Madeleine Udell

Recently, Deep Convolutional Neural Network (DCNN) has achieved tremendous success in many machine learning applications. Nevertheless, the deep structure has brought significant increases in computation complexity. Largescale deep learning…

Neural and Evolutionary Computing · Computer Science 2018-05-14 Zhe Li , Ji Li , Ao Ren , Caiwen Ding , Jeffrey Draper , Qinru Qiu , Bo Yuan , Yanzhi Wang

Deep neural networks ( DNNs ) are becoming a key enabling technology for many application domains. However, on-device inference on battery-powered, resource-constrained embedding systems is often infeasible due to prohibitively long…

Machine Learning · Computer Science 2019-11-13 Vicent Sanz Marco , Ben Taylor , Zheng Wang , Yehia Elkhatib

Detection Transformer (DETR) and its variants show strong performance on object detection, a key task for autonomous systems. However, a critical limitation of these models is that their confidence scores only reflect semantic uncertainty,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yutong Yang , Katarina Popović , Julian Wiederer , Markus Braun , Vasileios Belagiannis , Bin Yang

In this paper, we propose a novel learning paradigm called "DeepFlorist" for flower classification using ensemble learning as a meta-classifier. DeepFlorist combines the power of deep learning with the robustness of ensemble methods to…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Afshin Khadangi

Aggregating multiple learners through an ensemble of models aim to make better predictions by capturing the underlying distribution of the data more accurately. Different ensembling methods, such as bagging, boosting, and stacking/blending,…

Machine Learning · Statistics 2020-11-03 Mohsen Shahhosseini , Guiping Hu , Hieu Pham

Graph Neural Networks (GNNs) have shown success in various fields for learning from graph-structured data. This paper investigates the application of ensemble learning techniques to improve the performance and robustness of Graph Neural…

Machine Learning · Computer Science 2023-10-24 Zhen Hao Wong , Ling Yue , Quanming Yao

AdaNet is a lightweight TensorFlow-based (Abadi et al., 2015) framework for automatically learning high-quality ensembles with minimal expert intervention. Our framework is inspired by the AdaNet algorithm (Cortes et al., 2017) which learns…

While ensembling deep neural networks has shown promise in improving generalization performance, scaling current ensemble methods for large models remains challenging. Given that recent progress in deep learning is largely driven by the…

Machine Learning · Computer Science 2024-11-25 Giung Nam , Juho Lee

Recent advances in neural algorithmic reasoning with graph neural networks (GNNs) are propped up by the notion of algorithmic alignment. Broadly, a neural network will be better at learning to execute a reasoning task (in terms of sample…

Machine Learning · Computer Science 2022-10-12 Andrew Dudzik , Petar Veličković

A memory efficient approach to ensembling neural networks is to share most weights among the ensembled models by means of a single reference network. We refer to this strategy as Embedded Ensembling (EE); its particular examples are…

Machine Learning · Statistics 2022-02-25 Maksim Velikanov , Roman Kail , Ivan Anokhin , Roman Vashurin , Maxim Panov , Alexey Zaytsev , Dmitry Yarotsky

Ensemble methods such as boosting combine multiple learners to obtain better prediction than could be obtained from any individual learner. Here we propose a principled framework for directly constructing ensemble learning methods from…

Machine Learning · Computer Science 2014-01-07 Chunhua Shen , Fayao Liu

Automated machine learning (AutoML) can produce complex model ensembles by stacking, bagging, and boosting many individual models like trees, deep networks, and nearest neighbor estimators. While highly accurate, the resulting predictors…

Machine Learning · Computer Science 2021-11-05 Rasool Fakoor , Jonas Mueller , Nick Erickson , Pratik Chaudhari , Alexander J. Smola

In recent years, deep neural networks (DNNs), have yielded strong results on a wide range of applications. Graphics Processing Units (GPUs) have been one key enabling factor leading to the current popularity of DNNs. However, despite…

Neural and Evolutionary Computing · Computer Science 2016-11-22 Matthew W. Moskewicz , Ali Jannesari , Kurt Keutzer

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated machine learning…

Machine Learning · Computer Science 2021-01-27 Marc-André Zöller , Marco F. Huber

We propose a privacy-preserving ensemble infused enhanced Deep Neural Network (DNN) based learning framework in this paper for Internet-of-Things (IoT), edge, and cloud convergence in the context of healthcare. In the convergence, edge…

Cryptography and Security · Computer Science 2023-05-17 Veronika Stephanie , Ibrahim Khalil , Mohammad Saidur Rahman , Mohammed Atiquzzaman