English
Related papers

Related papers: Low-Cost Self-Ensembles Based on Multi-Branch Tran…

200 papers

Accurate segmentation of medical images is an important step towards analyzing and tracking disease related morphological alterations in the anatomy. Convolutional neural networks (CNNs) have recently emerged as a powerful tool for many…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Jana Kemnitz , Christian F. Baumgartner , Wolfgang Wirth , Felix Eckstein , Sebastian K. Eder , Ender Konukoglu

Despite the outstanding performance of convolutional neural networks (CNNs) for many vision tasks, the required computational cost during inference is problematic when resources are limited. In this context, we propose Convolutional Neural…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Adria Ruiz , Jakob Verbeek

Binarization is an attractive strategy for implementing lightweight Deep Convolutional Neural Networks (CNNs). Despite the unquestionable savings offered, memory footprint above all, it may induce an excessive accuracy loss that prevents a…

Machine Learning · Computer Science 2019-12-30 Luca Mocerino , Andrea Calimera

Although group convolution operators are increasingly used in deep convolutional neural networks to improve the computational efficiency and to reduce the number of parameters, most existing methods construct their group convolution…

Machine Learning · Computer Science 2020-09-30 Qingbei Guo , Xiao-Jun Wu , Josef Kittler , Zhiquan Feng

Convolutional Neural Networks (CNNs) filter the input data using a series of spatial convolution operators with compactly supported stencils and point-wise nonlinearities. Commonly, the convolution operators couple features from all…

Numerical Analysis · Computer Science 2018-10-04 Eran Treister , Lars Ruthotto , Michal Sharoni , Sapir Zafrani , Eldad Haber

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

Many strides have been made in semantic segmentation of multiple classes within an image. This has been largely due to advancements in deep learning and convolutional neural networks (CNNs). Features within a CNN are automatically learned…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Erik Gaasedelen , Alex Deakyne , Paul Iaizzo

Ensemble learning has proven effective in boosting predictive performance, but traditional methods such as bagging, boosting, and dynamic ensemble selection (DES) suffer from high computational cost and limited adaptability to heterogeneous…

Training multiple deep neural networks (DNNs) and averaging their outputs is a simple way to improve the predictive performance. Nevertheless, the multiplied training cost prevents this ensemble method to be practical and efficient. Several…

Machine Learning · Computer Science 2021-10-27 Feng Wang , Guoyizhe Wei , Qiao Liu , Jinxiang Ou , Xian Wei , Hairong Lv

Artificial neural networks have been successfully applied to a variety of machine learning tasks, including image recognition, semantic segmentation, and machine translation. However, few studies fully investigated ensembles of artificial…

Machine Learning · Statistics 2017-04-07 Cheng Ju , Aurélien Bibaut , Mark J. van der Laan

Transferring a deep neural network trained on one problem to another requires only a small amount of data and little additional computation time. The same behaviour holds for ensembles of deep learning models typically superior to a single…

Machine Learning · Computer Science 2022-06-28 Ilya Shashkov , Nikita Balabin , Evgeny Burnaev , Alexey Zaytsev

This paper proposes a branched residual network for image classification. It is known that high-level features of deep neural network are more representative than lower-level features. By sharing the low-level features, the network can…

Computer Vision and Pattern Recognition · Computer Science 2017-02-22 Byungju Kim , Youngsoo Kim , Yeakang Lee , Junmo Kim

Ensemble learning has gain attention in resent deep learning research as a way to further boost the accuracy and generalizability of deep neural network (DNN) models. Recent ensemble training method explores different training algorithms or…

Machine Learning · Computer Science 2023-01-20 Jingchi Zhang , Huanrui Yang , Hai Li

While ensembling deep neural networks has shown promise in improving generalization performance, scaling current ensemble methods for large models remains challenging. Given that recent progress in deep learning is largely driven by the…

Machine Learning · Computer Science 2024-11-25 Giung Nam , Juho Lee

Since the BOSS competition, in 2010, most steganalysis approaches use a learning methodology involving two steps: feature extraction, such as the Rich Models (RM), for the image representation, and use of the Ensemble Classifier (EC) for…

Multimedia · Computer Science 2018-01-15 Lionel Pibre , Pasquet Jérôme , Dino Ienco , Marc Chaumont

Deep convolutional neural networks (CNNs) have been intensively used for multi-class segmentation of data from different modalities and achieved state-of-the-art performances. However, a common problem when dealing with large, high…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Chengjia Wang , Tom MacGillivray , Gillian Macnaught , Guang Yang , David Newby

Ensembles of CNN models trained with different seeds (also known as Deep Ensembles) are known to achieve superior performance over a single copy of the CNN. Neural Ensemble Search (NES) can further boost performance by adding architectural…

Machine Learning · Computer Science 2021-07-12 Ashwin Raaghav Narayanan , Arber Zela , Tonmoy Saikia , Thomas Brox , Frank Hutter

Convolutional neural networks (CNNs) have shown great capability of solving various artificial intelligence tasks. However, the increasing model size has raised challenges in employing them in resource-limited applications. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Hongyang Gao , Zhengyang Wang , Shuiwang Ji

Hierarchical feature learning based on convolutional neural networks (CNN) has recently shown significant potential in various computer vision tasks. While allowing high-quality discriminative feature learning, the downside of CNNs is the…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Domen Tabernik , Matej Kristan , Jeremy L. Wyatt , Aleš Leonardis

Ensembling is a well-known technique in neural machine translation (NMT) to improve system performance. Instead of a single neural net, multiple neural nets with the same topology are trained separately, and the decoder generates…

Computation and Language · Computer Science 2017-07-24 Felix Stahlberg , Bill Byrne
‹ Prev 1 3 4 5 6 7 10 Next ›