English
Related papers

Related papers: Low-Cost Self-Ensembles Based on Multi-Branch Tran…

200 papers

We introduce an architecture for large-scale image categorization that enables the end-to-end learning of separate visual features for the different classes to distinguish. The proposed model consists of a deep CNN shaped like a tree. The…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Karim Ahmed , Lorenzo Torresani

Feature regression is a simple way to distill large neural network models to smaller ones. We show that with simple changes to the network architecture, regression can outperform more complex state-of-the-art approaches for knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 K L Navaneet , Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

This paper explores the problem of clustering ensemble, which aims to combine multiple base clusterings to produce better performance than that of the individual one. The existing clustering ensemble methods generally construct a…

Machine Learning · Computer Science 2020-12-17 Yuheng Jia , Hui Liu , Junhui Hou , Qingfu Zhang

Deep convolutional neural networks have proven to be well suited for image classification applications. However, if there is distortion in the image, the classification accuracy can be significantly degraded, even with state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2019-02-15 Minho Ha , Younghoon Byeon , Youngjoo Lee , Sunggu Lee

The image classification machine learning model was trained with the intention to predict the category of the input image. While multiple state-of-the-art ensemble model methodologies are openly available, this paper evaluates the…

Machine Learning · Computer Science 2020-10-19 W. H. Huang

Benefitted from its great success on many tasks, deep learning is increasingly used on low-computational-cost devices, e.g. smartphone, embedded devices, etc. To reduce the high computational and memory cost, in this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Xijun Wang , Meina Kan , Shiguang Shan , Xilin Chen

Recently, the concept of unsupervised learning for superpixel segmentation via CNNs has been studied. Essentially, such methods generate superpixels by convolutional neural network (CNN) employed on a single image, and such CNNs are trained…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Moshe Eliasof , Nir Ben Zikri , Eran Treister

We propose a convolutional neural network (CNN) architecture for image classification based on subband decomposition of the image using wavelets. The proposed architecture decomposes the input image spectra into multiple critically sampled…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Pavel Sinha , Ioannis Psaromiligkos , Zeljko Zilic

Single-model ensembles (SMEs) have attracted attention as a way to approximate some of the benefits of deep ensembles within a single network. However, under an approximately matched parameter budget, it remains unclear whether model…

Machine Learning · Computer Science 2026-05-13 Tatsuhito Hasegawa , Taisei Tanaka

The main flaw of neural network ensembling is that it is exceptionally demanding computationally, especially, if the individual sub-models are large neural networks, which must be trained separately. Having in mind that modern DNNs can be…

Machine Learning · Computer Science 2020-03-31 Ludwik Bukowski , Witold Dzwinel

Few-shot learning has been proposed and rapidly emerging as a viable means for completing various tasks. Many few-shot models have been widely used for relation learning tasks. However, each of these models has a shortage of capturing a…

Computation and Language · Computer Science 2021-05-26 Qing Lin , Yongbin Liu , Wen Wen , Zhihua Tao

Ensemble learning is a technique where multiple component learners are combined through a protocol. We propose an Ensemble Neural Network (ENN) that uses the combined latent-feature space of multiple neural network classifiers to improve…

High Energy Physics - Phenomenology · Physics 2021-05-06 Jack Y. Araz , Michael Spannowsky

Ensemble methods have played a crucial role in achieving state-of-the-art (SOTA) performance across various machine learning tasks by leveraging the diversity of features learned by individual models. In Time Series Classification (TSC),…

Machine Learning · Computer Science 2026-02-10 Javidan Abdullayev , Maxime Devanne , Cyril Meyer , Ali Ismail-Fawaz , Jonathan Weber , Germain Forestier

Seam carving is a representative content-aware image retargeting approach to adjust the size of an image while preserving its visually prominent content. To maintain visually important content, seam-carving algorithms first calculate the…

Multimedia · Computer Science 2021-07-20 Seung-Hun Nam , Wonhyuk Ahn , In-Jae Yu , Myung-Joon Kwon , Minseok Son , Heung-Kyu Lee

In this paper, we propose a novel framework that combines ensemble learning with augmented graph structures to improve the performance and robustness of semi-supervised node classification in graphs. By creating multiple augmented views of…

Machine Learning · Computer Science 2025-03-25 Maryam Abdolali , Romina Zakerian , Behnam Roshanfekr , Fardin Ayar , Mohammad Rahmati

Ensembles of deep neural networks have demonstrated superior performance, but their heavy computational cost hinders applying them for resource-limited environments. It motivates distilling knowledge from the ensemble teacher into a smaller…

Machine Learning · Computer Science 2022-07-01 Giung Nam , Hyungi Lee , Byeongho Heo , Juho Lee

This work presents and analyzes three convolutional neural network (CNN) models for efficient pixelwise classification of images. When using convolutional neural networks to classify single pixels in patches of a whole image, a lot of…

Computer Vision and Pattern Recognition · Computer Science 2015-09-14 Fabian Tschopp

In this paper, we propose to train convolutional neural networks (CNNs) with both binarized weights and activations, leading to quantized models specifically} for mobile devices with limited power capacity and computation resources.…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Bohan Zhuang , Chunhua Shen , Mingkui Tan , Lingqiao Liu , Ian Reid

The customizable nature of deep learning models have allowed them to be successful predictors in various disciplines. These models are often trained with respect to thousands or millions of instances for complicated problems, but the…

Machine Learning · Computer Science 2019-12-24 Drimik Roy Chowdhury , Muhammad Firmansyah Kasim

Neural network ensembles is a simple yet effective approach for enhancing generalization capabilities. The most common method involves independently training multiple neural networks initialized with different weights and then averaging…

Computer Vision and Pattern Recognition · Computer Science 2025-04-09 Shunsuke Sakai , Shunsuke Tsuge , Tatsuhito Hasegawa