English
Related papers

Related papers: Low-Cost Self-Ensembles Based on Multi-Branch Tran…

200 papers

Diversity is an important consideration in the construction of robust neural network ensembles. A collection of well trained models will generalize better if they are diverse in the patterns they respond to and the predictions they make.…

Machine Learning · Computer Science 2023-02-14 Tim Whitaker , Darrell Whitley

Cost and cardinality estimation is vital to query optimizer, which can guide the plan selection. However traditional empirical cost and cardinality estimation techniques cannot provide high-quality estimation, because they cannot capture…

Databases · Computer Science 2019-06-07 Ji Sun , Guoliang Li

We present a tree-structured network architecture for large scale image classification. The trunk of the network contains convolutional layers optimized over all classes. At a given depth, the trunk splits into separate branches, each…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Karim Ahmed , Mohammad Haris Baig , Lorenzo Torresani

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

Motivated by the necessity for parameter efficiency in distributed machine learning and AI-enabled edge devices, we provide a general and easy to implement method for significantly reducing the number of parameters of Convolutional Neural…

Machine Learning · Computer Science 2019-08-13 Hamed Omidvar , Vahideh Akhlaghi , Massimo Franceschetti , Rajesh K. Gupta

Deep convolutional neural networks (CNNs) with strong expressive ability have achieved impressive performances on single image super-resolution (SISR). However, their excessive amounts of convolutions and parameters usually consume high…

Image and Video Processing · Electrical Eng. & Systems 2020-07-22 Chunwei Tian , Ruibin Zhuge , Zhihao Wu , Yong Xu , Wangmeng Zuo , Chen Chen , Chia-Wen Lin

While deep convolutional neural networks (CNNs) have shown a great success in single-label image classification, it is important to note that real world images generally contain multiple labels, which could correspond to different objects,…

Computer Vision and Pattern Recognition · Computer Science 2016-04-18 Jiang Wang , Yi Yang , Junhua Mao , Zhiheng Huang , Chang Huang , Wei Xu

Deep neural networks have enhanced the performance of decision making systems in many applications including image understanding, and further gains can be achieved by constructing ensembles. However, designing an ensemble of deep networks…

Machine Learning · Computer Science 2021-11-16 Sara Atito Ali Ahmed , Cemre Zor , Berrin Yanikoglu , Muhammad Awais , Josef Kittler

Convolutional neural networks (CNNs) are increasingly being used to automate segmentation of organs-at-risk in radiotherapy. Since large sets of highly curated data are scarce, we investigated how much data is required to train accurate and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Edward G. A. Henderson , Marcel van Herk , Eliana M. Vasquez Osorio

Deep learning using Convolutional Neural Networks (CNNs) has been shown to significantly out-performed many conventional vision algorithms. Despite efforts to increase the CNN efficiency both algorithmically and with specialized hardware,…

Computer Vision and Pattern Recognition · Computer Science 2021-05-24 Carlos Mauricio Villegas Burgos , Tianqi Yang , Nick Vamivakas , Yuhao Zhu

Over the past few years, there has been a significant improvement in the domain of few-shot learning. This learning paradigm has shown promising results for the challenging problem of anomaly detection, where the general task is to deal…

Computer Vision and Pattern Recognition · Computer Science 2022-11-24 Soumyajit Karmakar , Abeer Banerjee , Prashant Sadashiv Gidde , Sumeet Saurav , Sanjay Singh

Ensemble methods are known for enhancing the accuracy and robustness of machine learning models by combining multiple base learners. However, standard approaches like greedy or random ensembling often fall short, as they assume a constant…

Machine Learning · Computer Science 2025-06-24 Sebastian Pineda Arango , Maciej Janowski , Lennart Purucker , Arber Zela , Frank Hutter , Josif Grabocka

In recent years, convolutional neural networks (CNNs) have shown great performance in various fields such as image classification, pattern recognition, and multi-media compression. Two of the feature properties, local connectivity and…

Machine Learning · Computer Science 2018-07-24 Qianru Zhang , Meng Zhang , Tinghuan Chen , Zhifei Sun , Yuzhe Ma , Bei Yu

Thanks to the state-of-the-art Large Language Models (LLMs), language generation has reached outstanding levels. These models are capable of generating high quality content, thus making it a challenging task to detect generated text from…

Computation and Language · Computer Science 2023-10-27 Vijini Liyanage , Davide Buscaldi

Evolutionary Learning proceeds by evolving a population of classifiers, from which it generally returns (with some notable exceptions) the single best-of-run classifier as final result. In the meanwhile, Ensemble Learning, one of the most…

Artificial Intelligence · Computer Science 2007-05-23 Christian Gagné , Michèle Sebag , Marc Schoenauer , Marco Tomassini

This work aims to enable on-device training of convolutional neural networks (CNNs) by reducing the computation cost at training time. CNN models are usually trained on high-performance computers and only the trained models are deployed to…

Machine Learning · Computer Science 2020-07-08 Yawen Wu , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Deep convolutional neural networks (CNNs) have shown excellent performance in object recognition tasks and dense classification problems such as semantic segmentation. However, training deep neural networks on large and sparse datasets is…

Computer Vision and Pattern Recognition · Computer Science 2017-12-25 Lorenz Berger , Eoin Hyde , M. Jorge Cardoso , Sebastien Ourselin

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

Graph-based semi-supervised learning (GSSL) has long been a hot research topic. Traditional methods are generally shallow learners, based on the cluster assumption. Recently, graph convolutional networks (GCNs) have become the predominant…

Machine Learning · Computer Science 2025-08-07 Zheng Wang , Hongming Ding , Li Pan , Jianhua Li , Zhiguo Gong , Philip S. Yu

Despite the steady progress in video analysis led by the adoption of convolutional neural networks (CNNs), the relative improvement has been less drastic as that in 2D static image classification. Three main challenges exist including…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Saining Xie , Chen Sun , Jonathan Huang , Zhuowen Tu , Kevin Murphy