English
Related papers

Related papers: Which Backbone to Use: A Resource-efficient Domain…

200 papers

Deep learning has established many new state of the art solutions in the last decade in areas such as object, scene and speech recognition. In particular Convolutional Neural Network (CNN) is a category of deep learning which obtains…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Vincent Andrearczyk , Paul F. Whelan

The accuracy of deep convolutional neural networks (CNNs) generally improves when fueled with high resolution images. However, this often comes at a high computational cost and high memory footprint. Inspired by the fact that not all…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Yulin Wang , Kangchen Lv , Rui Huang , Shiji Song , Le Yang , Gao Huang

Convolutional Neural Networks have dramatically improved in recent years, surpassing human accuracy on certain problems and performance exceeding that of traditional computer vision algorithms. While the compute pattern in itself is…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Michaela Blott , Thomas B. Preusser , Nicholas Fraser , Giulio Gambardella , Kenneth OBrien , Yaman Umuroglu , Miriam Leeser

The U-shaped architecture has emerged as a crucial paradigm in the design of medical image segmentation networks. However, due to the inherent local limitations of convolution, a fully convolutional segmentation network with U-shaped…

Image and Video Processing · Electrical Eng. & Systems 2023-08-04 Fenghe Tang , Jianrui Ding , Lingtao Wang , Chunping Ning , S. Kevin Zhou

Many researchers believe that ConvNets perform well on small or moderately sized datasets, but are not competitive with Vision Transformers when given access to datasets on the web-scale. We challenge this belief by evaluating a performant…

Computer Vision and Pattern Recognition · Computer Science 2023-10-26 Samuel L. Smith , Andrew Brock , Leonard Berrada , Soham De

Convolutional Neural Networks have revolutionized vision applications. There are image domains and representations, however, that cannot be handled by standard CNNs (e.g., spherical images, superpixels). Such data are usually processed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 David Hart , Michael Whitney , Bryan Morse

The field of machine learning has taken a dramatic twist in recent times, with the rise of the Artificial Neural Network (ANN). These biologically inspired computational models are able to far exceed the performance of previous forms of…

Neural and Evolutionary Computing · Computer Science 2015-12-03 Keiron O'Shea , Ryan Nash

Facial expression recognition is a major problem in the domain of artificial intelligence. One of the best ways to solve this problem is the use of convolutional neural networks (CNNs). However, a large amount of data is required to train…

Computer Vision and Pattern Recognition · Computer Science 2019-05-30 Dylan C. Tannugi , Alceu S. Britto , Alessandro L. Koerich

While going deeper has been witnessed to improve the performance of convolutional neural networks (CNN), going smaller for CNN has received increasing attention recently due to its attractiveness for mobile/embedded applications. It remains…

Computer Vision and Pattern Recognition · Computer Science 2017-06-14 Zhe Li , Xiaoyu Wang , Xutao Lv , Tianbao Yang

Convolutional neural networks (CNN) pre-trained on ImageNet are the backbone of most state-of-the-art approaches. In this paper, we present a new set of pre-trained models with popular state-of-the-art architectures for the Caffe framework.…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Marcel Simon , Erik Rodner , Joachim Denzler

Beyond the Transformer, it is important to explore how to exploit the capacity of the MetaFormer, an architecture that is fundamental to the performance improvements of the Transformer. Previous studies have exploited it only for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Beoungwoo Kang , Seunghun Moon , Yubin Cho , Hyunwoo Yu , Suk-Ju Kang

This study evaluates the trade-offs between convolutional and transformer-based architectures on both medical and general-purpose image classification benchmarks. We use ResNet-18 as our baseline and introduce a fine-tuning strategy applied…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Aidar Amangeldi , Angsar Taigonyrov , Muhammad Huzaifa Jawad , Chinedu Emmanuel Mbonu

Deep learning has shown promising results on many machine learning tasks but DL models are often complex networks with large number of neurons and layers, and recently, complex layer structures known as building blocks. Finding the best…

Machine Learning · Computer Science 2018-01-29 Jayanta K Dutta , Jiayi Liu , Unmesh Kurup , Mohak Shah

Deep learning with a convolutional neural network (CNN) has been proved to be very effective in feature extraction and representation of images. For image classification problems, this work aim at finding which classifier is more…

Machine Learning · Computer Science 2015-06-09 Lei Zhang , David Zhang

Different neural network (NN) architectures have different advantages. Convolutional neural networks (CNNs) achieved enormous success in computer vision, while recurrent neural networks (RNNs) gained popularity in speech recognition. It is…

Signal Processing · Electrical Eng. & Systems 2019-07-18 Ziyu Ye , Andrew Gilman , Qihang Peng , Kelly Levick , Pamela Cosman , Larry Milstein

We introduce a new architecture called ChoiceNet where each layer of the network is highly connected with skip connections and channelwise concatenations. This enables the network to alleviate the problem of vanishing gradients, reduces the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-27 Farshid Rayhan , Aphrodite Galata , Timothy F. Cootes

Convolutional Neural Networks (CNNs) have proven to be extremely accurate for image recognition, even outperforming human recognition capability. When deployed on battery-powered mobile devices, efficient computer architectures are required…

Hardware Architecture · Computer Science 2020-10-05 Mehdi Ahmadi , Shervin Vakili , J. M. Pierre Langlois

In recent years, convolutional neural networks (CNNs) have achieved impressive performance for various visual recognition scenarios. CNNs trained on large labeled datasets can not only obtain significant performance on most challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Xiangyang Li , Luis Herranz , Shuqiang Jiang

Deep Convolutional Neural Networks (CNNs) for image classification successively alternate convolutions and downsampling operations, such as pooling layers or strided convolutions, resulting in lower resolution features the deeper the…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Ioannis Vezakis , Antonios Vezakis , Sofia Gourtsoyianni , Vassilis Koutoulidis , George K. Matsopoulos , Dimitrios Koutsouris

We propose a local modelling approach using deep convolutional neural networks (CNNs) for fine-grained image classification. Recently, deep CNNs trained from large datasets have considerably improved the performance of object recognition.…

Computer Vision and Pattern Recognition · Computer Science 2015-03-02 ZongYuan Ge , Chris McCool , Conrad Sanderson , Peter Corke