English
Related papers

Related papers: Is the deconvolution layer the same as a convoluti…

200 papers

Convolutional networks are large linear systems divided into layers and connected by non-linear units. These units are the "articulations" that allow the network to adapt to the input. To understand how a network manages to solve a problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-15 Pablo Navarrete Michelini , Hanwen Liu , Yunhua Lu , Xingqun Jiang

In the last decade, Convolutional Neural Network with a multi-layer architecture has advanced rapidly. However, training its complex network is very space-consuming, since a lot of intermediate data are preserved across layers, especially…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-23 Zhigang Wang , Hangyu Yang , Ning Wang , Chuanfei Xu , Jie Nie , Zhiqiang Wei , Yu Gu , Ge Yu

The focus of this paper is speeding up the evaluation of convolutional neural networks. While delivering impressive results across a range of computer vision and machine learning tasks, these networks are computationally demanding, limiting…

Computer Vision and Pattern Recognition · Computer Science 2014-05-16 Max Jaderberg , Andrea Vedaldi , Andrew Zisserman

Densely Connected Convolutional Networks (DenseNets) have been shown to achieve state-of-the-art results on image classification tasks while using fewer parameters and computation than competing methods. Since each layer in this…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Andy Hess

Convolutional neural networks typically consist of many convolutional layers followed by one or more fully connected layers. While convolutional layers map between high-order activation tensors, the fully connected layers operate on…

Machine Learning · Computer Science 2020-07-22 Jean Kossaifi , Zachary C. Lipton , Arinbjorn Kolbeinsson , Aran Khanna , Tommaso Furlanello , Anima Anandkumar

Convolutional layers are the core building blocks of Convolutional Neural Networks (CNNs). In this paper, we propose to augment a convolutional layer with an additional depthwise convolution, where each input channel is convolved with a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Jinming Cao , Yangyan Li , Mingchao Sun , Ying Chen , Dani Lischinski , Daniel Cohen-Or , Baoquan Chen , Changhe Tu

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

Convolutional neural networks excel in image recognition tasks, but this comes at the cost of high computational and memory complexity. To tackle this problem, [1] developed a tensor factorization framework to compress fully-connected…

Machine Learning · Computer Science 2016-11-11 Timur Garipov , Dmitry Podoprikhin , Alexander Novikov , Dmitry Vetrov

In this work we investigate the effect of the convolutional network depth on its accuracy in the large-scale image recognition setting. Our main contribution is a thorough evaluation of networks of increasing depth using an architecture…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Karen Simonyan , Andrew Zisserman

This document will review the most prominent proposals using multilayer convolutional architectures. Importantly, the various components of a typical convolutional network will be discussed through a review of different approaches that base…

Computer Vision and Pattern Recognition · Computer Science 2018-03-26 Isma Hadji , Richard P. Wildes

We present techniques for speeding up the test-time evaluation of large convolutional networks, designed for object recognition tasks. These models deliver impressive accuracy but each image evaluation requires millions of floating point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Remi Denton , Wojciech Zaremba , Joan Bruna , Yann LeCun , Rob Fergus

A number of recent studies have shown that a Deep Convolutional Neural Network (DCNN) pretrained on a large dataset can be adopted as a universal image description which leads to astounding performance in many visual classification tasks.…

Computer Vision and Pattern Recognition · Computer Science 2014-12-01 Lingqiao Liu , Chunhua Shen , Anton van den Hengel

Convolutional neural networks were the standard for solving many computer vision tasks until recently, when Transformers of MLP-based architectures have started to show competitive performance. These architectures typically have a vast…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Peter Kocsis , Peter Súkeník , Guillem Brasó , Matthias Nießner , Laura Leal-Taixé , Ismail Elezi

Convolutional Neural Networks (CNN) increase depth by stacking convolutional layers, and deeper network models perform better in image recognition. Empirical research shows that simply stacking convolutional layers does not make the network…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Rui-Yang Ju , Jen-Shiun Chiang , Chih-Chia Chen , Yu-Shian Lin

In this work, we study the problem of non-blind image deconvolution and propose a novel recurrent network architecture that leads to very competitive restoration results of high image quality. Motivated by the computational efficiency and…

Image and Video Processing · Electrical Eng. & Systems 2021-12-13 Iaroslav Koshelev , Daniil Selikhanovych , Stamatios Lefkimmiatis

Hyperspectral images are of crucial importance in order to better understand features of different materials. To reach this goal, they leverage on a high number of spectral bands. However, this interesting characteristic is often paid by a…

Image and Video Processing · Electrical Eng. & Systems 2020-06-01 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng , Tai-Xiang Jiang , Gemine Vivone , Jocelyn Chanussot

The purpose of this short and simple note is to clarify a common misconception about convolutional neural networks (CNNs). CNNs are made up of convolutional layers which are shift equivariant due to weight sharing. However, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nick McGreivy , Ammar Hakim

Deep neural networks, in particular convolutional neural networks, have become highly effective tools for compressing images and solving inverse problems including denoising, inpainting, and reconstruction from few and noisy measurements.…

Computer Vision and Pattern Recognition · Computer Science 2019-03-12 Reinhard Heckel , Paul Hand

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

Dense prediction tasks typically employ encoder-decoder architectures, but the prevalent convolutions in the decoder are not image-adaptive and can lead to boundary artifacts. Different generalized convolution operations have been…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Anne S. Wannenwetsch , Martin Kiefel , Peter V. Gehler , Stefan Roth