English
Related papers

Related papers: Associative Convolutional Layers

200 papers

Hyperparameters tuning is a time-consuming approach, particularly when the architecture of the neural network is decided as part of this process. For instance, in convolutional neural networks (CNNs), the selection of the number and the…

Machine Learning · Computer Science 2020-07-31 Roberto L. Castro , Diego Andrade , Basilio Fraguela

State-of-the-art approaches for semantic image segmentation are built on Convolutional Neural Networks (CNNs). The typical segmentation architecture is composed of (a) a downsampling path responsible for extracting coarse semantic features,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-01 Simon Jégou , Michal Drozdzal , David Vazquez , Adriana Romero , Yoshua Bengio

Convolutional neural network (CNN) is widely used in computer vision applications. In the networks that deal with images, CNNs are the most time-consuming layer of the networks. Usually, the solution to address the computation cost is to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Meisam Rakhshanfar

Minimal changes to neural architectures (e.g. changing a single hyperparameter in a key layer), can lead to significant gains in predictive performance in Convolutional Neural Networks (CNNs). In this work, we present a new approach to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Mats L. Richter , Christopher Pal

Convolutional neural networks (CNNs) have demonstrated their capability to solve different kind of problems in a very huge number of applications. However, CNNs are limited for their computational and storage requirements. These limitations…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Adrià Ciurana , Albert Mosella-Montoro , Javier Ruiz-Hidalgo

Recently, convolutional neural networks (CNNs) have been used as a powerful tool to solve many problems of machine learning and computer vision. In this paper, we aim to provide insight on the property of convolutional neural networks, as…

Machine Learning · Computer Science 2016-07-20 Wenling Shang , Kihyuk Sohn , Diogo Almeida , Honglak Lee

We present an efficient alternative to the convolutional layer using cheap spatial transformations. This construction exploits an inherent spatial redundancy of the learned convolutional filters to enable a much greater parameter…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Roy Miles , Krystian Mikolajczyk

We propose a new method for creating computationally efficient and compact convolutional neural networks (CNNs) using a novel sparse connection structure that resembles a tree root. This allows a significant reduction in computational cost…

Neural and Evolutionary Computing · Computer Science 2020-10-13 Yani Ioannou , Duncan Robertson , Roberto Cipolla , Antonio Criminisi

Convolutional Neural Network (CNN)-based filters have achieved significant performance in video artifacts reduction. However, the high complexity of existing methods makes it difficult to be applied in real usage. In this paper, a CNN-based…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Chao Liu , Heming Sun , Jiro Katto , Xiaoyang Zeng , Yibo Fan

Although convolutional neural networks (CNNs) are now widely used in various computer vision applications, its huge resource demanding on parameter storage and computation makes the deployment on mobile and embedded devices difficult.…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Zhe Xu , Ray C. C. Cheung

Building large models with parameter sharing accounts for most of the success of deep convolutional neural networks (CNNs). In this paper, we propose doubly convolutional neural networks (DCNNs), which significantly improve the performance…

Machine Learning · Computer Science 2016-11-01 Shuangfei Zhai , Yu Cheng , Weining Lu , Zhongfei Zhang

We applied pre-defined kernels also known as filters or masks developed for image processing to convolution neural network. Instead of letting neural networks find its own kernels, we used 41 different general-purpose kernels of blurring,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-23 Jay Hoon Jung , Yousun Shin , YoungMin Kwon

Convolutional Neural Networks (CNNs) have been widely applied. But as the CNNs grow, the number of arithmetic operations and memory footprint also increase. Furthermore, typical non-linear activation functions do not allow associativity of…

Machine Learning · Computer Science 2021-11-10 Eduardo Vera Sousa , Leandro A. F. Fernandes , Cristina Nader Vasconcelos

Typical deep convolutional architectures present an increasing number of feature maps as we go deeper in the network, whereas spatial resolution of inputs is decreased through downsampling operations. This means that most of the parameters…

Machine Learning · Computer Science 2020-07-21 Guillaume Coiffier , Ghouthi Boukli Hacene , Vincent Gripon

Convolutional neural networks (CNNs) are very popular nowadays for image processing. CNNs allow one to learn optimal filters in a (mostly) supervised machine learning context. However this typically requires abundant labelled training data…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Matej Ulicny , Vladimir A. Krylov , Rozenn Dahyot

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

In this work, we present a novel background subtraction system that uses a deep Convolutional Neural Network (CNN) to perform the segmentation. With this approach, feature engineering and parameter tuning become unnecessary since the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-07 Mohammadreza Babaee , Duc Tung Dinh , Gerhard Rigoll

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

This paper shows that it is possible to train large and deep convolutional neural networks (CNN) for JPEG compression artifacts reduction, and that such networks can provide significantly better reconstruction quality compared to previously…

Computer Vision and Pattern Recognition · Computer Science 2016-05-03 Pavel Svoboda , Michal Hradis , David Barina , Pavel Zemcik

Over the past decade, convolutional neural networks (CNNs) have become the driving force of an ever-increasing set of applications, achieving state-of-the-art performance. Most of the modern CNN architectures are composed of many…

Machine Learning · Computer Science 2020-09-15 Alicia Montserrat Alvarado-Gonzalez , Gibran Fuentes-Pineda , Jorge Cervantes-Ojeda