English
Related papers

Related papers: Scaling-Translation-Equivariant Networks with Deco…

200 papers

We introduce an approach to integrate segmentation information within a convolutional neural network (CNN). This counter-acts the tendency of CNNs to smooth information across regions and increases their spatial precision. To obtain…

Computer Vision and Pattern Recognition · Computer Science 2017-08-16 Adam W. Harley , Konstantinos G. Derpanis , Iasonas Kokkinos

Convolutional Neural Networks (CNNs) are very effective for many pattern recognition tasks. However, training deep CNNs needs extensive computation and large training data. In this paper we propose Bank of Filter-Trees (BFT) as a trans- fer…

Computer Vision and Pattern Recognition · Computer Science 2017-11-28 Suresh Kirthi Kumaraswamy , PS Sastry , KR Ramakrishnan

It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and…

Machine Learning · Computer Science 2019-04-23 Taco S. Cohen , Max Welling

In this paper we propose cross-modal convolutional neural networks (X-CNNs), a novel biologically inspired type of CNN architectures, treating gradient descent-specialised CNNs as individual units of processing in a larger-scale network…

Machine Learning · Statistics 2017-09-26 Petar Veličković , Duo Wang , Nicholas D. Lane , Pietro Liò

Convolutional neural networks have many hyperparameters such as the filter size, number of filters, and pooling size, which require manual tuning. Though deep stacked structures are able to create multi-scale and hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2018-03-02 Ilker Cam , F. Boray Tek

The redundancy is widely recognized in Convolutional Neural Networks (CNNs), which enables to remove unimportant filters from convolutional layers so as to slim the network with acceptable performance drop. Inspired by the linear and…

Machine Learning · Computer Science 2019-04-09 Xiaohan Ding , Guiguang Ding , Yuchen Guo , Jungong Han

Convolutional neural networks (CNNs) are very popular nowadays for image processing. CNNs allow one to learn optimal filters in a (mostly) supervised machine learning context. However this typically requires abundant labelled training data…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Matej Ulicny , Vladimir A. Krylov , Rozenn Dahyot

In many computer vision tasks, we expect a particular behavior of the output with respect to rotations of the input image. If this relationship is explicitly encoded, instead of treated as any other variation, the complexity of the problem…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Diego Marcos , Michele Volpi , Nikos Komodakis , Devis Tuia

Convolutional neural networks (CNNs) are inherently equivariant to translation. Efforts to embed other forms of equivariance have concentrated solely on rotation. We expand the notion of equivariance in CNNs through the Polar Transformer…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Carlos Esteves , Christine Allen-Blanchette , Xiaowei Zhou , Kostas Daniilidis

Convolutional Neural Networks (CNNs) are extremely efficient, since they exploit the inherent translation-invariance of natural images. However, translation is just one of a myriad of useful spatial transformations. Can the same efficiency…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 João F. Henriques , Andrea Vedaldi

Spherical CNNs generalize CNNs to functions on the sphere, by using spherical convolutions as the main linear operation. The most accurate and efficient way to compute spherical convolutions is in the spectral domain (via the convolution…

Machine Learning · Computer Science 2023-06-09 Carlos Esteves , Jean-Jacques Slotine , Ameesh Makadia

Deep Convolutional Neural Networks (CNN) have been successfully applied to many real-life problems. However, the huge memory cost of deep CNN models poses a great challenge of deploying them on memory-constrained devices (e.g., mobile…

Computer Vision and Pattern Recognition · Computer Science 2020-10-07 Weichao Lan , Liang Lan

CNNs exhibit inherent equivariance to image translation, leading to efficient parameter and data usage, faster learning, and improved robustness. The concept of translation equivariant networks has been successfully extended to rotation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Tomáš Karella , Adam Harmanec , Jan Kotera , Jan Blažek , Filip Šroubek

The purpose of this short and simple note is to clarify a common misconception about convolutional neural networks (CNNs). CNNs are made up of convolutional layers which are shift equivariant due to weight sharing. However, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nick McGreivy , Ammar Hakim

The layers of convolutional neural networks (CNNs) can be used to alter the resolution of their inputs, but the scaling factors are limited to integer values. However, in many image and video processing applications, the ability to resize…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Li-Heng Chen , Christos G. Bampis , Zhi Li , Chao Chen , Alan C. Bovik

Convolutional neural networks (CNNs) are able to attain better visual recognition performance than fully connected neural networks despite having much fewer parameters due to their parameter sharing principle. Modern architectures usually…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Ilke Cugu , Emre Akbas

Deep convolutional neural networks (CNN) are widely used in modern artificial intelligence (AI) and smart vision systems but also limited by computation latency, throughput, and energy efficiency on a resource-limited scenario, such as…

Hardware Architecture · Computer Science 2017-09-18 Yuan Du , Li Du , Yilei Li , Junjie Su , Mau-Chung Frank Chang

We propose a framework for rotation and translation covariant deep learning using $SE(2)$ group convolutions. The group product of the special Euclidean motion group $SE(2)$ describes how a concatenation of two roto-translations results in…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Erik J Bekkers , Maxime W Lafarge , Mitko Veta , Koen AJ Eppenhof , Josien PW Pluim , Remco Duits

Deep learning, e.g., convolutional neural networks (CNNs), has achieved great success in image processing and computer vision especially in high level vision applications such as recognition and understanding. However, it is rarely used to…

Computer Vision and Pattern Recognition · Computer Science 2017-08-03 Feng Jiang , Wen Tao , Shaohui Liu , Jie Ren , Xun Guo , Debin Zhao

Convolutional neural network (CNN) has achieved state-of-the-art performance in many different visual tasks. Learned from a large-scale training dataset, CNN features are much more discriminative and accurate than the hand-crafted features.…

Computer Vision and Pattern Recognition · Computer Science 2016-02-01 Guo-Sen Xie , Xu-Yao Zhang , Shuicheng Yan , Cheng-Lin Liu