English
Related papers

Related papers: Why Convolutional Networks Learn Oriented Bandpass…

200 papers

Convolutional neural networks for computer vision are fairly intuitive. In a typical CNN used in image classification, the first layers learn edges, and the following layers learn some filters that can identify an object. But CNNs for…

Computation and Language · Computer Science 2018-04-04 Prudhvi Raj Dachapally , Srikanth Ramanam

Hyperspectral Imaging is a crucial tool in remote sensing which captures far more spectral information than standard color images. However, the increase in spectral information comes at the cost of spatial resolution. Super-resolution is a…

Image and Video Processing · Electrical Eng. & Systems 2023-10-26 Alexander Ulrichsen , Paul Murray , Stephen Marshall , Moncef Gabbouj , Serkan Kiranyaz , Mehmet Yamac , Nour Aburaed

In this paper we challenge the common assumption that convolutional layers in modern CNNs are translation invariant. We show that CNNs can and will exploit the absolute spatial location by learning filters that respond exclusively to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Osman Semih Kayhan , Jan C. van Gemert

In this paper we study the spontaneous development of symmetries in the early layers of a Convolutional Neural Network (CNN) during learning on natural images. Our architecture is built in such a way to mimic the early stages of biological…

Neurons and Cognition · Quantitative Biology 2021-04-20 Federico Bertoni , Noemi Montobbio , Alessandro Sarti , Giovanna Citti

We investigate the geometric properties of the functions learned by trained ConvNets in the preactivation space of their convolutional layers, by performing an empirical study of hyperplane arrangements induced by a convolutional layer. We…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Matteo Gamba , Stefan Carlsson , Hossein Azizpour , Mårten Björkman

Convolutional neural networks (CNNs) have achieved remarkable performance in various fields, particularly in the domain of computer vision. However, why this architecture works well remains to be a mystery. In this work we move a small step…

Machine Learning · Computer Science 2019-05-27 Bing Yu , Junzhao Zhang , Zhanxing Zhu

Many works have concentrated on visualizing and understanding the inner mechanism of convolutional neural networks (CNNs) by generating images that activate some specific neurons, which is called deep visualization. However, it is still…

Computer Vision and Pattern Recognition · Computer Science 2016-08-19 Zhiqiang Xia , Ce Zhu , Zhengtao Wang , Qi Guo , Yipeng Liu

In a traditional convolutional layer, the learned filters stay fixed after training. In contrast, we introduce a new framework, the Dynamic Filter Network, where filters are generated dynamically conditioned on an input. We show that this…

Machine Learning · Computer Science 2016-06-07 Bert De Brabandere , Xu Jia , Tinne Tuytelaars , Luc Van Gool

Convolutional Neural Networks (CNN) possess many positive qualities when it comes to spatial raster data. Translation invariance enables CNNs to detect features regardless of their position in the scene. However, in some domains, like…

Machine Learning · Computer Science 2020-07-13 Arnas Uselis , Mantas Lukoševičius , Lukas Stasytis

Artificial neural networks have recently shown great results in many disciplines and a variety of applications, including natural language understanding, speech processing, games and image data generation. One particular application in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Felix Altenberger , Claus Lenz

Convolutional neural networks (CNNs) are being applied to an increasing number of problems and fields due to their superior performance in classification and regression tasks. Since two of the key operations that CNNs implement are…

Machine Learning · Computer Science 2018-02-27 Fernando Gama , Geert Leus , Antonio G. Marques , Alejandro Ribeiro

In human perception and cognition, a fundamental operation that brains perform is interpretation: constructing coherent neural states from noisy, incomplete, and intrinsically ambiguous evidence. The problem of interpretation is well…

Machine Learning · Computer Science 2019-09-30 Michael Iuzzolino , Yoram Singer , Michael C. Mozer

We introduce a convolutional neural network that operates directly on graphs. These networks allow end-to-end learning of prediction pipelines whose inputs are graphs of arbitrary size and shape. The architecture we present generalizes…

Convolutional neural networks (CNNs) handle the case where filters extend beyond the image boundary using several heuristics, such as zero, repeat or mean padding. These schemes are applied in an ad-hoc fashion and, being weakly related to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-09 Carlo Innamorati , Tobias Ritschel , Tim Weyrich , Niloy J. Mitra

Supervised training of a convolutional network for object classification should make explicit any information related to the class of objects and disregard any auxiliary information associated with the capture of the image or the variation…

Computer Vision and Pattern Recognition · Computer Science 2014-11-25 Ali Sharif Razavian , Hossein Azizpour , Atsuto Maki , Josephine Sullivan , Carl Henrik Ek , Stefan Carlsson

Deep convolutional network has been the state-of-the-art approach for a wide variety of tasks over the last few years. Its successes have, in many cases, turned it into the default model in quite a few domains. In this work, we will…

Machine Learning · Statistics 2018-07-10 Elad Hoffer , Shai Fine , Daniel Soudry

The use of graph convolution in the development of recommender system algorithms has recently achieved state-of-the-art results in the collaborative filtering task (CF). While it has been demonstrated that the graph convolution operation is…

Information Retrieval · Computer Science 2023-05-31 Edoardo D'Amico , Aonghus Lawlor , Neil Hurley

Conventional vision backbones, despite their success, often construct features through a largely uniform cascade of operations, offering limited explicit pathways for adaptive, iterative refinement. This raises a compelling question: can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Bin Guo , John H. L. Hansen

In modern computer vision tasks, convolutional neural networks (CNNs) are indispensable for image classification tasks due to their efficiency and effectiveness. Part of their superiority compared to other architectures, comes from the fact…

Machine Learning · Computer Science 2019-06-11 Vighnesh Birodkar , Hossein Mobahi , Dilip Krishnan , Samy Bengio

As object recognition becomes an increasingly common ML task, and recent research demonstrating CNNs vulnerability to attacks and small image perturbations necessitate fully understanding the foundations of object recognition. We focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-11-01 Megha Srivastava , Kalanit Grill-Spector