English
Related papers

Related papers: Tracking translation invariance in CNNs

200 papers

We study the effect of injecting local scale equivariance into Convolutional Neural Networks. This is done by applying each convolutional filter at multiple scales. The output is a vector field encoding for the maximally activating scale…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Diego Marcos , Benjamin Kellenberger , Sylvain Lobry , Devis Tuia

CNN (Convolutional Neural Network) models have been successfully used for segmentation of the left ventricle (LV) in cardiac MRI (Magnetic Resonance Imaging), providing clinical measurements. In practice, two questions arise with deployment…

Image and Video Processing · Electrical Eng. & Systems 2021-10-14 Marcelo Toledo , Daniel Lima , José Krieger , Marco Gutierrez

It is widely acknowledged that trained convolutional neural networks (CNNs) have different levels of sensitivity to signals of different frequency. In particular, a number of empirical studies have documented CNNs sensitivity to…

Machine Learning · Computer Science 2023-09-27 Charles Godfrey , Elise Bishoff , Myles Mckay , Davis Brown , Grayson Jorgenson , Henry Kvinge , Eleanor Byler

The performance of a Convolutional Neural Network (CNN) depends on its hyperparameters, like the number of layers, kernel sizes, or the learning rate for example. Especially in smaller networks and applications with limited computational…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Lukas Hahn , Lutz Roese-Koerner , Klaus Friedrichs , Anton Kummert

In general, convolutional neural networks (CNNs) are easy to train, but their essential properties, such as generalization error and adversarial robustness, are hard to control. Recent research demonstrated that singular values of…

Machine Learning · Computer Science 2022-11-28 Alexandra Senderovich , Ekaterina Bulatova , Anton Obukhov , Maxim Rakhuba

This work investigates how using reduced precision data in Convolutional Neural Networks (CNNs) affects network accuracy during classification. More specifically, this study considers networks where each layer may use different precision…

Safety-critical applications require transparency in artificial intelligence (AI) components, but widely used convolutional neural networks (CNNs) widely used for perception tasks lack inherent interpretability. Hence, insights into what…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Georgii Mikriukov , Gesina Schwalbe , Christian Hellert , Korinna Bade

As the basic building block of Convolutional Neural Networks (CNNs), the convolutional layer is designed to extract local patterns and lacks the ability to model global context in its nature. Many efforts have been recently devoted to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Xudong Lin , Lin Ma , Wei Liu , Shih-Fu Chang

Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Amr Farahat , Felix Effenberger , Martin Vinck

This report deals with translation invariance of convolutional neural networks (CNNs) for automatic target recognition (ATR) from synthetic aperture radar (SAR) imagery. In particular, the translation invariance of CNNs for SAR ATR…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Hidetoshi Furukawa

We propose a novel method for translation selection in statistical machine translation, in which a convolutional neural network is employed to judge the similarity between a phrase pair in two languages. The specifically designed…

Computation and Language · Computer Science 2015-06-25 Zhaopeng Tu , Baotian Hu , Zhengdong Lu , Hang Li

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

For many years, it has been shown how much exploiting equivariances can be beneficial when solving image analysis tasks. For example, the superiority of convolutional neural networks (CNNs) compared to dense networks mainly comes from an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Valentin Delchevalerie , Alexandre Mayer , Adrien Bibal , Benoît Frénay

A common approach to define convolutions on meshes is to interpret them as a graph and apply graph convolutional networks (GCNs). Such GCNs utilize isotropic kernels and are therefore insensitive to the relative orientation of vertices and…

Machine Learning · Computer Science 2021-11-22 Pim de Haan , Maurice Weiler , Taco Cohen , Max Welling

Convolutional Neural Networks (CNNs) are a standard approach for visual recognition due to their capacity to learn hierarchical representations from raw pixels. In practice, practitioners often choose among (i) training a compact custom CNN…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Annoor Sharara Akhand

In this article, we look into some essential aspects of convolutional neural networks (CNNs) with the focus on medical image segmentation. First, we discuss the CNN architecture, thereby highlighting the spatial origin of the data,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Jeroen Bertels , David Robben , Robin Lemmens , Dirk Vandermeulen

Convolutional neural networks (CNNs) have massively impacted visual recognition in 2D images, and are now ubiquitous in state-of-the-art approaches. CNNs do not easily extend, however, to data that are not represented by regular grids, such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Nitika Verma , Edmond Boyer , Jakob Verbeek

Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yahui Liu , Enver Sangineto , Wei Bi , Nicu Sebe , Bruno Lepri , Marco De Nadai

Currently, increasingly deeper neural networks have been applied to improve their accuracy. In contrast, We propose a novel wider Convolutional Neural Networks (CNN) architecture, motivated by the Multi-column Deep Neural Networks and the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Xiaobo Huang

In this paper, we study the sensitivity of CNN outputs with respect to image transformations and noise in the area of fine-grained recognition. In particular, we answer the following questions (1) how sensitive are CNNs with respect to…

Computer Vision and Pattern Recognition · Computer Science 2016-10-24 Erik Rodner , Marcel Simon , Robert B. Fisher , Joachim Denzler