English
Related papers

Related papers: Scale-Equivariant Deep Learning for 3D Data

200 papers

Scale is often seen as a given, disturbing factor in many vision tasks. When doing so it is one of the factors why we need more data during learning. In recent work scale equivariance was added to convolutional neural networks. It was shown…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Ivan Sosnovik , Artem Moskalev , Arnold Smeulders

We introduce deep scale-spaces (DSS), a generalization of convolutional neural networks, exploiting the scale symmetry structure of conventional image recognition tasks. Put plainly, the class of an image is invariant to the scale at which…

Machine Learning · Computer Science 2019-05-29 Daniel E. Worrall , Max Welling

In computer vision, models must be able to adapt to changes in image resolution to effectively carry out tasks such as image segmentation; This is known as scale-equivariance. Recent works have made progress in developing scale-equivariant…

Machine Learning · Computer Science 2023-11-07 Md Ashiqur Rahman , Raymond A. Yeh

The widespread success of convolutional neural networks may largely be attributed to their intrinsic property of translation equivariance. However, convolutions are not equivariant to variations in scale and fail to generalize to objects of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Thomas Altstidl , An Nguyen , Leo Schwinn , Franz Köferl , Christopher Mutschler , Björn Eskofier , Dario Zanca

Most of the recent successful methods in accurate object detection build on the convolutional neural networks (CNN). However, due to the lack of scale normalization in CNN-based detection methods, the activated channels in the feature space…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Yonghyun Kim , Bong-Nam Kang , Daijin Kim

Convolutional networks are successful, but they have recently been outperformed by new neural networks that are equivariant under rotations and translations. These new networks work better because they do not struggle with learning each…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Philip Müller , Vladimir Golkov , Valentina Tomassini , Daniel Cremers

Deep Neural Networks (DNNs) have shown unparalleled achievements in numerous applications, reflecting their proficiency in managing vast data sets. Yet, their static structure limits their adaptability in ever-changing environments. This…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Yunjie Zhu , Yunhao Chen

Convolutional Neural Network(CNN) has been widely used for image recognition with great success. However, there are a number of limitations of the current CNN based image recognition paradigm. First, the receptive field of CNN is generally…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Dong-Qing Zhang

In neural networks, the property of being equivariant to transformations improves generalization when the corresponding symmetry is present in the data. In particular, scale-equivariant networks are suited to computer vision tasks where the…

Machine Learning · Statistics 2022-10-11 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

The introduction of convolutional layers greatly advanced the performance of neural networks on image tasks due to innately capturing a way of encoding and learning translation-invariant operations, matching one of the underlying symmetries…

Computer Vision and Pattern Recognition · Computer Science 2016-12-15 Nicholas Guttenberg , Nathaniel Virgo , Olaf Witkowski , Hidetoshi Aoki , Ryota Kanai

The use of Convolutional Neural Networks (CNNs) is widespread in Deep Learning due to a range of desirable model properties which result in an efficient and effective machine learning framework. However, performant CNN architectures must be…

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further improve parameter…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Ivan Diaz , Mario Geiger , Richard Iain McKinley

Convolutional Neural Networks (CNNs) have shown remarkable progress in medical image segmentation. However, lesion segmentation remains a challenge to state-of-the-art CNN-based algorithms due to the variance in scales and shapes. On the…

Image and Video Processing · Electrical Eng. & Systems 2023-05-31 Yanwen Li , Luyang Luo , Huangjing Lin , Pheng-Ann Heng , Hao Chen

Equivariance of neural networks to transformations helps to improve their performance and reduce generalization error in computer vision tasks, as they apply to datasets presenting symmetries (e.g. scalings, rotations, translations). The…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesus Angulo

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

The purpose of this short and simple note is to clarify a common misconception about convolutional neural networks (CNNs). CNNs are made up of convolutional layers which are shift equivariant due to weight sharing. However, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Nick McGreivy , Ammar Hakim

Convolutional neural networks (CNNs) have massively impacted visual recognition in 2D images, and are now ubiquitous in state-of-the-art approaches. CNNs do not easily extend, however, to data that are not represented by regular grids, such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Nitika Verma , Edmond Boyer , Jakob Verbeek

Convolutional Neural Networks (CNN) offer state of the art performance in various computer vision tasks. Many of those tasks require different subtypes of affine invariances (scale, rotational, translational) to image transformations.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Facundo Manuel Quiroga , Franco Ronchetti , Laura Lanzarini , Aurelio Fernandez-Bariviera

In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object's orientation and on a sensor's flight path, objects of the same semantic class can be observed in different orientations in the same image.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Diego Marcos , Michele Volpi , Benjamin Kellenberger , Devis Tuia