English
Related papers

Related papers: Roto-Translation Equivariant Convolutional Network…

200 papers

We propose a semantic segmentation model that exploits rotation and reflection symmetries. We demonstrate significant gains in sample efficiency due to increased weight sharing, as well as improvements in robustness to symmetry…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Jasper Linmans , Jim Winkens , Bastiaan S. Veeling , Taco S. Cohen , Max Welling

In many computer vision tasks, we expect a particular behavior of the output with respect to rotations of the input image. If this relationship is explicitly encoded, instead of treated as any other variation, the complexity of the problem…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Diego Marcos , Michele Volpi , Nikos Komodakis , Devis Tuia

We analyze the role of rotational equivariance in convolutional neural networks (CNNs) applied to spherical images. We compare the performance of the group equivariant networks known as S2CNNs and standard non-equivariant CNNs trained with…

Machine Learning · Computer Science 2022-07-13 Jan E. Gerken , Oscar Carlsson , Hampus Linander , Fredrik Ohlsson , Christoffer Petersson , Daniel Persson

Convolutional neural networks (CNNs) allow for parameter sharing and translational equivariance by using convolutional kernels in their linear layers. By restricting these kernels to be SO(3)-steerable, CNNs can further improve parameter…

Image and Video Processing · Electrical Eng. & Systems 2024-05-20 Ivan Diaz , Mario Geiger , Richard Iain McKinley

Convolutional Neural Networks (CNNs) perform very well in image classification and object detection in recent years, but even the most advanced models have limited rotation invariance. Known solutions include the enhancement of training…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Zongbo Hao , Tao Zhang , Mingwang Chen , Kaixu Zhou

Vision Transformers (ViTs) have gained rapid adoption in computational pathology for their ability to model long-range dependencies through self-attention, addressing the limitations of convolutional neural networks that excel at local…

Image and Video Processing · Electrical Eng. & Systems 2026-01-15 Fuyao Chen , Yuexi Du , Elèonore V. Lieffrig , Nicha C. Dvornek , John A. Onofrey

The big empirical success of group equivariant networks has led in recent years to the sprouting of a great variety of equivariant network architectures. A particular focus has thereby been on rotation and reflection equivariant CNNs for…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Maurice Weiler , Gabriele Cesa

Group equivariant neural networks have been explored in the past few years and are interesting from theoretical and practical standpoints. They leverage concepts from group representation theory, non-commutative harmonic analysis and…

Machine Learning · Computer Science 2020-05-01 Carlos Esteves

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

In remote sensing images, the absolute orientation of objects is arbitrary. Depending on an object's orientation and on a sensor's flight path, objects of the same semantic class can be observed in different orientations in the same image.…

Computer Vision and Pattern Recognition · Computer Science 2018-03-19 Diego Marcos , Michele Volpi , Benjamin Kellenberger , Devis Tuia

Many classes of images exhibit rotational symmetry. Convolutional neural networks are sometimes trained using data augmentation to exploit this, but they are still required to learn the rotation equivariance properties from the data.…

Machine Learning · Computer Science 2016-05-27 Sander Dieleman , Jeffrey De Fauw , Koray Kavukcuoglu

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

A wide range of techniques have been proposed in recent years for designing neural networks for 3D data that are equivariant under rotation and translation of the input. Most approaches for equivariance under the Euclidean group…

Computational Geometry · Computer Science 2022-11-30 Adrien Poulenard , Maks Ovsjanikov , Leonidas J. Guibas

This paper investigates the super-resolution (SR) of velocity fields in two-dimensional fluids from the viewpoint of rotational equivariance. SR refers to techniques that estimate high-resolution images from those in low resolution and has…

Fluid Dynamics · Physics 2022-10-26 Yuki Yasuda , Ryo Onishi

In this work we investigate how to achieve equivariance to input transformations in deep networks, purely from data, without being given a model of those transformations. Convolutional Neural Networks (CNNs), for example, are equivariant to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Jianbo Jiao , João F. Henriques

Equivariance is a nice property to have as it produces much more parameter efficient neural architectures and preserves the structure of the input through the feature mapping. Even though some combinations of transformations might never…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 David W. Romero , Mark Hoogendoorn

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zikai Sun , Thierry Blu

Automatic tumor segmentation is a crucial step in medical image analysis for computer-aided diagnosis. Although the existing methods based on convolutional neural networks (CNNs) have achieved the state-of-the-art performance, many…

Image and Video Processing · Electrical Eng. & Systems 2020-05-11 Shuchao Pang , Anan Du , Mehmet A. Orgun , Yan Wang , Quanzheng Sheng , Shoujin Wang , Xiaoshui Huang , Zhemei Yu

Weight sharing in convolutional neural networks (CNNs) ensures that their feature maps will be translation-equivariant. However, although conventional convolutions are equivariant to translation, they are not equivariant to other isometries…

Instrumentation and Methods for Astrophysics · Physics 2021-03-10 Anna M. M. Scaife , Fiona Porter

This paper is concerned with a fundamental problem in geometric deep learning that arises in the construction of convolutional neural networks on surfaces. Due to curvature, the transport of filter kernels on surfaces results in a…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Ruben Wiersma , Elmar Eisemann , Klaus Hildebrandt