English
Related papers

Related papers: Empowering Networks With Scale and Rotation Equiva…

200 papers

There has been enormous progress in the last few years in designing neural networks that respect the fundamental symmetries and coordinate freedoms of physical law. Some of these frameworks make use of irreducible representations, some make…

Machine Learning · Computer Science 2023-02-09 Soledad Villar , David W. Hogg , Kate Storey-Fisher , Weichi Yao , Ben Blum-Smith

Convolutional neural networks (CNNs) have rapidly risen in popularity for many machine learning applications, particularly in the field of image recognition. Much of the benefit generated from these networks comes from their ability to…

Quantum Physics · Physics 2019-04-10 Maxwell Henderson , Samriddhi Shakya , Shashindra Pradhan , Tristan Cook

We address the problem of 3D rotation equivariance in convolutional neural networks. 3D rotations have been a challenging nuisance in 3D classification tasks requiring higher capacity and extended data augmentation in order to tackle it. We…

Computer Vision and Pattern Recognition · Computer Science 2018-10-01 Carlos Esteves , Christine Allen-Blanchette , Ameesh Makadia , Kostas Daniilidis

Convolutional Neural Networks (CNNs) have proven to be highly effective in solving a broad spectrum of computer vision tasks, such as classification, identification, and segmentation. These methods can be deployed in both centralized and…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-12 Victor Forattini Jansen , Emanuel Teixeira Martins , Yasmin Souza Lima , Flavio de Oliveira Silva , Rodrigo Moreira , Larissa Ferreira Rodrigues Moreira

The success of convolutional networks in learning problems involving planar signals such as images is due to their ability to exploit the translation symmetry of the data distribution through weight sharing. Many areas of science and…

Machine Learning · Computer Science 2019-04-23 Taco Cohen , Mario Geiger , Jonas Köhler , Max Welling

Although provably robust to translational perturbations, convolutional neural networks (CNNs) are known to suffer from extreme performance degradation when presented at test time with more general geometric transformations of inputs.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Lachlan Ewen MacDonald , Sameera Ramasinghe , Simon Lucey

Invariances to translations have imbued convolutional neural networks with powerful generalization properties. However, we often do not know a priori what invariances are present in the data, or to what extent a model should be invariant to…

Machine Learning · Computer Science 2020-12-02 Gregory Benton , Marc Finzi , Pavel Izmailov , Andrew Gordon Wilson

The majority of medical images, especially those that resemble cells, have similar characteristics. These images, which occur in a variety of shapes, often show abnormalities in the organ or cell region. The convolution operation possesses…

When seeing a new object, humans can immediately recognize it across different retinal locations: we say that the internal object representation is invariant to translation. It is commonly believed that Convolutional Neural Networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2020-11-25 Valerio Biscione , Jeffrey Bowers

Metric learning has received conflicting assessments concerning its suitability for solving instance segmentation tasks. It has been dismissed as theoretically flawed due to the shift equivariance of the employed CNNs and their respective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Josef Lorenz Rumberger , Xiaoyan Yu , Peter Hirsch , Melanie Dohmen , Vanessa Emanuela Guarino , Ashkan Mokarian , Lisa Mais , Jan Funke , Dagmar Kainmueller

Radio spectrum monitoring in contested environments motivates the need for reliable automatic signal classification technology. Prior work highlights deep learning as a promising approach, but existing models depend on brute-force Doppler…

Signal Processing · Electrical Eng. & Systems 2025-11-19 Avi Bagchi , Dwight Hutchenson

Extracting discriminative local features that are invariant to imaging variations is an integral part of establishing correspondences between images. In this work, we introduce a self-supervised learning framework to extract discriminative…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Jongmin Lee , Byungjin Kim , Seungwook Kim , Minsu Cho

In this paper we propose integrating a priori knowledge into both design and training of convolutional neural networks (CNNs) to learn object representations that are invariant to affine transformations (i.e., translation, scale, rotation).…

Computer Vision and Pattern Recognition · Computer Science 2019-09-04 Xenju Xu , Guanghui Wang , Alan Sullivan , Ziming Zhang

During the last years, Convolutional Neural Networks (CNNs) have achieved state-of-the-art performance in image classification. Their architectures have largely drawn inspiration by models of the primate visual system. However, while recent…

Computer Vision and Pattern Recognition · Computer Science 2017-08-24 Georgios Zoumpourlis , Alexandros Doumanoglou , Nicholas Vretos , Petros Daras

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

Extending the translation equivariance property of convolutional neural networks to larger symmetry groups has been shown to reduce sample complexity and enable more discriminative feature learning. Further, exploiting additional symmetries…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Lisa Weijler , Pedro Hermosilla

Vision transformers have become popular as a possible substitute to convolutional neural networks (CNNs) for a variety of computer vision applications. These transformers, with their ability to focus on global relationships in images, offer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Asifullah Khan , Zunaira Rauf , Anabia Sohail , Abdul Rehman , Hifsa Asif , Aqsa Asif , Umair Farooq

Convolutional Neural Networks (CNNs) have been widely applied. But as the CNNs grow, the number of arithmetic operations and memory footprint also increase. Furthermore, typical non-linear activation functions do not allow associativity of…

Machine Learning · Computer Science 2021-11-10 Eduardo Vera Sousa , Leandro A. F. Fernandes , Cristina Nader Vasconcelos

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

Convolutional neural networks (CNNs) are essential tools for computer vision tasks, but they lack traditionally desired properties of extracted features that could further improve model performance, e.g., rotational equivariance. Such…

Computer Vision and Pattern Recognition · Computer Science 2025-01-17 Yuexi Du , Jiazhen Zhang , Tal Zeevi , Nicha C. Dvornek , John A. Onofrey