English
Related papers

Related papers: Learning Invariant Representations for Equivariant…

200 papers

With the advent of group equivariant convolutions in deep networks literature, spherical CNNs with $\mathsf{SO}(3)$-equivariant layers have been developed to cope with data that are samples of signals on the sphere $S^2$. One can implicitly…

Computer Vision and Pattern Recognition · Computer Science 2023-05-29 Gianfranco Cortes , Yue Yu , Robin Chen , Melissa Armstrong , David Vaillancourt , Baba C. Vemuri

Convolutional Neural Networks (CNNs) are powerful models that achieve impressive results for image classification. In addition, pre-trained CNNs are also useful for other computer vision tasks as generic feature extractors. This paper aims…

Computer Vision and Pattern Recognition · Computer Science 2015-07-10 Ben Athiwaratkun , Keegan Kang

Spherical convolutional networks have been introduced recently as tools to learn powerful feature representations of 3D shapes. Spherical CNNs are equivariant to 3D rotations making them ideally suited to applications where 3D data may be…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Carlos Esteves , Avneesh Sud , Zhengyi Luo , Kostas Daniilidis , Ameesh Makadia

We present a novel class of convolutional neural networks (CNNs) for set functions, i.e., data indexed with the powerset of a finite set. The convolutions are derived as linear, shift-equivariant functions for various notions of shifts on…

Machine Learning · Computer Science 2024-06-21 Chris Wendler , Dan Alistarh , Markus Püschel

When seeing a new object, humans can immediately recognize it across different retinal locations: the internal object representation is invariant to translation. It is commonly believed that Convolutional Neural Networks (CNNs) are…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Valerio Biscione , Jeffrey S. Bowers

$G$-equivariant convolutional neural networks (GCNNs) is a geometric deep learning model for data defined on a homogeneous $G$-space $\mathcal{M}$. GCNNs are designed to respect the global symmetry in $\mathcal{M}$, thereby facilitating…

Machine Learning · Computer Science 2022-07-27 Jimmy Aronsson

Many data symmetries can be described in terms of group equivariance and the most common way of encoding group equivariances in neural networks is by building linear layers that are group equivariant. In this work we investigate whether…

Machine Learning · Computer Science 2023-12-11 Georg Bökman , Fredrik Kahl

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

Machine Learning · Computer Science 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

Equivariant machine learning is an approach for designing deep learning models that respect the symmetries of the problem, with the aim of reducing model complexity and improving generalization. In this paper, we focus on an extension of…

Machine Learning · Computer Science 2024-12-10 Ya-Wei Eileen Lin , Ronen Talmon , Ron Levie

Convolutional neural network (CNN) is a neural network that can make use of the internal structure of data such as the 2D structure of image data. This paper studies CNN on text categorization to exploit the 1D structure (namely, word…

Computation and Language · Computer Science 2015-03-27 Rie Johnson , Tong Zhang

In today's digital age, Convolutional Neural Networks (CNNs), a subset of Deep Learning (DL), are widely used for various computer vision tasks such as image classification, object detection, and image segmentation. There are numerous types…

Machine Learning · Computer Science 2024-02-29 Abolfazl Younesi , Mohsen Ansari , MohammadAmin Fazli , Alireza Ejlali , Muhammad Shafique , Jörg Henkel

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

Most modern convolutional neural networks (CNNs) used for object recognition are built using the same principles: Alternating convolution and max-pooling layers followed by a small number of fully connected layers. We re-evaluate the state…

Machine Learning · Computer Science 2015-04-14 Jost Tobias Springenberg , Alexey Dosovitskiy , Thomas Brox , Martin Riedmiller

Convolutional Neural Networks (CNNs) require large image corpora to be trained on classification tasks. The variation in image resolutions, sizes of objects and patterns depicted, and image scales, hampers CNN training and performance,…

Computer Vision and Pattern Recognition · Computer Science 2016-05-16 Nanne van Noord , Eric Postma

Convolutional Neural Networks (CNNs) have revolutionized the understanding of visual content. This is mainly due to their ability to break down an image into smaller pieces, extract multi-scale localized features and compose them to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zachary Wharton , Ardhendu Behera , Asish Bera

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

Equivariant neural networks have shown improved performance, expressiveness and sample complexity on symmetrical domains. But for some specific symmetries, representations, and choice of coordinates, the most common point-wise activations,…

Machine Learning · Computer Science 2024-01-18 Marco Pacini , Xiaowen Dong , Bruno Lepri , Gabriele Santin

In recent years, convolutional neural network has shown good performance in many image processing and computer vision tasks. However, a standard CNN model is not invariant to image rotations. In fact, even slight rotation of an input image…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Hanlin Mo , Guoying Zhao

CoVariance Neural Networks (VNNs) perform convolutions on the graph determined by the covariance matrix of the data, which enables expressive and stable covariance-based learning. However, covariance matrices are typically dense, fail to…

Machine Learning · Computer Science 2026-01-21 Andrea Cavallo , Samuel Rey , Antonio G. Marques , Elvin Isufi

Feature extraction with convolutional neural networks (CNNs) is a popular method to represent images for machine learning tasks. These representations seek to capture global image content, and ideally should be independent of geometric…

Machine Learning · Computer Science 2022-03-03 Jake Lee , Junfeng Yang , Zhangyang Wang