English
Related papers

Related papers: Learning Equivariant Representations

200 papers

Histology images are inherently symmetric under rotation, where each orientation is equally as likely to appear. However, this rotational symmetry is not widely utilised as prior knowledge in modern Convolutional Neural Networks (CNNs),…

Image and Video Processing · Electrical Eng. & Systems 2020-07-21 Simon Graham , David Epstein , Nasir Rajpoot

In this paper we construct and theoretically analyse group equivariant convolutional kernel networks (CKNs) which are useful in understanding the geometry of (equivariant) CNNs through the lens of reproducing kernel Hilbert spaces (RKHSs).…

Machine Learning · Computer Science 2024-08-09 Soutrik Roy Chowdhury

In this paper we review the mathematical foundations of convolutional neural nets (CNNs) with the goals of: i) highlighting connections with techniques from statistics, signal processing, linear algebra, differential equations, and…

Machine Learning · Computer Science 2021-07-08 Shengli Jiang , Victor M. Zavala

With the impressive capability to capture visual content, deep convolutional neural networks (CNN) have demon- strated promising performance in various vision-based ap- plications, such as classification, recognition, and objec- t…

Computer Vision and Pattern Recognition · Computer Science 2015-09-16 Zhen Liu

Convolutional neural networks owe much of their success to hard-coding translation equivariance. Quantum convolutional neural networks (QCNNs) have been proposed as near-term quantum analogues, but the relevant notion of translation depends…

Quantum Physics · Physics 2026-04-28 Dmitry Chirkov , Igor Lobanov

Analyzing multivariate time series data is important for many applications such as automated control, fault diagnosis and anomaly detection. One of the key challenges is to learn latent features automatically from dynamically changing…

Machine Learning · Computer Science 2018-06-01 Subin Yi , Janghoon Ju , Man-Ki Yoon , Jaesik Choi

Most existing neural networks for learning graphs address permutation invariance by conceiving of the network as a message passing scheme, where each node sums the feature vectors coming from its neighbors. We argue that this imposes a…

Machine Learning · Computer Science 2018-01-09 Risi Kondor , Hy Truong Son , Horace Pan , Brandon Anderson , Shubhendu Trivedi

We propose a framework for rotation and translation covariant deep learning using $SE(2)$ group convolutions. The group product of the special Euclidean motion group $SE(2)$ describes how a concatenation of two roto-translations results in…

Computer Vision and Pattern Recognition · Computer Science 2018-06-12 Erik J Bekkers , Maxime W Lafarge , Mitko Veta , Koen AJ Eppenhof , Josien PW Pluim , Remco Duits

Convolutional neural networks have been extremely successful in the image recognition domain because they ensure equivariance to translations. There have been many recent attempts to generalize this framework to other domains, including…

Machine Learning · Statistics 2018-11-13 Risi Kondor , Shubhendu Trivedi

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance,…

Machine Learning · Computer Science 2024-07-09 Maksim Zhdanov , David Ruhe , Maurice Weiler , Ana Lucic , Johannes Brandstetter , Patrick Forré

CNNs exhibit inherent equivariance to image translation, leading to efficient parameter and data usage, faster learning, and improved robustness. The concept of translation equivariant networks has been successfully extended to rotation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Tomáš Karella , Adam Harmanec , Jan Kotera , Jan Blažek , Filip Šroubek

Equivariant neural networks provide a principled framework for incorporating symmetry into learning architectures and have been extensively analyzed through the lens of their separation power, that is, the ability to distinguish inputs…

Machine Learning · Computer Science 2026-02-04 Marco Pacini , Gabriele Santin , Bruno Lepri , Shubhendu Trivedi

We characterize the class of image plane transformations which realize rigid camera motions and call these transformations `rigidity preserving'. In particular, 2D translations of pinhole images are not rigidity preserving. Hence, when…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Lucas Brynte , Georg Bökman , Axel Flinth , Fredrik Kahl

Metric learning has received conflicting assessments concerning its suitability for solving instance segmentation tasks. It has been dismissed as theoretically flawed due to the shift equivariance of the employed CNNs and their respective…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Josef Lorenz Rumberger , Xiaoyan Yu , Peter Hirsch , Melanie Dohmen , Vanessa Emanuela Guarino , Ashkan Mokarian , Lisa Mais , Jan Funke , Dagmar Kainmueller

Many scientific problems require to process data in the form of geometric graphs. Unlike generic graph data, geometric graphs exhibit symmetries of translations, rotations, and/or reflections. Researchers have leveraged such inductive bias…

Machine Learning · Computer Science 2022-02-23 Jiaqi Han , Yu Rong , Tingyang Xu , Wenbing Huang

This paper investigates the super-resolution (SR) of velocity fields in two-dimensional fluids from the viewpoint of rotational equivariance. SR refers to techniques that estimate high-resolution images from those in low resolution and has…

Fluid Dynamics · Physics 2022-10-26 Yuki Yasuda , Ryo Onishi

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

Convolutional neural networks (CNNs) have been employed along with Variational Monte Carlo methods for finding the ground state of quantum many-body spin systems with great success. In order to do so, however, a CNN with only linearly many…

Quantum Physics · Physics 2022-10-04 Yilong Ju , Shah Saad Alam , Jonathan Minoff , Fabio Anselmi , Han Pu , Ankit Patel

Rotational symmetry is a defining feature of many tomography systems, including computed tomography (CT) and emission computed tomography (ECT), where detectors are arranged in a circular or periodically rotating configuration. This study…

Medical Physics · Physics 2025-02-05 Yaogong Zhang , Fang-Fang Yin , Lei Zhang

Convolutional Neural Network (CNN) features have been successfully employed in recent works as an image descriptor for various vision tasks. But the inability of the deep CNN features to exhibit invariance to geometric transformations and…

Computer Vision and Pattern Recognition · Computer Science 2015-04-27 Konda Reddy Mopuri , R. Venkatesh Babu