English
Related papers

Related papers: Learning Invariant Representations Of Planar Curve…

200 papers

We develop a new method for visualizing and refining the invariances of learned representations. Specifically, we test for a general form of invariance, linearization, in which the action of a transformation is confined to a low-dimensional…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Olivier J. Hénaff , Eero P. Simoncelli

Equivariant neural networks incorporate symmetries through group actions, embedding them as an inductive bias to improve performance. Existing methods learn an equivariant action on the latent space, or design architectures that are…

Machine Learning · Computer Science 2026-05-19 Riccardo Ali , Pietro Liò , Jamie Vicary

Clifford Group Equivariant Neural Networks (CGENNs) leverage Clifford algebras and multivectors as an alternative approach to incorporating group equivariance to ensure symmetry constraints in neural representations. In principle, this…

Machine Learning · Computer Science 2025-06-11 Riccardo Ali , Paulina Kulytė , Haitz Sáez de Ocáriz Borde , Pietro Liò

We propose a neural parameterization of convex sets by learning sublinear (positively homogeneous and convex) functions. Our networks implicitly represent both the support and gauge functions of a convex body. We prove a universal…

Optimization and Control · Mathematics 2026-05-06 Eloi Martinet

It has been observed that representations learned by distinct neural networks conceal structural similarities when the models are trained under similar inductive biases. From a geometric perspective, identifying the classes of…

Machine Learning · Computer Science 2024-03-21 Irene Cannistraci , Luca Moschella , Marco Fumero , Valentino Maiorca , Emanuele Rodolà

Many successful deep learning architectures are equivariant to certain transformations in order to conserve parameters and improve generalization: most famously, convolution layers are equivariant to shifts of the input. This approach only…

Machine Learning · Computer Science 2021-03-31 Allan Zhou , Tom Knowles , Chelsea Finn

We address the problem of determining correspondences between two images in agreement with a geometric model such as an affine or thin-plate spline transformation, and estimating its parameters. The contributions of this work are…

Computer Vision and Pattern Recognition · Computer Science 2017-04-17 Ignacio Rocco , Relja Arandjelović , Josef Sivic

Self-supervised learning converts raw perceptual data such as images to a compact space where simple Euclidean distances measure meaningful variations in data. In this paper, we extend this formulation by adding additional geometric…

Machine Learning · Computer Science 2023-06-27 Sharut Gupta , Joshua Robinson , Derek Lim , Soledad Villar , Stefanie Jegelka

Many supervised learning problems involve high-dimensional data such as images, text, or graphs. In order to make efficient use of data, it is often useful to leverage certain geometric priors in the problem at hand, such as invariance to…

Machine Learning · Statistics 2021-11-08 Alberto Bietti , Luca Venturi , Joan Bruna

In this work, we used deep neural networks (DNNs) to solve a fundamental problem in differential geometry. One can find many closed-form expressions for calculating curvature, length, and other geometric properties in the literature. As we…

Graphics · Computer Science 2021-02-04 Barak Or , Liam Hazan

We propose a general architecture that combines the coefficient learning scheme with a residual operator layer for learning mappings between continuous functions in the 3D Euclidean space. Our proposed model is guaranteed to achieve…

Machine Learning · Computer Science 2023-11-21 Chaoran Cheng , Jian Peng

Symmetries built into a neural network have appeared to be very beneficial for a wide range of tasks as it saves the data to learn them. We depart from the position that when symmetries are not built into a model a priori, it is…

Machine Learning · Computer Science 2023-02-01 Artem Moskalev , Anna Sepliarskaia , Ivan Sosnovik , Arnold Smeulders

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of…

Machine Learning · Statistics 2021-03-01 Song Mei , Theodor Misiakiewicz , Andrea Montanari

Graph Neural Networks (GNN) can capture the geometric properties of neural representations in EEG data. Here we utilise those to study how reinforcement-based motor learning affects neural activity patterns during motor planning, leveraging…

Machine Learning · Computer Science 2024-11-01 Federico Nardi , Jinpei Han , Shlomi Haar , A. Aldo Faisal

Graph convolutional networks adapt the architecture of convolutional neural networks to learn rich representations of data supported on arbitrary graphs by replacing the convolution operations of convolutional neural networks with…

Signal Processing · Electrical Eng. & Systems 2018-03-14 Addison Bohannon , Brian Sadler , Radu Balan

We present a new approach for predictive modeling and its uncertainty quantification for mechanical systems, where coarse-grained models such as constitutive relations are derived directly from observation data. We explore the use of a…

Numerical Analysis · Mathematics 2020-06-24 Daniel Z. Huang , Kailai Xu , Charbel Farhat , Eric Darve

This paper is concerned with the development, analysis and numerical realization of a novel variational model for the regularization of inverse problems in imaging. The proposed model is inspired by the architecture of generative…

Optimization and Control · Mathematics 2021-11-10 Andreas Habring , Martin Holler

Learning representations through deep generative modeling is a powerful approach for dynamical modeling to discover the most simplified and compressed underlying description of the data, to then use it for other tasks such as prediction.…

Machine Learning · Computer Science 2022-03-01 Bahar Azari , Deniz Erdoğmuş

Symmetry-based neural networks often constrain the architecture in order to achieve invariance or equivariance to a group of transformations. In this paper, we propose an alternative that avoids this architectural constraint by learning to…

Machine Learning · Computer Science 2023-07-10 Sékou-Oumar Kaba , Arnab Kumar Mondal , Yan Zhang , Yoshua Bengio , Siamak Ravanbakhsh

Geometric shape features have been widely used as strong predictors for image classification. Nevertheless, most existing classifiers such as deep neural networks (DNNs) directly leverage the statistical correlations between these shape…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Tonmoy Hossain , Jing Ma , Jundong Li , Miaomiao Zhang