English
Related papers

Related papers: Learning Equivariant Functions via Quadratic Forms

200 papers

The translational equivariant nature of Convolutional Neural Networks (CNNs) is a reason for its great success in computer vision. However, networks do not enjoy more general equivariance properties such as rotation or scaling, ultimately…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Zikai Sun , Thierry Blu

In this paper, we observe a fixed number of unknown $2\pi$-periodic functions differing from each other by both phases and amplitude. This semiparametric model appears in literature under the name "shape invariant model." While the common…

Statistics Theory · Mathematics 2010-10-06 Myriam Vimond

This paper studies separating invariants: mappings on $D$ dimensional domains which are invariant to an appropriate group action, and which separate orbits. The motivation for this study comes from the usefulness of separating invariants in…

Machine Learning · Computer Science 2023-11-22 Nadav Dym , Steven J. Gortler

Group equivariant neural networks are used as building blocks of group invariant neural networks, which have been shown to improve generalisation performance and data efficiency through principled parameter sharing. Such works have mostly…

Machine Learning · Computer Science 2021-06-17 Michael Hutchinson , Charline Le Lan , Sheheryar Zaidi , Emilien Dupont , Yee Whye Teh , Hyunjik Kim

Given a finite p-group G acting on a smooth projective curve X over an algebraically closed field k of characteristic p, the dimension of the tangent space of the associated equivariant deformation functor is equal to the dimension of the…

Algebraic Geometry · Mathematics 2011-04-19 Bernhard Köck , Aristides Kontogeorgis

A number of machine learning tasks entail a high degree of invariance: the data distribution does not change if we act on the data with a certain group of transformations. For instance, labels of images are invariant under translations of…

Machine Learning · Statistics 2021-03-01 Song Mei , Theodor Misiakiewicz , Andrea Montanari

Invariance (defined in a general sense) has been one of the most effective priors for representation learning. Direct factorization of parametric models is feasible only for a small range of invariances, while regularization approaches,…

Machine Learning · Computer Science 2020-07-28 Yingyi Ma , Vignesh Ganapathiraman , Yaoliang Yu , Xinhua Zhang

Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing,…

Machine Learning · Computer Science 2024-08-14 Nicholas H. Nelsen , Andrew M. Stuart

There are (at least) two different approaches to define equivariant analogue of the Euler charateristic for a space with a finite group action. The first one defines it as an element of the Burnside ring of the group. The second approach…

Algebraic Geometry · Mathematics 2016-05-11 S. M. Gusein-Zade , I. Luengo , A. Melle-Hernández

Symmetry is present in many tasks in computer vision, where the same class of objects can appear transformed, e.g. rotated due to different camera orientations, or scaled due to perspective. The knowledge of such symmetries in data coupled…

Image and Video Processing · Electrical Eng. & Systems 2022-07-25 Mateus Sangalli , Samy Blusseau , Santiago Velasco-Forero , Jesús Angulo

Tractably modelling distributions over manifolds has long been an important goal in the natural sciences. Recent work has focused on developing general machine learning models to learn such distributions. However, for many applications…

Machine Learning · Statistics 2022-01-31 Isay Katsman , Aaron Lou , Derek Lim , Qingxuan Jiang , Ser-Nam Lim , Christopher De Sa

We define and study multivariate exponential functions, symmetric with respect to the alternating group A_n, which is a subgroup of the permutation (symmetric) group S_n. These functions are connected with multivariate exponential…

Mathematical Physics · Physics 2009-07-06 Anatoly Klimyk , Jiri Patera

We prove an implicit function theorem for functions on infinite-dimensional Banach manifolds, invariant under the (local) action of a finite dimensional Lie group. Motivated by some geometric variational problems, we consider group actions…

Differential Geometry · Mathematics 2015-02-10 Renato G. Bettiol , Paolo Piccione , Gaetano Siciliano

A variational model for learning convolutional image atoms from corrupted and/or incomplete data is introduced and analyzed both in function space and numerically. Building on lifting and relaxation strategies, the proposed approach is…

Optimization and Control · Mathematics 2018-12-10 Antonin Chambolle , Martin Holler Thomas Pock

We study equivariant deformations of singular curves with an action of a finite flat group scheme, using a simplified version of Illusie's equivariant cotangent complex. We apply these methods in a special case which is relevant for the…

Algebraic Geometry · Mathematics 2007-05-23 Stefan Wewers

While end-to-end approaches have achieved state-of-the-art performance in many perception tasks, they are not yet able to compete with 3D geometry-based methods in pose estimation. Moreover, absolute pose regression has been shown to be…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Mohamed Adel Musallam , Vincent Gaudilliere , Miguel Ortiz del Castillo , Kassem Al Ismaeil , Djamila Aouada

Complex systems manifest a small number of instabilities and bifurcations that are canonical in nature, resulting in universal pattern forming characteristics as a function of some parametric dependence. Such parametric instabilities are…

Machine Learning · Computer Science 2021-06-10 Manu Kalia , Steven L. Brunton , Hil G. E. Meijer , Christoph Brune , J. Nathan Kutz

Grouping has been commonly used in deep metric learning for computing diverse features. However, current methods are prone to overfitting and lack interpretability. In this work, we propose an improved and interpretable grouping method to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-26 Xinyi Xu , Zhengyang Wang , Cheng Deng , Hao Yuan , Shuiwang Ji

I present a novel equivariant neural network architecture for the large-scale spin dynamics simulation of the Kondo lattice model. This neural network mainly consists of tensor-product-based convolution layers and ensures two equivariances:…

Strongly Correlated Electrons · Physics 2023-10-12 Yu Miyazaki

Convolutional neural networks revolutionized computer vision and natrual language processing. Their efficiency, as compared to fully connected neural networks, has its origin in the architecture, where convolutions reflect the translation…

Machine Learning · Computer Science 2023-01-10 Patrick Krüger , Hanno Gottschalk