English
Related papers

Related papers: Scalars are universal: Equivariant machine learnin…

200 papers

We introduce a global equivariant refinement of algebraic K-theory; here `global equivariant' refers to simultaneous and compatible actions of all finite groups. Our construction turns a specific kind of categorical input data into a global…

Algebraic Topology · Mathematics 2022-07-05 Stefan Schwede

We study the approximation of shift-invariant or equivariant functions by deep fully convolutional networks from the dynamical systems perspective. We prove that deep residual fully convolutional networks and their continuous-layer…

Machine Learning · Computer Science 2023-05-19 Ting Lin , Zuowei Shen , Qianxiao Li

A solution to the 50 year old problem of a spinning particle in curved space has been recently derived using an extension of Clifford calculus in which each geometric element has its own coordinate. This leads us to propose that all the…

General Relativity and Quantum Cosmology · Physics 2007-05-23 William M. Pezzaglia

Higher order tensor inversion is possible for even order. We have shown that a tensor group endowed with the Einstein (contracted) product is isomorphic to the general linear group of degree $n$. With the isomorphic group structures, we…

Numerical Analysis · Mathematics 2011-09-20 Michael Brazell , Na Li , Carmeliza Navasca , Christino Tamon

We describe a new realization of supersymmetry, called scalar supersymmetry, acting in spaces of differential forms (bi-spinors), where transformation parameters are Lorentz scalars instead of spinors. The realization is related but is not…

High Energy Physics - Phenomenology · Physics 2015-06-11 Alex Jourjine

The task of shape space learning involves mapping a train set of shapes to and from a latent representation space with good generalization properties. Often, real-world collections of shapes have symmetries, which can be defined as…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Matan Atzmon , Koki Nagano , Sanja Fidler , Sameh Khamis , Yaron Lipman

The scalar normal modes of higher dimensional gravitating kink solutions are derived. By perturbing to second order the gravity and matter parts of the action in the background of a five-dimensional kink, the effective Lagrangian of the…

General Relativity and Quantum Cosmology · Physics 2017-08-23 Massimo Giovannini

We propose a metric learning framework for the construction of invariant geometric functions of planar curves for the Eucledian and Similarity group of transformations. We leverage on the representational power of convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-02-20 Gautam Pai , Aaron Wetzler , Ron Kimmel

Reductive Lie Groups, such as the orthogonal groups, the Lorentz group, or the unitary groups, play essential roles across scientific fields as diverse as high energy physics, quantum mechanics, quantum chromodynamics, molecular dynamics,…

Machine Learning · Statistics 2023-06-02 Ilyes Batatia , Mario Geiger , Jose Munoz , Tess Smidt , Lior Silberman , Christoph Ortner

Many problems across computer vision and the natural sciences require the analysis of spherical data, for which representations may be learned efficiently by encoding equivariance to rotational symmetries. We present a generalized spherical…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Oliver J. Cobb , Christopher G. R. Wallis , Augustine N. Mavor-Parker , Augustin Marignier , Matthew A. Price , Mayeul d'Avezac , Jason D. McEwen

A general scalar-tensor theory can be formulated in different parametrizations that are related by a conformal rescaling of the metric and a scalar field redefinition. We compare formulations of slow-roll regimes in the Einstein and Jordan…

General Relativity and Quantum Cosmology · Physics 2016-10-12 Piret Kuusk , Mihkel Rünkla , Margus Saal , Ott Vilson

The new manifestation of conformal invariance for a massless scalar particle in a Riemannian spacetime of general relativity is found. Conformal transformations conserve the Hamiltonian and wave function in the Foldy-Wouthuysen…

Mathematical Physics · Physics 2013-08-07 Alexander J. Silenko

The ability to generalize compositionally is key to understanding the potentially infinite number of sentences that can be constructed in a human language from only a finite number of words. Investigating whether NLP models possess this…

Computation and Language · Computer Science 2022-09-23 Jennifer C. White , Ryan Cotterell

This article shows that one can consistently incorporate nonunitary representations of at least one group into the ``ordinary'' nonrelativistic quantum mechanics. This group turns out to be Lorentz group thus giving us an alternative…

High Energy Physics - Theory · Physics 2007-05-23 Bojan Bistrovic

Any symmetry reduces a second-order differential equation to a first-order equation: variational symmetries of the action (exemplified by central field dynamics) lead to conservation laws, but symmetries of only the equations of motion…

Mathematical Physics · Physics 2011-06-08 Sidney Bludman

In a previous paper [1] we proposed a purely mathematical way to quantum mechanics based on Cartan's simple spinors in their most elementary form of 2 component spinors. Here we proceed along that path proposing, this time, a symmetric…

Mathematical Physics · Physics 2009-12-02 Paolo Budinich

We introduce tensor field neural networks, which are locally equivariant to 3D rotations, translations, and permutations of points at every layer. 3D rotation equivariance removes the need for data augmentation to identify features in…

Machine Learning · Computer Science 2018-05-22 Nathaniel Thomas , Tess Smidt , Steven Kearnes , Lusann Yang , Li Li , Kai Kohlhoff , Patrick Riley

In this paper, we explain the universal approximation capabilities of deep residual neural networks through geometric nonlinear control. Inspired by recent work establishing links between residual networks and control systems, we provide a…

Machine Learning · Computer Science 2024-02-12 Paulo Tabuada , Bahman Gharesifard

Incorporating symmetries can lead to highly data-efficient and generalizable models by defining equivalence classes of data samples related by transformations. However, characterizing how transformations act on input data is often…

Machine Learning · Computer Science 2022-07-04 Jung Yeon Park , Ondrej Biza , Linfeng Zhao , Jan Willem van de Meent , Robin Walters

Simple function classes have emerged as toy problems to better understand in-context-learning in transformer-based architectures used for large language models. But previously proposed simple function classes like linear regression or…

Machine Learning · Computer Science 2024-07-30 Max Wilcoxson , Morten Svendgård , Ria Doshi , Dylan Davis , Reya Vir , Anant Sahai