English
Related papers

Related papers: Scalars are universal: Equivariant machine learnin…

200 papers

Symmetry groups allow to transform solutions of differential equations continuously into other solutions. This property can be used for the observability analysis of infinite-dimensional systems with input and output. In this contribution,…

Optimization and Control · Mathematics 2019-05-28 Bernd Kolar , Markus Schöberl

Let G be any of the complex classical groups GL(n), SO(2n+1), Sp(2n), O(2n), let g denote the Lie algebra of G, and let Z(g) denote the subalgebra of G-invariants in the universal enveloping algebra U(g). We derive a Taylor-type expansion…

q-alg · Mathematics 2008-03-02 Andrei Okounkov , Grigori Olshanski

We explore the universality of neural encodings in convolutional neural networks trained on image classification tasks. We develop a procedure to directly compare the learned weights rather than their representations. It is based on a…

Machine Learning · Computer Science 2024-10-01 Florentin Guth , Brice Ménard

It is common practice to describe elementary particles by irreducible unitary representations of the Poincar\'e group. In the same way, multi-particle systems can be described by irreducible unitary representations of the Poincar\'e group.…

General Physics · Physics 2023-07-18 Walter Smilga

Group equivariant convolutional neural networks (G-CNNs) are generalizations of convolutional neural networks (CNNs) which excel in a wide range of technical applications by explicitly encoding symmetries, such as rotations and…

Machine Learning · Computer Science 2022-09-14 Hannah Lawrence , Kristian Georgiev , Andrew Dienes , Bobak T. Kiani

We present a direct confirmation of the validity of the equivalence principle for unstructured test bodies in scalar tensor gravity. Our analysis is complementary to previous approaches and valid for a large class of scalar-tensor theories…

General Relativity and Quantum Cosmology · Physics 2015-10-21 Dirk Puetzfeld , Yuri N. Obukhov

We show that, as a result of non-linear self-interactions, it is feasible, at least in light of the bounds coming from terrestrial tests of gravity, measurements of the Casimir force and those constraints imposed by the physics of compact…

High Energy Physics - Phenomenology · Physics 2008-11-26 David F. Mota , Douglas J. Shaw

Recent years have witnessed a hot wave of deep neural networks in various domains; however, it is not yet well understood theoretically. A theoretical characterization of deep neural networks should point out their approximation ability and…

Machine Learning · Computer Science 2022-10-28 Gao Zhang , Jin-Hui Wu , Shao-Qun Zhang

Group convolutions and cross-correlations, which are equivariant to the actions of group elements, are commonly used in mathematics to analyze or take advantage of symmetries inherent in a given problem setting. Here, we provide efficient…

Systems of equations are invariant under "polydimensional transformations" which reshuffle the geometry such that what is a line or a plane is dependent upon the frame of reference. This leads us to propose an extension of Clifford calculus…

General Relativity and Quantum Cosmology · Physics 2007-05-23 William M. Pezzaglia

The universal approximation theorem asserts that a single hidden layer neural network approximates continuous functions with any desired precision on compact sets. As an existential result, the universal approximation theorem supports the…

Machine Learning · Computer Science 2023-09-15 Wington L. Vital , Guilherme Vieira , Marcos Eduardo Valle

The symmetries of a scalar field theory in multifractional spacetimes are analyzed. The free theory realizes the Poincar\'e algebra, and the associated symmetries are modifications of ordinary translations and Lorentz transformations. In…

High Energy Physics - Theory · Physics 2013-04-05 Gianluca Calcagni , Giuseppe Nardelli

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

We present a novel equivalence between scale-dependent gravity and scalar-tensor theories that have only a single scalar field with a canonical kinetic term in the Einstein frame and a conformal coupling to the metric tensor. In particular,…

General Relativity and Quantum Cosmology · Physics 2026-02-25 Philipp Neckam , Christian Käding , Benjamin Koch , Cristobal Laporte , Mario Pitschmann , Ali Riahinia , Angel Rincon

Equivariance is a nice property to have as it produces much more parameter efficient neural architectures and preserves the structure of the input through the feature mapping. Even though some combinations of transformations might never…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 David W. Romero , Mark Hoogendoorn

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of research into…

Many scientific and geometric problems exhibit general linear symmetries, yet most equivariant neural networks are built for compact groups or simple vector features, limiting their reuse on matrix-valued data such as covariances, inertias,…

Machine Learning · Computer Science 2026-02-02 Chankyo Kim , Sicheng Zhao , Minghan Zhu , Tzu-Yuan Lin , Maani Ghaffari

Spin models are widely studied in the natural sciences, from investigating magnetic materials in condensed matter physics to studying neural networks. Previous work has demonstrated that there exist simple classical spin models that are…

Statistical Mechanics · Physics 2019-05-22 Tamara Kohler , Toby Cubitt

Many practical problems need the output of a machine learning model to satisfy a set of constraints, $K$. Nevertheless, there is no known guarantee that classical neural network architectures can exactly encode constraints while…

Machine Learning · Computer Science 2022-02-10 Anastasis Kratsios , Behnoosh Zamanlooy , Tianlin Liu , Ivan Dokmanić

We present the basic elements of a generalization of symmetric function theory involving functions of commuting and anticommuting (Grassmannian) variables. These new functions, called symmetric functions in superspace, are invariant under…

Combinatorics · Mathematics 2012-08-13 Patrick Desrosiers , Luc Lapointe , Pierre Mathieu