English
Related papers

Related papers: Equivariant Frames and the Impossibility of Contin…

200 papers

The state-of-the-art tools for practical graph canonization are all based on the individualization-refinement paradigm, and their difference is primarily in the choice of heuristics they include and in the actual tool implementation. It is…

Data Structures and Algorithms · Computer Science 2017-11-23 Jakob L. Andersen , Daniel Merkle

We introduce and study a mathematical framework for a broad class of regularization functionals for ill-posed inverse problems: Regularization Graphs. Regularization graphs allow to construct functionals using as building blocks linear…

Optimization and Control · Mathematics 2022-09-28 Kristian Bredies , Marcello Carioni , Martin Holler

A machine learning model is traditionally considered robust if its prediction remains (almost) constant under input perturbations with small norm. However, real-world tasks like molecular property prediction or point cloud segmentation have…

Machine Learning · Computer Science 2024-01-17 Jan Schuchardt , Yan Scholten , Stephan Günnemann

We introduce canonical weight normalization for convolutional neural networks. Inspired by the canonical tensor decomposition, we express the weight tensors in so-called canonical networks as scaled sums of outer vector products. In…

Machine Learning · Computer Science 2022-06-06 Lokesh Veeramacheneni , Moritz Wolter , Reinhard Klein , Jochen Garcke

Graph canonization is the problem of computing a unique representative, a canon, from the isomorphism class of a given graph. This implies that two graphs are isomorphic exactly if their canons are equal. We show that graphs of bounded tree…

Computational Complexity · Computer Science 2015-06-26 Michael Elberfeld , Pascal Schweitzer

Normalization Equivariance (NE) is a structural prior that improves robustness to distribution shift in image-to-image tasks. A function $f$ is normalization equivariant iff $f(a y + b\mathbf{1}) = a f(y) + b\mathbf{1}$ for all $a>0$ and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Youssef Saied , François Fleuret

The general uncertainty principle applied to gravity can be implemented as a set of modified Poisson brackets in the canonical formalism. As such, the theory is not canonical and the resulting equations of motion do not lead to a covariant…

General Relativity and Quantum Cosmology · Physics 2026-05-08 Douglas M. Gingrich

Applications of machine learning techniques for materials modeling typically involve functions known to be equivariant or invariant to specific symmetries. While graph neural networks (GNNs) have proven successful in such tasks, they…

Group equivariance has emerged as a valuable inductive bias in deep learning, enhancing generalization, data efficiency, and robustness. Classically, group equivariant methods require the groups of interest to be known beforehand, which may…

The expressivity of Graph Neural Networks (GNNs) has been studied broadly in recent years to reveal the design principles for more powerful GNNs. Graph canonization is known as a typical approach to distinguish non-isomorphic graphs, yet…

Machine Learning · Computer Science 2024-02-12 Zehao Dong , Muhan Zhang , Philip R. O. Payne , Michael A Province , Carlos Cruchaga , Tianyu Zhao , Fuhai Li , Yixin Chen

It is widely believed that engineering a model to be invariant/equivariant improves generalisation. Despite the growing popularity of this approach, a precise characterisation of the generalisation benefit is lacking. By considering the…

Machine Learning · Statistics 2021-07-07 Bryn Elesedy , Sheheryar Zaidi

While there are many studies on weight regularization, the study on structure regularization is rare. Many existing systems on structured prediction focus on increasing the level of structural dependencies within the model. However, this…

Machine Learning · Computer Science 2015-02-02 Xu Sun

In hep-th/0411028 a new manifestly covariant canonical quantization method was developed. The idea is to quantize in the phase space of arbitrary histories first, and impose dynamics as first-class constraints afterwards. The Hamiltonian is…

High Energy Physics - Theory · Physics 2007-05-23 T. A. Larsson

Weighted and controlled frames have been introduced recently to improve the numerical efficiency of iterative algorithms for inverting the frame operator. In this paper we develop systematically these notions, including their mutual…

Functional Analysis · Mathematics 2010-07-08 Peter Balazs , Jean-Pierre Antoine , Anna Grybos

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

The quest for robust and generalizable machine learning models has driven recent interest in exploiting symmetries through equivariant neural networks. In the context of PDE solvers, recent works have shown that Lie point symmetries can be…

Machine Learning · Computer Science 2025-03-06 Zakhar Shumaylov , Peter Zaika , James Rowbottom , Ferdia Sherry , Melanie Weber , Carola-Bibiane Schönlieb

Conventional simulations of complex systems in the canonical ensemble suffer from the quasi-ergodicity problem. A simulation in generalized ensemble overcomes this difficulty by performing a random walk in potential energy space and other…

Statistical Mechanics · Physics 2007-07-24 Yuji Sugita , Ayori Mitsutake , Yuko Okamoto

Firstly, we present a reformulation of the standard canonical approach to spherically symmetric systems in which the radial gauge is imposed. This is done via the gauge unfixing technique, which serves as the exposition in the context of…

General Relativity and Quantum Cosmology · Physics 2015-11-20 Norbert Bodendorfer , Jerzy Lewandowski , Jedrzej Świeżewski

Canonical quantization covers a broad class of classical systems, but that does not include all the problems of interest. Affine quantization has the benefit of providing a successful quantization of many important problems including the…

General Physics · Physics 2021-05-10 John R. Klauder

Lorentz-equivariant neural networks are becoming the leading architectures for high-energy physics. Current implementations rely on specialized layers, limiting architectural choices. We introduce Lorentz Local Canonicalization (LLoCa), a…