English
Related papers

Related papers: Compact Matrix Quantum Group Equivariant Neural Ne…

200 papers

Convolutional neural networks are ubiquitous in Machine Learning applications for solving a variety of problems. They however can not be used in their native form when the domain of the data is commonly encountered manifolds such as the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Rudrasis Chakraborty , Monami Banerjee , Baba C. Vemuri

Artificial neural networks have achieved great success in many fields ranging from image recognition to video understanding. However, its high requirements for computing and memory resources have limited further development on processing…

Quantum Physics · Physics 2021-08-05 Yanxuan Lü , Qing Gao , Jinhu Lü , Maciej Ogorzałek , Jin Zheng

The topic of this thesis is the development of a versatile and geometrically motivated differential calculus on non-commutative or quantum spaces, providing powerful but easy-to-use mathematical tools for applications in physics and related…

High Energy Physics - Theory · Physics 2008-02-03 Peter Schupp

Deep neural networks lack straightforward ways to incorporate domain knowledge and are notoriously considered black boxes. Prior works attempted to inject domain knowledge into architectures implicitly through data augmentation. Building on…

Machine Learning · Computer Science 2022-11-18 Emmanouil Theodosis , Demba Ba

We investigate the optimization of neural networks on symmetric data, and compare the strategy of constraining the architecture to be equivariant to that of using data augmentation. Our analysis reveals that that the relative geometry of…

Machine Learning · Computer Science 2024-10-21 Oskar Nordenfors , Fredrik Ohlsson , Axel Flinth

How can prior knowledge on the transformation invariances of a domain be incorporated into the architecture of a neural network? We propose Equivariant Transformers (ETs), a family of differentiable image-to-image mappings that improve the…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Kai Sheng Tai , Peter Bailis , Gregory Valiant

In this study, we introduce a method for learning group (known or unknown) equivariant functions by learning the associated quadratic form $x^T A x$ corresponding to the group from the data. Certain groups, known as orthogonal groups,…

Machine Learning · Computer Science 2025-10-16 Pavan Karjol , Vivek V Kashyap , Rohan Kashyap , Prathosh A P

Despite the great promise of quantum machine learning models, there are several challenges one must overcome before unlocking their full potential. For instance, models based on quantum neural networks (QNNs) can suffer from excessive local…

Quantum Physics · Physics 2024-02-15 Louis Schatzki , Martin Larocca , Quynh T. Nguyen , Frederic Sauvage , M. Cerezo

Thanks to their improved data efficiency, equivariant neural networks have gained increased interest in the deep learning community. They have been successfully applied in the medical domain where symmetries in the data can be effectively…

Machine Learning · Computer Science 2020-07-09 Mirgahney Mohamed , Gabriele Cesa , Taco S. Cohen , Max Welling

We devise a new type of feedforward neural network. It is equivariant with respect to the unitary group $U(n)$. The input and output can be vectors in $\mathbb{C}^n$ with arbitrary dimension $n$. No convolution layer is required in our…

Machine Learning · Computer Science 2022-08-26 Pui-Wai Ma , T. -H. Hubert Chan

Physical theories grounded in mathematical symmetries are an essential component of our understanding of a wide range of properties of the universe. Similarly, in the domain of machine learning, an awareness of symmetries such as rotation…

We explain equivariant neural networks, a notion underlying breakthroughs in machine learning from deep convolutional neural networks for computer vision to AlphaFold 2 for protein structure prediction, without assuming knowledge of…

Machine Learning · Computer Science 2022-11-18 Lek-Heng Lim , Bradley J. Nelson

Gauge Theory plays a crucial role in many areas in science, including high energy physics, condensed matter physics and quantum information science. In quantum simulations of lattice gauge theory, an important step is to construct a wave…

High Energy Physics - Lattice · Physics 2022-11-08 Di Luo , Shunyue Yuan , James Stokes , Bryan K. Clark

Discovering new phenomena at the Large Hadron Collider (LHC) involves the identification of rare signals over conventional backgrounds. Thus binary classification tasks are ubiquitous in analyses of the vast amounts of LHC data. We develop…

Quantum groups emerged in the latter quarter of the 20th century as, on the one hand, a deep and natural generalisation of symmetry groups for certain integrable systems, and on the other as part of a generalisation of geometry itself…

High Energy Physics - Theory · Physics 2011-07-19 S. Majid

In this paper we will demonstrate that any compact quantum group can be used as symmetry groups for quantum channels, which leads us to the concept of covariant channels. We, then, unearth the structure of the convex set of covariant…

Mathematical Physics · Physics 2020-07-09 Hun Hee Lee , Sang-Gyun Youn

This paper introduces MDP homomorphic networks for deep reinforcement learning. MDP homomorphic networks are neural networks that are equivariant under symmetries in the joint state-action space of an MDP. Current approaches to deep…

Machine Learning · Computer Science 2021-01-21 Elise van der Pol , Daniel E. Worrall , Herke van Hoof , Frans A. Oliehoek , Max Welling

Convolutions encode equivariance symmetries into neural networks leading to better generalisation performance. However, symmetries provide fixed hard constraints on the functions a network can represent, need to be specified in advance, and…

Machine Learning · Computer Science 2023-10-11 Tycho F. A. van der Ouderaa , Alexander Immer , Mark van der Wilk

Lattice gauge equivariant convolutional neural networks (L-CNNs) are a framework for convolutional neural networks that can be applied to non-Abelian lattice gauge theories without violating gauge symmetry. We demonstrate how L-CNNs can be…

High Energy Physics - Lattice · Physics 2023-03-22 Jimmy Aronsson , David I. Müller , Daniel Schuh

Constructing model-agnostic group equivariant networks, such as equitune (Basu et al., 2023b) and its generalizations (Kim et al., 2023), can be computationally expensive for large product groups. We address this problem by providing…

Machine Learning · Computer Science 2024-10-08 Razan Baltaji , Sourya Basu , Lav R. Varshney