中文
相关论文

相关论文: Metric Learning for Clifford Group Equivariant Neu…

200 篇论文

Designing neural network architectures that can handle data symmetry is crucial. This is especially important for geometric graphs whose properties are equivariance under Euclidean transformations. Current equivariant graph neural networks…

机器学习 · 计算机科学 2025-03-14 Viet-Hoang Tran , Thieu N. Vo , Tho Tran Huu , Tan Minh Nguyen

We propose, implement, and compare with competitors a new architecture of equivariant neural networks based on geometric (Clifford) algebras: Generalized Lipschitz Group Equivariant Neural Networks (GLGENN). These networks are equivariant…

机器学习 · 计算机科学 2025-12-04 Ekaterina Filimoshina , Dmitry Shirokov

We introduce Clifford Group Equivariant Neural Networks: a novel approach for constructing $\mathrm{O}(n)$- and $\mathrm{E}(n)$-equivariant models. We identify and study the $\textit{Clifford group}$, a subgroup inside the Clifford algebra…

机器学习 · 计算机科学 2023-10-24 David Ruhe , Johannes Brandstetter , Patrick Forré

Most current deep learning models equivariant to $O(n)$ or $SO(n)$ either consider mostly scalar information such as distances and angles or have a very high computational complexity. In this work, we test a few novel message passing graph…

机器学习 · 计算机科学 2024-07-11 Cong Liu , David Ruhe , Patrick Forré

We introduce Clifford Group Equivariant Simplicial Message Passing Networks, a method for steerable E(n)-equivariant message passing on simplicial complexes. Our method integrates the expressivity of Clifford group-equivariant layers with…

人工智能 · 计算机科学 2024-03-13 Cong Liu , David Ruhe , Floor Eijkelboom , Patrick Forré

This paper is to serve as a key to the projective (homogeneous) model developed by Charles Gunn (arXiv:1101.4542 [math.MG]). The goal is to explain the underlying concepts in a simple language and give plenty of examples. It is targeted to…

度量几何 · 数学 2013-07-12 Andrey Sokolov

Employing equivariance in neural networks leads to greater parameter efficiency and improved generalization performance through the encoding of domain knowledge in the architecture; however, the majority of existing approaches require an a…

机器学习 · 计算机科学 2023-05-31 Emmanouil Theodosis , Karim Helwani , Demba Ba

One of the most fundamental problems in machine learning is to compare examples: Given a pair of objects we want to return a value which indicates degree of (dis)similarity. Similarity is often task specific, and pre-defined distances can…

机器学习 · 统计学 2022-08-31 Shubhendu Trivedi

We propose models of quantum neural networks through Clifford algebras, which are capable of capturing geometric features of systems and to produce entanglement. Due to their representations in terms of Pauli matrices, the Clifford algebras…

量子物理 · 物理学 2022-06-07 Marco A. S. Trindade , Vinicius N. L. Rocha , S. Floquet

Modern computer vision architectures, from CNNs to Transformers, predominantly rely on the stacking of heuristic modules: spatial mixers (Attention/Conv) followed by channel mixers (FFNs). In this work, we challenge this paradigm by…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Zhongping Ji

This paper explores leveraging the Clifford algebra's expressive power for $\E(n)$-equivariant diffusion models. We utilize the geometric products between Clifford multivectors and the rich geometric information encoded in Clifford…

机器学习 · 计算机科学 2025-04-25 Cong Liu , Sharvaree Vadgama , David Ruhe , Erik Bekkers , Patrick Forré

Quantum neural network architectures that have little-to-no inductive biases are known to face trainability and generalization issues. Inspired by a similar problem, recent breakthroughs in machine learning address this challenge by…

We propose Geometric Clifford Algebra Networks (GCANs) for modeling dynamical systems. GCANs are based on symmetry group transformations using geometric (Clifford) algebras. We first review the quintessence of modern (plane-based) geometric…

机器学习 · 计算机科学 2023-05-30 David Ruhe , Jayesh K. Gupta , Steven de Keninck , Max Welling , Johannes Brandstetter

The principle of equivariance to symmetry transformations enables a theoretically grounded approach to neural network architecture design. Equivariant networks have shown excellent performance and data efficiency on vision and medical…

机器学习 · 计算机科学 2019-05-15 Taco S. Cohen , Maurice Weiler , Berkay Kicanaoglu , Max Welling

Group equivariance has emerged as a valuable inductive bias in deep learning, enhancing generalization, data efficiency, and robustness. Classically, group equivariant methods require the groups of interest to be known beforehand, which may…

We present Clifford-Steerable Convolutional Neural Networks (CS-CNNs), a novel class of $\mathrm{E}(p, q)$-equivariant CNNs. CS-CNNs process multivector fields on pseudo-Euclidean spaces $\mathbb{R}^{p,q}$. They cover, for instance,…

机器学习 · 计算机科学 2024-07-09 Maksim Zhdanov , David Ruhe , Maurice Weiler , Ana Lucic , Johannes Brandstetter , Patrick Forré

We propose a metric learning framework for the construction of invariant geometric functions of planar curves for the Eucledian and Similarity group of transformations. We leverage on the representational power of convolutional neural…

计算机视觉与模式识别 · 计算机科学 2017-02-20 Gautam Pai , Aaron Wetzler , Ron Kimmel

Learning to reason about relations and dynamics over multiple interacting objects is a challenging topic in machine learning. The challenges mainly stem from that the interacting systems are exponentially-compositional, symmetrical, and…

机器学习 · 计算机科学 2022-03-15 Wenbing Huang , Jiaqi Han , Yu Rong , Tingyang Xu , Fuchun Sun , Junzhou Huang

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Ramzan Basheer , Deepak Mishra

Group theory has been used in machine learning to provide a theoretically grounded approach for incorporating known symmetry transformations in tasks from robotics to protein modeling. In these applications, equivariant neural networks use…

机器学习 · 计算机科学 2025-01-17 Lucas Laird , Circe Hsu , Asilata Bapat , Robin Walters
‹ 上一页 1 2 3 10 下一页 ›