中文
相关论文

相关论文: Equivariant Spherical Transformer for Efficient Mo…

200 篇论文

While widespread, Transformers lack inductive biases for geometric symmetries common in science and computer vision. Existing equivariant methods often sacrifice the efficiency and flexibility that make Transformers so effective through…

The key problem in multivariate time series (MTS) analysis and forecasting aims to disclose the underlying couplings between variables that drive the co-movements. Considerable recent successful MTS methods are built with graph neural…

机器学习 · 计算机科学 2022-10-11 Kun Yi , Qi Zhang , Liang Hu , Hui He , Ning An , LongBing Cao , ZhenDong Niu

Recognizing the pivotal role of EEG emotion recognition in the development of affective Brain-Computer Interfaces (aBCIs), considerable research efforts have been dedicated to this field. While prior methods have demonstrated success in…

人机交互 · 计算机科学 2024-03-26 Yijin Zhou , Fu Li , Yang Li , Youshuo Ji , Lijian Zhang , Yuanfang Chen

We propose a semantic segmentation model that exploits rotation and reflection symmetries. We demonstrate significant gains in sample efficiency due to increased weight sharing, as well as improvements in robustness to symmetry…

计算机视觉与模式识别 · 计算机科学 2018-07-03 Jasper Linmans , Jim Winkens , Bastiaan S. Veeling , Taco S. Cohen , Max Welling

At present, people usually use some methods based on convolutional neural networks (CNNs) for Electroencephalograph (EEG) decoding. However, CNNs have limitations in perceiving global dependencies, which is not adequate for common EEG…

信号处理 · 电气工程与系统科学 2021-06-23 Yonghao Song , Xueyu Jia , Lie Yang , Longhan Xie

We devise a new type of feedforward neural network. It is equivariant with respect to the unitary group $U(n)$. The input and output can be vectors in $\mathbb{C}^n$ with arbitrary dimension $n$. No convolution layer is required in our…

机器学习 · 计算机科学 2022-08-26 Pui-Wai Ma , T. -H. Hubert Chan

In this study, an efficient stochastic gradient-free method, the ensemble neural networks (ENN), is developed. In the ENN, the optimization process relies on covariance matrices rather than derivatives. The covariance matrices are…

机器学习 · 统计学 2019-11-11 Yuntian Chen , Haibin Chang , Meng Jin , Dongxiao Zhang

Graph neural networks (GNN) have shown great advantages in many graph-based learning tasks but often fail to predict accurately for a task-based on sets of nodes such as link/motif prediction and so on. Many works have recently proposed to…

机器学习 · 计算机科学 2022-06-24 Haorui Wang , Haoteng Yin , Muhan Zhang , Pan Li

Equivariant Graph Neural Networks (GNNs) have demonstrated significant success across various applications. To achieve completeness -- that is, the universal approximation property over the space of equivariant functions -- the network must…

机器学习 · 计算机科学 2025-10-16 Jiacheng Cen , Anyi Li , Ning Lin , Tingyang Xu , Yu Rong , Deli Zhao , Zihe Wang , Wenbing Huang

Many scientific problems require to process data in the form of geometric graphs. Unlike generic graph data, geometric graphs exhibit symmetries of translations, rotations, and/or reflections. Researchers have leveraged such inductive bias…

机器学习 · 计算机科学 2022-02-23 Jiaqi Han , Yu Rong , Tingyang Xu , Wenbing Huang

The ability to perform fast and accurate atomistic simulations is crucial for advancing the chemical sciences. By learning from high-quality data, machine-learned interatomic potentials achieve accuracy on par with ab initio and…

With the advent of group equivariant convolutions in deep networks literature, spherical CNNs with $\mathsf{SO}(3)$-equivariant layers have been developed to cope with data that are samples of signals on the sphere $S^2$. One can implicitly…

计算机视觉与模式识别 · 计算机科学 2023-05-29 Gianfranco Cortes , Yue Yu , Robin Chen , Melissa Armstrong , David Vaillancourt , Baba C. Vemuri

Deep generative models are increasingly used for molecular discovery, with most recent approaches relying on equivariant graph neural networks (GNNs) under the assumption that explicit equivariance is essential for generating high-quality…

Training a Convolutional Neural Network (CNN) to be robust against rotation has mostly been done with data augmentation. In this paper, another progressive vision of research direction is highlighted to encourage less dependence on data…

计算机视觉与模式识别 · 计算机科学 2021-10-22 Sungwon Hwang , Hyungtae Lim , Hyun Myung

Modeling the complex three-dimensional (3D) dynamics of relational systems is an important problem in the natural sciences, with applications ranging from molecular simulations to particle mechanics. Machine learning methods have achieved…

We introduce Equivariant Neural Eikonal Solvers, a novel framework that integrates Equivariant Neural Fields (ENFs) with Neural Eikonal Solvers. Our approach employs a single neural field where a unified shared backbone is conditioned on…

Recent work by Cohen \emph{et al.} has achieved state-of-the-art results for learning spherical images in a rotation invariant way by using ideas from group representation theory and noncommutative harmonic analysis. In this paper we…

机器学习 · 统计学 2018-11-13 Risi Kondor , Zhen Lin , Shubhendu Trivedi

It has long been recognized that the invariance and equivariance properties of a representation are critically important for success in many vision tasks. In this paper we present Steerable Convolutional Neural Networks, an efficient and…

机器学习 · 计算机科学 2019-04-23 Taco S. Cohen , Max Welling

The widespread success of convolutional neural networks may largely be attributed to their intrinsic property of translation equivariance. However, convolutions are not equivariant to variations in scale and fail to generalize to objects of…

计算机视觉与模式识别 · 计算机科学 2022-11-21 Thomas Altstidl , An Nguyen , Leo Schwinn , Franz Köferl , Christopher Mutschler , Björn Eskofier , Dario Zanca

Quantum Graph Neural Networks (QGNNs) offer a promising approach to combining quantum computing with graph-structured data processing. While classical Graph Neural Networks (GNNs) are scalable and robust, existing QGNNs often lack…

量子物理 · 物理学 2026-01-13 Arthur M. Faria , Ignacio F. Graña , Savvas Varsamopoulos