English
Related papers

Related papers: Specformer: Spectral Graph Neural Networks Meet Tr…

200 papers

Spectral-based graph neural networks (SGNNs) have been attracting increasing attention in graph representation learning. However, existing SGNNs are limited in implementing graph filters with rigid transforms (e.g., graph Fourier or…

Machine Learning · Computer Science 2022-01-05 Mingxing Xu , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong , Pascal Frossard

Many representative graph neural networks, e.g., GPR-GNN and ChebNet, approximate graph convolutions with graph spectral filters. However, existing work either applies predefined filter weights or learns them without necessary constraints,…

Machine Learning · Computer Science 2022-02-07 Mingguo He , Zhewei Wei , Zengfeng Huang , Hongteng Xu

This paper aims to provide a novel design of a multiscale framelet convolution for spectral graph neural networks (GNNs). While current spectral methods excel in various graph learning tasks, they often lack the flexibility to adapt to…

Machine Learning · Computer Science 2024-07-30 Mengxi Yang , Dai Shi , Xuebin Zheng , Jie Yin , Junbin Gao

Graph Neural Networks (GNNs) are the dominant architecture for molecular machine learning, particularly for molecular property prediction and machine learning interatomic potentials (MLIPs). GNNs perform message passing on predefined graphs…

Machine Learning · Computer Science 2025-10-03 Tobias Kreiman , Yutong Bai , Fadi Atieh , Elizabeth Weaver , Eric Qu , Aditi S. Krishnapriyan

Graph neural networks (GNNs) have become a workhorse approach for learning from data defined over irregular domains, typically by implicitly assuming that the data structure is represented by a homophilic graph. However, recent works have…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Madeline Navarro , Victor M. Tenorio , Santiago Segarra , Antonio G. Marques

We study spectral graph convolutional neural networks (GCNNs), where filters are defined as continuous functions of the graph shift operator (GSO) through functional calculus. A spectral GCNN is not tailored to one specific graph and can be…

Machine Learning · Computer Science 2022-06-28 Sohir Maskey , Ron Levie , Gitta Kutyniok

Graph neural networks (GNNs) rely on graph convolutions to extract local features from network data. These graph convolutions combine information from adjacent nodes using coefficients that are shared across all nodes. Since these…

Machine Learning · Computer Science 2020-10-22 Luana Ruiz , Luiz F. O. Chamon , Alejandro Ribeiro

Graph Neural Networks (GNNs) are the subject of intense focus by the machine learning community for problems involving relational reasoning. GNNs can be broadly divided into spatial and spectral approaches. Spatial approaches use a form of…

Machine Learning · Statistics 2021-01-05 Kimberly Stachenfeld , Jonathan Godwin , Peter Battaglia

Graph Comparative Learning (GCL) is a self-supervised method that combines the advantages of Graph Convolutional Networks (GCNs) and comparative learning, making it promising for learning node representations. However, the GCN encoders used…

Machine Learning · Computer Science 2023-12-12 Ruyue Liu , Rong Yin , Yong Liu , Weiping Wang

Graph Neural Networks (GNNs) are widely used in graph data mining tasks. Traditional GNNs follow a message passing scheme that can effectively utilize local and structural information. However, the phenomena of over-smoothing and…

Machine Learning · Computer Science 2025-04-14 Zijie Zhou , Zhaoqi Lu , Xuekai Wei , Rongqin Chen , Shenghui Zhang , Pak Lon Ip , Leong Hou U

We introduce a transformer-based GNN model, named UGformer, to learn graph representations. In particular, we present two UGformer variants, wherein the first variant (publicized in September 2019) is to leverage the transformer on a set of…

Machine Learning · Computer Science 2022-03-09 Dai Quoc Nguyen , Tu Dinh Nguyen , Dinh Phung

Graph neural networks (GNNs) have significantly improved the representation power for graph-structured data. Despite of the recent success of GNNs, the graph convolution in most GNNs have two limitations. Since the graph convolution is…

Machine Learning · Computer Science 2021-12-30 Jinyoung Park , Sungdong Yoo , Jihwan Park , Hyunwoo J. Kim

Graph neural networks (GNNs) are commonly divided into message-passing neural networks (MPNNs) and spectral graph neural networks, reflecting two largely separate research traditions in machine learning and signal processing. This paper…

Equivariant machine learning is an approach for designing deep learning models that respect the symmetries of the problem, with the aim of reducing model complexity and improving generalization. In this paper, we focus on an extension of…

Machine Learning · Computer Science 2024-12-10 Ya-Wei Eileen Lin , Ronen Talmon , Ron Levie

Spectral graph convolutional neural networks (GCNNs) have been producing encouraging results in graph classification tasks. However, most spectral GCNNs utilize fixed graphs when aggregating node features, while omitting edge feature…

Computer Vision and Pattern Recognition · Computer Science 2022-10-06 Yang Yi , Xuequan Lu , Shang Gao , Antonio Robles-Kelly , Yuejie Zhang

Graph Neural Networks (GNNs) are an effective framework for representation learning of graphs. GNNs follow a neighborhood aggregation scheme, where the representation vector of a node is computed by recursively aggregating and transforming…

Machine Learning · Computer Science 2019-02-26 Keyulu Xu , Weihua Hu , Jure Leskovec , Stefanie Jegelka

Recently, Transformers for graph representation learning have become increasingly popular, achieving state-of-the-art performance on a wide-variety of graph datasets, either alone or in combination with message-passing graph neural networks…

Machine Learning · Computer Science 2024-05-07 Ayush Garg

Over the last few years, we have witnessed the availability of an increasing data generated from non-Euclidean domains, which are usually represented as graphs with complex relationships, and Graph Neural Networks (GNN) have gained a high…

Machine Learning · Computer Science 2023-08-15 Andrea Apicella , Francesco Isgrò , Andrea Pollastro , Roberto Prevete

We study Graph Convolutional Networks (GCN) from the graph signal processing viewpoint by addressing a difference between learning graph filters with fully connected weights versus trainable polynomial coefficients. We find that by stacking…

Machine Learning · Computer Science 2020-11-24 Hoang NT , Takanori Maehara , Tsuyoshi Murata

This paper focuses on spectral graph convolutional neural networks (ConvNets), where filters are defined as elementwise multiplication in the frequency domain of a graph. In machine learning settings where the dataset consists of signals…

Machine Learning · Computer Science 2021-06-15 Ron Levie , Wei Huang , Lorenzo Bucci , Michael M. Bronstein , Gitta Kutyniok