English
Related papers

Related papers: Specformer: Spectral Graph Neural Networks Meet Tr…

200 papers

Graph Neural Networks (GNNs) are a promising deep learning approach for circumventing many real-world problems on graph-structured data. However, these models usually have at least one of four fundamental limitations: over-smoothing,…

Machine Learning · Computer Science 2022-10-03 Xun Liu , Alex Hay-Man Ng , Fangyuan Lei , Yikuan Zhang , Zhengmin Li

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Graph-structured data arise in a variety of real-world context ranging from sensor and transportation to biological and social networks. As a ubiquitous tool to process graph-structured data, spectral graph filters have been used to solve…

Machine Learning · Computer Science 2021-02-22 Henry Kenlay , Dorina Thanou , Xiaowen Dong

While graph heterophily has been extensively studied in recent years, a fundamental research question largely remains nascent: How and to what extent will graph heterophily affect the prediction performance of graph neural networks (GNNs)?…

Machine Learning · Computer Science 2023-06-27 Shuaicheng Zhang , Haohui Wang , Si Zhang , Dawei Zhou

This paper reviews graph convolutional neural networks (GCNNs) through the lens of edge-variant graph filters. The edge-variant graph filter is a finite order, linear, and local recursion that allows each node, in each iteration, to weigh…

Machine Learning · Computer Science 2019-03-05 Elvin Isufi , Fernando Gama , Alejandro Ribeiro

Graph convolutional networks(GCNs) have become the most popular approaches for graph data in these days because of their powerful ability to extract features from graph. GCNs approaches are divided into two categories, spectral-based and…

Machine Learning · Computer Science 2019-07-23 Yi Ma , Jianye Hao , Yaodong Yang , Han Li , Junqi Jin , Guangyong Chen

Spectral graph convolution, an important tool of data filtering on graphs, relies on two essential decisions: selecting spectral bases for signal transformation and parameterizing the kernel for frequency analysis. While recent techniques…

Machine Learning · Computer Science 2025-05-15 Nian Liu , Xiaoxin He , Thomas Laurent , Francesco Di Giovanni , Michael M. Bronstein , Xavier Bresson

We propose the Interferometric Graph Transform (IGT), which is a new class of deep unsupervised graph convolutional neural network for building graph representations. Our first contribution is to propose a generic, complex-valued spectral…

Machine Learning · Computer Science 2020-06-11 Edouard Oyallon

We propose a new graph neural network (GNN) module, based on relaxations of recently proposed geometric scattering transforms, which consist of a cascade of graph wavelet filters. Our learnable geometric scattering (LEGS) module enables…

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Graph Neural Networks have recently become a prevailing paradigm for various high-impact graph analytical problems. Existing efforts can be mainly categorized as spectral-based and spatial-based methods. The major challenge for the former…

Machine Learning · Computer Science 2022-02-22 Yushun Dong , Kaize Ding , Brian Jalaian , Shuiwang Ji , Jundong Li

Graph Neural Networks (GNNs) have become a standard approach for learning from graph-structured data. However, their reliance on parametric classifiers (most often linear softmax layers) limits interpretability and sometimes hinders…

Machine Learning · Computer Science 2026-02-03 Zeljko Bolevic , Milos Brajovic , Isidora Stankovic , Ljubisa Stankovic

Graphs are the natural data structure to represent relational and structural information in many domains. To cover the broad range of graph-data applications including graph classification as well as graph generation, it is desirable to…

Machine Learning · Computer Science 2020-06-11 Sanghyun Yoo , Young-Seok Kim , Kang Hyun Lee , Kuhwan Jeong , Junhwi Choi , Hoshik Lee , Young Sang Choi

Social and information networks are gaining huge popularity recently due to their various applications. Knowledge representation through graphs in the form of nodes and edges should preserve as many characteristics of the original data as…

Machine Learning · Computer Science 2021-02-08 Rucha Bhalchandra Joshi , Subhankar Mishra

The analysis of the brain surface modeled as a graph mesh is a challenging task. Conventional deep learning approaches often rely on data lying in the Euclidean space. As an extension to irregular graphs, convolution operations are defined…

Image and Video Processing · Electrical Eng. & Systems 2019-11-25 Ran He , Karthik Gopinath , Christian Desrosiers , Herve Lombaert

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Graph neural networks (GNNs) have been used effectively in different applications involving the processing of signals on irregular structures modeled by graphs. Relying on the use of shift-invariant graph filters, GNNs extend the operation…

Machine Learning · Computer Science 2020-03-05 Alejandro Parada-Mayorga , Luana Ruiz , Alejandro Ribeiro

While tokenized graph Transformers have demonstrated strong performance in node classification tasks, their reliance on a limited subset of nodes with high similarity scores for constructing token sequences overlooks valuable information…

Machine Learning · Computer Science 2025-02-18 Jinsong Chen , Hanpeng Liu , John E. Hopcroft , Kun He

Graph self-supervised learning (SSL) has been vastly employed to learn representations from unlabeled graphs. Existing methods can be roughly divided into predictive learning and contrastive learning, where the latter one attracts more…

Machine Learning · Computer Science 2022-11-29 Jiashun Cheng , Man Li , Jia Li , Fugee Tsung