English
Related papers

Related papers: An Effective Universal Polynomial Basis for Spectr…

200 papers

Graph Neural Networks (GNNs) have emerged as a powerful category of learning architecture for handling graph-structured data. However, existing GNNs typically ignore crucial structural characteristics in node-induced subgraphs, which thus…

Machine Learning · Computer Science 2023-06-13 Kaixuan Chen , Shunyu Liu , Tongtian Zhu , Tongya Zheng , Haofei Zhang , Zunlei Feng , Jingwen Ye , Mingli Song

Heterophilic Graph Neural Networks (HGNNs) have shown promising results for semi-supervised learning tasks on graphs. Notably, most real-world heterophilic graphs are composed of a mixture of nodes with different neighbor patterns,…

Machine Learning · Computer Science 2025-02-26 Jinluan Yang , Zhengyu Chen , Teng Xiao , Wenqiao Zhang , Yong Lin , Kun Kuang

The ever-designed Graph Neural Networks, though opening a promising path for the modeling of the graph-structure data, unfortunately introduce two daunting obstacles to their deployment on devices. (I) Most of existing GNNs are shallow, due…

Machine Learning · Computer Science 2024-05-14 Shilong Wang , Hao Wu , Yifan Duan , Guibin Zhang , Guohao Li , Yuxuan Liang , Shirui Pan , Kun Wang , Yang Wang

Graphs with heterophily have been regarded as challenging scenarios for Graph Neural Networks (GNNs), where nodes are connected with dissimilar neighbors through various patterns. In this paper, we present theoretical understandings of the…

Machine Learning · Computer Science 2024-06-05 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Graph convolutional neural networks (GCNNs) are popular deep learning architectures that, upon replacing regular convolutions with graph filters (GFs), generalize CNNs to irregular domains. However, classical GFs are prone to numerical…

Signal Processing · Electrical Eng. & Systems 2022-10-18 Victor M. Tenorio , Samuel Rey , Fernando Gama , Santiago Segarra , Antonio G. Marques

Spectral features are widely incorporated within Graph Neural Networks (GNNs) to improve their expressive power, or their ability to distinguish among non-isomorphic graphs. One popular example is the usage of graph Laplacian eigenvectors…

Machine Learning · Computer Science 2025-09-29 Snir Hordan , Maya Bechler-Speicher , Gur Lifshitz , Nadav Dym

Message passing Graph Neural Networks (GNNs) are known to be limited in expressive power by the 1-WL color-refinement test for graph isomorphism. Other more expressive models either are computationally expensive or need preprocessing to…

Machine Learning · Computer Science 2024-02-01 Mohammed Haroon Dupty , Yanfei Dong , Wee Sun Lee

Graph transformers (GTs) have emerged as a promising architecture that is theoretically more expressive than message-passing graph neural networks (GNNs). However, typical GT models have at least quadratic complexity and thus cannot scale…

Machine Learning · Computer Science 2024-04-09 Chenhui Deng , Zichao Yue , Zhiru Zhang

We study the problem of learning features through self-supervision that are generalisable to multiple graphs. State-of-the-art graph self-supervision restricts training to only one graph, resulting in graph-specific models that are…

Machine Learning · Computer Science 2024-07-31 Laya Das , Sai Munikoti , Nrushad Joshi , Mahantesh Halappanavar

Graph Neural Networks (GNNs) have achieved remarkable performance in modeling graphs for various applications. However, most existing GNNs assume the graphs exhibit strong homophily in node labels, i.e., nodes with similar labels are…

Machine Learning · Computer Science 2023-02-20 Enyan Dai , Shijie Zhou , Zhimeng Guo , Suhang Wang

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

We investigate a scalable $M$-channel critically sampled filter bank for graph signals, where each of the $M$ filters is supported on a different subband of the graph Laplacian spectrum. For analysis, the graph signal is filtered on each…

Information Theory · Computer Science 2019-01-31 Shuni Li , Yan Jin , David I Shuman

We consider the problem of designing spectral graph filters for the construction of dictionaries of atoms that can be used to efficiently represent signals residing on weighted graphs. While the filters used in previous spectral graph…

Functional Analysis · Mathematics 2013-11-06 David I Shuman , Christoph Wiesmeyr , Nicki Holighaus , Pierre Vandergheynst

Real-world graphs are typically complex, exhibiting heterogeneity in the global structure, as well as strong heterophily within local neighborhoods. While a growing body of literature has revealed the limitations of common graph neural…

Machine Learning · Computer Science 2023-10-19 Jintang Li , Zheng Wei , Jiawang Dan , Jing Zhou , Yuchang Zhu , Ruofan Wu , Baokun Wang , Zhang Zhen , Changhua Meng , Hong Jin , Zibin Zheng , Liang Chen

Graph Convolutional Networks (GCNs) have been widely applied in various fields due to their significant power on processing graph-structured data. Typical GCN and its variants work under a homophily assumption (i.e., nodes with same class…

Machine Learning · Computer Science 2021-12-28 Tao Wang , Rui Wang , Di Jin , Dongxiao He , Yuxiao Huang

Inspired by convolutional neural networks on 1D and 2D data, graph convolutional neural networks (GCNNs) have been developed for various learning tasks on graph data, and have shown superior performance on real-world datasets. Despite their…

Machine Learning · Computer Science 2019-05-15 Saurabh Verma , Zhi-Li Zhang

In view of the huge success of convolution neural networks (CNN) for image classification and object recognition, there have been attempts to generalize the method to general graph-structured data. One major direction is based on spectral…

Machine Learning · Computer Science 2020-03-09 Feng Ji , Jielong Yang , Qiang Zhang , Wee Peng Tay

Graph Neural Networks (GNNs) have emerged as a powerful tool to capture intricate network patterns, achieving success across different domains. However, existing GNNs require careful domain-specific architecture designs and training from…

Machine Learning · Computer Science 2025-05-30 Jingzhe Liu , Haitao Mao , Zhikai Chen , Bingheng Li , Wenqi Fan , Mingxuan Ju , Tong Zhao , Neil Shah , Jiliang Tang

Deep representation learning on non-Euclidean data types, such as graphs, has gained significant attention in recent years. Invent of graph neural networks has improved the state-of-the-art for both node and the entire graph representation…

Machine Learning · Computer Science 2020-06-09 Sambaran Bandyopadhyay , Manasvi Aggarwal , M. Narasimha Murty

Graph neural networks (GNNs) have been proved powerful in graph-oriented tasks. However, many real-world graphs are heterophilous, challenging the homophily assumption of classical GNNs. To solve the universality problem, many studies…

Machine Learning · Computer Science 2023-10-09 Shengbo Gong , Jiajun Zhou , Chenxuan Xie , Qi Xuan