English
Related papers

Related papers: Improving Expressivity of GNNs with Subgraph-speci…

200 papers

Subgraph representation learning has emerged as an important problem, but it is by default approached with specialized graph neural networks on a large global graph. These models demand extensive memory and computational resources but…

Machine Learning · Computer Science 2024-05-24 Dongkwan Kim , Alice Oh

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Graph neural networks (GNNs), has been widely used for supervised learning tasks in graphs reaching state-of-the-art results. However, little work was dedicated to creating unbiased GNNs, i.e., where the classification is uncorrelated with…

Machine Learning · Computer Science 2021-08-20 Uriel Singer , Kira Radinsky

Deep learning has revolutionized many machine learning tasks in recent years, ranging from image classification and video processing to speech recognition and natural language understanding. The data in these tasks are typically represented…

Machine Learning · Computer Science 2020-03-27 Zonghan Wu , Shirui Pan , Fengwen Chen , Guodong Long , Chengqi Zhang , Philip S. Yu

Subgraph GNNs are provably expressive neural architectures that learn graph representations from sets of subgraphs. Unfortunately, their applicability is hampered by the computational complexity associated with performing message passing on…

Machine Learning · Computer Science 2024-03-22 Beatrice Bevilacqua , Moshe Eliasof , Eli Meirom , Bruno Ribeiro , Haggai Maron

Despite Graph neural networks' significant performance gain over many classic techniques in various graph-related downstream tasks, their successes are restricted in shallow models due to over-smoothness and the difficulties of…

Machine Learning · Computer Science 2023-12-15 Jin Li , Qirong Zhang , Shuling Xu , Xinlong Chen , Longkun Guo , Yang-Geng Fu

Graph neural networks (GNNs) have recently become the standard approach for learning with graph-structured data. Prior work has shed light into their potential, but also their limitations. Unfortunately, it was shown that standard GNNs are…

Machine Learning · Computer Science 2023-06-12 Gaspard Michel , Giannis Nikolentzos , Johannes Lutzeyer , Michalis Vazirgiannis

Inspired by the extensive success of deep learning, graph neural networks (GNNs) have been proposed to learn expressive node representations and demonstrated promising performance in various graph learning tasks. However, existing endeavors…

Machine Learning · Computer Science 2022-04-05 Kaize Ding , Jianling Wang , James Caverlee , Huan Liu

Graph neural networks (GNNs) have received much attention recently because of their excellent performance on graph-based tasks. However, existing research on GNNs focuses on designing more effective models without considering much about the…

Machine Learning · Computer Science 2021-04-20 Han Yang , Xiao Yan , Xinyan Dai , Yongqiang Chen , James Cheng

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Residual connections and normalization layers have become standard design choices for graph neural networks (GNNs), and were proposed as solutions to the mitigate the oversmoothing problem in GNNs. However, how exactly these methods help…

Machine Learning · Computer Science 2026-01-21 Michael Scholkemper , Xinyi Wu , Ali Jadbabaie , Michael T. Schaub

We target open-world feature extrapolation problem where the feature space of input data goes through expansion and a model trained on partially observed features needs to handle new features in test data without further retraining. The…

Machine Learning · Computer Science 2023-06-14 Qitian Wu , Chenxiao Yang , Junchi Yan

In machine learning, graph embedding algorithms seek low-dimensional representations of the input network data, thereby allowing for downstream tasks on compressed encodings. Recently, within the framework of network renormalization,…

Physics and Society · Physics 2025-08-29 Riccardo Milocco , Fabian Jansen , Diego Garlaschelli

Graph Neural Networks (GNNs) achieve strong performance on node classification tasks but remain difficult to interpret, particularly with respect to which input features drive their predictions. Existing global GNN explainers operate at the…

Machine Learning · Computer Science 2026-05-06 Rishi Raj Sahoo , Subhankar Mishra

Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for imbalanced…

Machine Learning · Computer Science 2022-02-08 Xiaohe Li , Lijie Wen , Yawen Deng , Fuli Feng , Xuming Hu , Lei Wang , Zide Fan

Graph neural networks (GNNs) have become a workhorse approach for learning from data defined over irregular domains, typically by implicitly assuming that the data structure is represented by a homophilic graph. However, recent works have…

Machine Learning · Computer Science 2024-09-16 Samuel Rey , Madeline Navarro , Victor M. Tenorio , Santiago Segarra , Antonio G. Marques

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Graph neural networks (GNNs) have been demonstrated to be powerful in modeling graph-structured data. However, training GNNs usually requires abundant task-specific labeled data, which is often arduously expensive to obtain. One effective…

Machine Learning · Computer Science 2020-06-30 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Kai-Wei Chang , Yizhou Sun

Graph neural networks (GNNs) have emerged as a powerful tool for modeling graph-structured data. However, existing GNNs often struggle with heterophilic graphs, where connected nodes tend to have dissimilar features or labels. While…

Machine Learning · Computer Science 2026-02-10 Ruizhong Qiu , Ting-Wei Li , Gaotang Li , Hanghang Tong

The inference of gene regulatory networks (GRNs) is a foundational stride towards deciphering the fundamentals of complex biological systems. Inferring a possible regulatory link between two genes can be formulated as a link prediction…

Machine Learning · Computer Science 2025-04-25 Binon Teji , Swarup Roy