English
Related papers

Related papers: Improving Expressivity of GNNs with Subgraph-speci…

200 papers

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Graph Neural Networks (GNNs) have demonstrated remarkable efficacy in handling graph-structured data; however, they exhibit failures after deployment, which can cause severe consequences. Hence, conducting thorough testing before deployment…

Software Engineering · Computer Science 2025-12-23 Lichen Yang , Qiang Wang , Zhonghao Yang , Daojing He , Yu Li

Benefiting from the message passing mechanism, Graph Neural Networks (GNNs) have been successful on flourish tasks over graph data. However, recent studies have shown that attackers can catastrophically degrade the performance of GNNs by…

Machine Learning · Computer Science 2023-04-24 Kuan Li , Yang Liu , Xiang Ao , Jianfeng Chi , Jinghua Feng , Hao Yang , Qing He

How can we enhance the node features acquired from Pretrained Models (PMs) to better suit downstream graph learning tasks? Graph Neural Networks (GNNs) have become the state-of-the-art approach for many high-impact, real-world graph…

Machine Learning · Computer Science 2025-04-01 Jing Zhu , Xiang Song , Vassilis N. Ioannidis , Danai Koutra , Christos Faloutsos

Graph Neural Networks (GNN) are inherently limited in their expressive power. Recent seminal works (Xu et al., 2019; Morris et al., 2019b) introduced the Weisfeiler-Lehman (WL) hierarchy as a measure of expressive power. Although this…

Machine Learning · Computer Science 2023-06-06 Omri Puny , Derek Lim , Bobak T. Kiani , Haggai Maron , Yaron Lipman

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

Unsupervised/self-supervised graph neural networks (GNN) are vulnerable to inherent randomness in the input graph data which greatly affects the performance of the model in downstream tasks. In this paper, we alleviate the interference of…

Machine Learning · Computer Science 2023-08-14 Yifei Wang , Yupan Wang , Zeyu Zhang , Song Yang , Kaiqi Zhao , Jiamou Liu

Graph Neural Network (GNN) aggregates the neighborhood of each node into the node embedding and shows its powerful capability for graph representation learning. However, most existing GNN variants aggregate the neighborhood information in a…

Machine Learning · Computer Science 2020-10-13 Chengsheng Mao , Liang Yao , Yuan Luo

Recently, Graph Neural Networks (GNNs) have greatly advanced the task of graph classification. Typically, we first build a unified GNN model with graphs in a given training set and then use this unified model to predict labels of all the…

Machine Learning · Computer Science 2021-12-15 Yiqi Wang , Yao Ma , Wei Jin , Chaozhuo Li , Charu Aggarwal , Jiliang Tang

Graph prediction problems prevail in data analysis and machine learning. The inverse prediction problem, namely to infer input data from given output labels, is of emerging interest in various applications. In this work, we develop…

Machine Learning · Statistics 2022-11-22 Chen Xu , Xiuyuan Cheng , Yao Xie

Graph Neural Networks (GNNs) have attracted considerable attention and have emerged as a new promising paradigm to process graph-structured data. GNNs are usually stacked to multiple layers and the node representations in each layer are…

Machine Learning · Computer Science 2020-09-25 Yihao Chen , Xin Tang , Xianbiao Qi , Chun-Guang Li , Rong Xiao

Recently, there have been some breakthroughs in graph analysis by applying the graph neural networks (GNNs) following a neighborhood aggregation scheme, which demonstrate outstanding performance in many tasks. However, we observe that the…

Machine Learning · Computer Science 2021-04-13 Hanchen Wang , Defu Lian , Ying Zhang , Lu Qin , Xiangjian He , Yiguang Lin , Xuemin Lin

Graph Neural Networks (GNNs) are powerful deep learning models to generate node embeddings on graphs. When applying deep GNNs on large graphs, it is still challenging to perform training in an efficient and scalable way. We propose a novel…

Machine Learning · Computer Science 2020-10-08 Hanqing Zeng , Hongkuan Zhou , Ajitesh Srivastava , Rajgopal Kannan , Viktor Prasanna

Graph-structured data is ubiquitous in practice and often processed using graph neural networks (GNNs). With the adoption of recent laws ensuring the ``right to be forgotten'', the problem of graph data removal has become of significant…

Machine Learning · Computer Science 2022-11-01 Eli Chien , Chao Pan , Olgica Milenkovic

Graph Neural Networks (GNNs) have become the backbone for a myriad of tasks pertaining to graphs and similar topological data structures. While many works have been established in domains related to node and graph classification/regression…

Machine Learning · Computer Science 2022-09-07 Appan Rakaraddi , Siew Kei Lam , Mahardhika Pratama , Marcus De Carvalho

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Graph, as an important data representation, is ubiquitous in many real world applications ranging from social network analysis to biology. How to correctly and effectively learn and extract information from graph is essential for a large…

Machine Learning · Computer Science 2020-10-27 Xiaodong Jiang , Ronghang Zhu , Pengsheng Ji , Sheng Li

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

The expressivity of Graph Neural Networks (GNNs) has been studied broadly in recent years to reveal the design principles for more powerful GNNs. Graph canonization is known as a typical approach to distinguish non-isomorphic graphs, yet…

Machine Learning · Computer Science 2024-02-12 Zehao Dong , Muhan Zhang , Philip R. O. Payne , Michael A Province , Carlos Cruchaga , Tianyu Zhao , Fuhai Li , Yixin Chen

Inspired by the immense success of deep learning, graph neural networks (GNNs) are widely used to learn powerful node representations and have demonstrated promising performance on different graph learning tasks. However, most real-world…

Machine Learning · Computer Science 2020-01-24 Kaize Ding , Yichuan Li , Jundong Li , Chenghao Liu , Huan Liu