English
Related papers

Related papers: Homophily modulates double descent generalization …

200 papers

Graph neural networks (GNN) suffer from severe inefficiency. It is mainly caused by the exponential growth of node dependency with the increase of layers. It extremely limits the application of stochastic optimization algorithms so that the…

Machine Learning · Computer Science 2024-04-23 Hongyuan Zhang , Yanan Zhu , Xuelong Li

Graph convolution (GConv) is a widely used technique that has been demonstrated to be extremely effective for graph learning applications, most notably node categorization. On the other hand, many GConv-based models do not quantify the…

Machine Learning · Computer Science 2022-07-27 Zhiqian Chen , Zonghan Zhang

Graph-based fraud detection has heretofore received considerable attention. Owning to the great success of Graph Neural Networks (GNNs), many approaches adopting GNNs for fraud detection has been gaining momentum. However, most existing…

Machine Learning · Computer Science 2022-10-25 Zhixun Li , Dingshuo Chen , Qiang Liu , Shu Wu

Traditional convolutional neural networks are limited to handling Euclidean space data, overlooking the vast realm of real-life scenarios represented as graph data, including transportation networks, social networks, and reference networks.…

Machine Learning · Computer Science 2023-07-04 Xingyu Liu , Juan Chen , Quan Wen

Graph convolutional networks are a popular class of deep neural network algorithms which have shown success in a number of relational learning tasks. Despite their success, graph convolutional networks exhibit a number of peculiar features,…

Machine Learning · Computer Science 2022-08-22 Thomas Gebhart

Graphs are general and powerful data representations which can model complex real-world phenomena, ranging from chemical compounds to social networks; however, effective feature extraction from graphs is not a trivial task, and much work…

Homophily, the tendency of similar nodes to connect, is a fundamental phenomenon in network science and a critical factor in the performance of graph neural networks (GNNs). While existing studies primarily explore homophily in homogeneous…

Social and Information Networks · Computer Science 2025-11-18 Zhen Tao , Ziyue Qiao , Chaoqi Chen , Zhengyi Yang , Lun Du , Qingqiang Sun

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

This paper explores the connection between learning trajectories of Deep Neural Networks (DNNs) and their generalization capabilities when optimized using (stochastic) gradient descent algorithms. Instead of concentrating solely on the…

Machine Learning · Computer Science 2023-11-01 Jingwen Fu , Zhizheng Zhang , Dacheng Yin , Yan Lu , Nanning Zheng

Graph neural networks (GNNs) have emerged as powerful models for learning representations of graph data showing state of the art results in various tasks. Nevertheless, the superiority of these methods is usually supported by either…

Machine Learning · Computer Science 2024-11-22 Tianqi Zhao , Megha Khosla

Graph Neural Networks (GNNs) have achieved remarkable success in various graph mining tasks by aggregating information from neighborhoods for representation learning. The success relies on the homophily assumption that nearby nodes exhibit…

Machine Learning · Computer Science 2024-06-03 Zhuonan Zheng , Sheng Zhou , Hongjia Xu , Ming Gu , Yilun Xu , Ao Li , Yuhong Li , Jingjun Gu , Jiajun Bu

Graph convolutional neural networks (GCNNs) have emerged as powerful tools for analyzing graph-structured data, achieving remarkable success across diverse applications. However, the theoretical understanding of the stability of these…

Machine Learning · Computer Science 2025-10-28 Ning Zhang , Henry Kenlay , Li Zhang , Mihai Cucuringu , Xiaowen Dong

Although graph neural networks (GNNs) have made great progress recently on learning from graph-structured data in practice, their theoretical guarantee on generalizability remains elusive in the literature. In this paper, we provide a…

Machine Learning · Computer Science 2020-06-26 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Simplicial complexes can be viewed as high dimensional generalizations of graphs that explicitly encode multi-way ordered relations between vertices at different resolutions, all at once. This concept is central towards detection of higher…

Machine Learning · Computer Science 2022-07-05 Alexandros Dimitrios Keros , Vidit Nanda , Kartic Subr

Heterophily has been considered as an issue that hurts the performance of Graph Neural Networks (GNNs). To address this issue, some existing work uses a graph-level weighted fusion of the information of multi-hop neighbors to include more…

Machine Learning · Computer Science 2023-06-21 Yuhan Chen , Yihong Luo , Jing Tang , Liang Yang , Siya Qiu , Chuan Wang , Xiaochun Cao

Graph Neural Networks (GNN) have emerged as a popular and standard approach for learning from graph-structured data. The literature on GNN highlights the potential of this evolving research area and its widespread adoption in real-life…

Machine Learning · Computer Science 2024-03-25 Sukhdeep Singh , Anuj Sharma , Vinod Kumar Chauhan

Most existing Graph Neural Networks (GNNs) are proposed without considering the selection bias in data, i.e., the inconsistent distribution between the training set with test set. In reality, the test data is not even available during the…

Machine Learning · Computer Science 2022-01-27 Shaohua Fan , Xiao Wang , Chuan Shi , Kun Kuang , Nian Liu , Bai Wang

The message-passing mechanism underlying Graph Neural Networks (GNNs) is not naturally suited for heterophilic datasets, where adjacent nodes often have different labels. Most solutions to this problem remain confined to the task of node…

Machine Learning · Computer Science 2025-06-30 Andrea Giuseppe Di Francesco , Francesco Caso , Maria Sofia Bucarelli , Fabrizio Silvestri

This paper studies causal inference with observational data from a single large network. We consider a nonparametric model with interference in both potential outcomes and selection into treatment. Specifically, both stages may be the…

Econometrics · Economics 2025-12-30 Michael P. Leung , Pantelis Loupos

Graph Neural Networks (GNNs) are efficient approaches to process graph-structured data. Modelling long-distance node relations is essential for GNN training and applications. However, conventional GNNs suffer from bad performance in…

Machine Learning · Computer Science 2020-05-19 Deli Chen , Xiaoqian Liu , Yankai Lin , Peng Li , Jie Zhou , Qi Su , Xu Sun