English
Related papers

Related papers: Mitigating Degree Bias in Graph Representation Lea…

200 papers

Graph Neural Networks (GNNs) struggle to balance heterophily and homophily in representation learning, a challenge further amplified in self-supervised settings. We propose H$^3$GNNs, an end-to-end self-supervised learning framework that…

Machine Learning · Computer Science 2025-04-17 Rui Xue , Tianfu Wu

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

Machine Learning · Computer Science 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

Graph-based fraud detection has heretofore received considerable attention. Owning to the great success of Graph Neural Networks (GNNs), many approaches adopting GNNs for fraud detection has been gaining momentum. However, most existing…

Machine Learning · Computer Science 2022-10-25 Zhixun Li , Dingshuo Chen , Qiang Liu , Shu Wu

Heterophily, or the tendency of connected nodes in networks to have different class labels or dissimilar features, has been identified as challenging for many Graph Neural Network (GNN) models. While the challenges of applying GNNs for node…

Machine Learning · Computer Science 2024-09-27 Jiong Zhu , Gaotang Li , Yao-An Yang , Jing Zhu , Xuehao Cui , Danai Koutra

Knowledge graph data are prevalent in real-world applications, and knowledge graph neural networks (KGNNs) are essential techniques for knowledge graph representation learning. Although KGNN effectively models the structural information…

Artificial Intelligence · Computer Science 2022-12-06 Yu-Neng Chuang , Kwei-Herng Lai , Ruixiang Tang , Mengnan Du , Chia-Yuan Chang , Na Zou , Xia Hu

Graph Neural Networks (GNNs) have achieved remarkable success in various graph mining tasks by aggregating information from neighborhoods for representation learning. The success relies on the homophily assumption that nearby nodes exhibit…

Machine Learning · Computer Science 2024-06-03 Zhuonan Zheng , Sheng Zhou , Hongjia Xu , Ming Gu , Yilun Xu , Ao Li , Yuhong Li , Jingjun Gu , Jiajun Bu

Heterogeneous Graph Neural Networks (HGNNs) are a class of powerful deep learning methods widely used to learn representations of heterogeneous graphs. Despite the fast development of HGNNs, they still face some challenges such as…

Machine Learning · Computer Science 2023-05-29 Xiao Yang , Xuejiao Zhao , Zhiqi Shen

Unsupervised node representation learning aims to obtain meaningful node embeddings without relying on node labels. To achieve this, graph convolution, which aggregates information from neighboring nodes, is commonly employed to encode node…

Machine Learning · Computer Science 2025-12-18 Sunwoo Kim , Soo Yong Lee , Kyungho Kim , Hyunjin Hwang , Jaemin Yoo , Kijung Shin

The emerging graph Transformers have achieved impressive performance for graph representation learning over graph neural networks (GNNs). In this work, we regard the self-attention mechanism, the core module of graph Transformers, as a…

Machine Learning · Computer Science 2023-10-18 Jinsong Chen , Gaichao Li , John E. Hopcroft , Kun He

In the past, the dichotomy between homophily and heterophily has inspired research contributions toward a better understanding of Deep Graph Networks' inductive bias. In particular, it was believed that homophily strongly correlates with…

Machine Learning · Computer Science 2023-08-21 Daniele Castellana , Federico Errica

Graph condensation (GC) has become a vital strategy for scaling Graph Neural Networks by compressing massive datasets into small, synthetic node sets. While current GC methods effectively maintain predictive accuracy, they are primarily…

Machine Learning · Computer Science 2026-03-31 Yihan Gao , Chenxi Huang , Wen Shi , Ke Sun , Ziqi Xu , Xikun Zhang , Mingliang Hou , Renqiang Luo

Graph neural networks (GNNs) learn to represent nodes by aggregating information from their neighbors. As GNNs increase in depth, their receptive field grows exponentially, leading to high memory costs. Several existing methods address this…

Machine Learning · Computer Science 2025-07-16 Taraneh Younesian , Daniel Daza , Emile van Krieken , Thiviyan Thanapalasingam , Peter Bloem

Real-world graph data environments intrinsically exist noise (e.g., link and structure errors) that inevitably disturb the effectiveness of graph representation and downstream learning tasks. For homogeneous graphs, the latest works use…

Machine Learning · Computer Science 2024-12-25 Xiong Zhang , Cheng Xie , Haoran Duan , Beibei Yu

Homophily is a graph property describing the tendency of edges to connect similar nodes; the opposite is called heterophily. It is often believed that heterophilous graphs are challenging for standard message-passing graph neural networks…

Social and Information Networks · Computer Science 2024-04-17 Oleg Platonov , Denis Kuznedelev , Artem Babenko , Liudmila Prokhorenkova

Inspired by the recent success of self-supervised methods applied on images, self-supervised learning on graph structured data has seen rapid growth especially centered on augmentation-based contrastive methods. However, we argue that…

Machine Learning · Computer Science 2021-12-08 Namkyeong Lee , Junseok Lee , Chanyoung Park

Graph representation learning, aiming to learn low-dimensional representations which capture the geometric dependencies between nodes in the original graph, has gained increasing popularity in a variety of graph analysis tasks, including…

Machine Learning · Computer Science 2019-10-07 Lu Wang , Wenchao Yu , Wei Wang , Wei Cheng , Wei Zhang , Hongyuan Zha , Xiaofeng He , Haifeng Chen

Graph neural networks have been extensively studied for learning with inter-connected data. Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing, heterophily, handling long-range dependencies, edge…

Machine Learning · Computer Science 2023-06-16 Qitian Wu , Wentao Zhao , Zenan Li , David Wipf , Junchi Yan

Graph Neural Networks (GNNs) traditionally employ a message-passing mechanism that resembles diffusion over undirected graphs, which often leads to homogenization of node features and reduced discriminative power in tasks such as node…

Machine Learning · Computer Science 2025-03-04 Seong Ho Pahng , Sahand Hormoz

Can neural networks learn to compare graphs without feature engineering? In this paper, we show that it is possible to learn representations for graph similarity with neither domain knowledge nor supervision (i.e.\ feature engineering or…

Machine Learning · Computer Science 2019-04-23 Rami Al-Rfou , Dustin Zelle , Bryan Perozzi

Hypergraph Neural Networks (HyGNNs) have demonstrated remarkable success in modeling higher-order relationships among entities. However, their performance often degrades on heterophilic hypergraphs, where nodes connected by the same…

Machine Learning · Computer Science 2026-02-17 Tianyi Ma , Yiyue Qian , Zehong Wang , Zheyuan Zhang , Chuxu Zhang , Yanfang Ye