English
Related papers

Related papers: HeRB: Heterophily-Resolved Structure Balancer for …

200 papers

Graph neural networks (GNNs) are known to be vulnerable to oversmoothing due to their implicit homophily assumption. We mitigate this problem with a novel scheme that regulates the aggregation of messages, modulating the type and extent of…

Machine Learning · Computer Science 2025-12-03 Haishan Wang , Arno Solin , Vikas Garg

Recent research on graph neural networks (GNNs) has explored mechanisms for capturing local uncertainty and exploiting graph hierarchies to mitigate data sparsity and leverage structural properties. However, the synergistic integration of…

Machine Learning · Computer Science 2025-05-06 Yoonhyuk Choi , Jiho Choi , Taewook Ko , Chong-Kwon Kim

We propose a novel solution to addressing a long-standing dilemma in the representation learning of graph neural networks (GNNs): how to effectively capture and represent useful information embedded in long-distance nodes to improve the…

Machine Learning · Computer Science 2022-02-17 Ailing Zeng , Minhao Liu , Zhiwei Liu , Ruiyuan Gao , Jing Qin , Qiang Xu

Heterogeneous graphs have attracted a lot of research interests recently due to the success for representing complex real-world systems. However, existing methods have two pain points in embedding them into low-dimensional spaces: the…

Machine Learning · Computer Science 2024-06-18 Qijie Bai , Changli Nie , Haiwei Zhang , Zhicheng Dou , Xiaojie Yuan

Learning unbiased node representations for imbalanced samples in the graph has become a more remarkable and important topic. For the graph, a significant challenge is that the topological properties of the nodes (e.g., locations, roles) are…

Machine Learning · Computer Science 2023-04-12 Xingcheng Fu , Yuecen Wei , Qingyun Sun , Haonan Yuan , Jia Wu , Hao Peng , Jianxin Li

Graph Neural Networks (GNNs) have been generalized to process the heterogeneous graphs by various approaches. Unfortunately, these approaches usually model the heterogeneity via various complicated modules. This paper aims to propose a…

Machine Learning · Computer Science 2023-11-23 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Graph Neural Networks (GNNs) have excelled in handling graph-structured data, attracting significant research interest. However, two primary challenges have emerged: interference between topology and attributes distorting node…

Machine Learning · Computer Science 2024-11-19 Yachao Yang , Yanfeng Sun , Jipeng Guo , Junbin Gao , Shaofan Wang , Fujiao Ju , Baocai Yin

Graph representation learning (GRL) has emerged as an effective technique for modeling graph-structured data. When modeling heterogeneity and dynamics in real-world complex networks, GRL methods designed for complex heterogeneous temporal…

Social and Information Networks · Computer Science 2026-05-19 Huan Liu , Pengfei Jiao , Mengzhou Gao , Chaochao Chen , Di Jin

Recent advances in Graph Neural Networks (GNNs) have revolutionized graph-structured data modeling, yet traditional GNNs struggle with complex heterogeneous structures prevalent in real-world scenarios. Despite progress in handling…

Machine Learning · Computer Science 2025-01-07 Zongwei Li , Lianghao Xia , Hua Hua , Shijie Zhang , Shuangyang Wang , Chao Huang

Graph Neural Networks (GNNs) have proven effective in various medical imaging applications, such as automated disease diagnosis. However, due to the local neighborhood aggregation paradigm in message passing which characterizes these…

Machine Learning · Computer Science 2024-11-05 K. Mancini , I. Rekik

Unsupervised graph representation learning (UGRL) has drawn increasing research attention and achieved promising results in several graph analytic tasks. Relying on the homophily assumption, existing UGRL methods tend to smooth the learned…

Machine Learning · Computer Science 2022-11-28 Yixin Liu , Yizhen Zheng , Daokun Zhang , Vincent CS Lee , Shirui Pan

Graph Neural Networks (GNNs) have shown state-of-the-art improvements in node classification tasks on graphs. While these improvements have been largely demonstrated in a multi-class classification scenario, a more general and realistic…

Machine Learning · Computer Science 2024-03-01 Tianqi Zhao , Ngan Thi Dong , Alan Hanjalic , Megha Khosla

Graph Neural Networks (GNNs) draw their strength from explicitly modeling the topological information of structured data. However, existing GNNs suffer from limited capability in capturing the hierarchical graph representation which plays…

Machine Learning · Computer Science 2021-03-30 Jinyu Yang , Peilin Zhao , Yu Rong , Chaochao Yan , Chunyuan Li , Hehuan Ma , Junzhou Huang

Graphs are widely used to encapsulate a variety of data formats, but real-world networks often involve complex node relations beyond only being pairwise. While hypergraphs and hierarchical graphs have been developed and employed to account…

Machine Learning · Computer Science 2024-02-21 Zehui Li , Xiangyu Zhao , Mingzhu Shen , Guy-Bart Stan , Pietro Liò , Yiren Zhao

Class imbalance is pervasive in real-world graph datasets, where the majority of annotated nodes belong to a small set of classes (majority classes), leaving many other classes (minority classes) with only a handful of labeled nodes. Graph…

Machine Learning · Computer Science 2024-12-31 Abdullah Alchihabi , Hao Yan , Yuhong Guo

Heterogeneous graph pre-training (HGP) has demonstrated remarkable performance across various domains. However, the issue of heterophily in real-world heterogeneous graphs (HGs) has been largely overlooked. To bridge this research gap, we…

Machine Learning · Computer Science 2025-01-16 Haosen Wang , Chenglong Shi , Can Xu , Surong Yan , Pan Tang

Graph Transformers have recently achieved remarkable progress in graph representation learning by capturing long-range dependencies through self-attention. However, their quadratic computational complexity and inability to effectively model…

Machine Learning · Computer Science 2025-12-17 Yifan Lu , Ziyun Zou , Belal Alsinglawi , Islam Al-Qudah , Izzat Alsmadi , Feilong Tang , Pengfei Jiao , Shoaib Jameel , Imran Razzak

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

Recent studies have highlighted the limitations of message-passing based graph neural networks (GNNs), e.g., limited model expressiveness, over-smoothing, over-squashing, etc. To alleviate these issues, Graph Transformers (GTs) have been…

Machine Learning · Computer Science 2023-03-06 Qiheng Mao , Zemin Liu , Chenghao Liu , Jianling Sun

Integrating Pre-trained Language Models (PLMs) with Graph Neural Networks (GNNs) remains a central challenge in text-rich heterophilic graph learning. We propose a novel integration framework that enables effective fusion between powerful…

Computation and Language · Computer Science 2025-10-09 Aarush Sinha