English
Related papers

Related papers: HiGPT: Heterogeneous Graph Language Model

200 papers

Universal graph pre-training has emerged as a key paradigm in graph representation learning, offering a promising way to train encoders to learn transferable representations from unlabeled graphs and to effectively generalize across a wide…

Machine Learning · Computer Science 2026-02-27 Lianze Shan , Jitao Zhao , Dongxiao He , Yongqi Huang , Zhiyong Feng , Weixiong Zhang

Graph representation learning for hypergraphs can be used to extract patterns among higher-order interactions that are critically important in many real world problems. Current approaches designed for hypergraphs, however, are unable to…

Machine Learning · Computer Science 2019-11-11 Ruochi Zhang , Yuesong Zou , Jian Ma

While the celebrated graph neural networks yield effective representations for individual nodes of a graph, there has been relatively less success in extending to the task of graph similarity learning. Recent work on graph similarity…

Machine Learning · Computer Science 2021-08-20 Xiang Ling , Lingfei Wu , Saizhuo Wang , Tengfei Ma , Fangli Xu , Alex X. Liu , Chunming Wu , Shouling Ji

Heterogeneous graph neural networks (HGNNs) were proposed for representation learning on structural data with multiple types of nodes and edges. To deal with the performance degradation issue when HGNNs become deep, researchers combine…

Machine Learning · Computer Science 2023-11-27 Xinyu Fu , Irwin King

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Heterogeneous graphs are ubiquitous data structures that can inherently capture multi-type and multi-modal interactions between objects. In recent years, research on encoding heterogeneous graph into latent representations have enjoyed a…

Social and Information Networks · Computer Science 2023-07-06 Chen Ling , Carl Yang , Liang Zhao

Heterogeneous graph is a kind of data structure widely existing in real life. Nowadays, the research of graph neural network on heterogeneous graph has become more and more popular. The existing heterogeneous graph neural network algorithms…

Artificial Intelligence · Computer Science 2021-06-28 Xinliang Wu , Mengying Jiang , Guizhong Liu

Graph Neural Networks (GNNs) are well-suited for learning on homophilous graphs, i.e., graphs in which edges tend to connect nodes of the same type. Yet, achievement of consistent GNN performance on heterophilous graphs remains an open…

Machine Learning · Computer Science 2023-08-30 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

Graph Neural Networks (GNNs) are characterized by their capacity of processing graph-structured data. However, due to the sparsity of labels under semi-supervised learning, they have been found to exhibit biased performance on specific…

Machine Learning · Computer Science 2025-12-16 Yihan Zhang

Graphs are able to model interconnected entities in many online services, supporting a wide range of applications on the Web. This raises an important question: How can we train a graph foundational model on multiple source domains and…

Computation and Language · Computer Science 2025-04-15 Xingtong Yu , Zechuan Gong , Chang Zhou , Yuan Fang , Hui Zhang

Recent advances in Graph Neural Networks (GNNs) have revolutionized graph-structured data modeling, yet traditional GNNs struggle with complex heterogeneous structures prevalent in real-world scenarios. Despite progress in handling…

Machine Learning · Computer Science 2025-01-07 Zongwei Li , Lianghao Xia , Hua Hua , Shijie Zhang , Shuangyang Wang , Chao Huang

Federated Graph Learning (FGL) aims to collaboratively and privately optimize graph models on divergent data for different tasks. A critical challenge in FGL is to enable effective yet efficient federated optimization against multifaceted…

Machine Learning · Computer Science 2024-11-05 Zhuoning Guo , Ruiqian Han , Hao Liu

Dynamic graphs evolve continuously, presenting challenges for traditional graph learning due to their changing structures and temporal dependencies. Recent advancements have shown potential in addressing these challenges by developing…

Machine Learning · Computer Science 2025-06-03 Hao Li , Hao Wan , Yuzhou Chen , Dongsheng Ye , Yulia Gel , Hao Jiang

Recently, pretraining methods for the Graph Neural Networks (GNNs) have been successful at learning effective representations from unlabeled graph data. However, most of these methods rely on pairwise relations in the graph and do not…

Machine Learning · Computer Science 2023-11-21 Abdalgader Abubaker , Takanori Maehara , Madhav Nimishakavi , Vassilis Plachouras

This paper explores the applications and challenges of graph neural networks (GNNs) in processing complex graph data brought about by the rapid development of the Internet. Given the heterogeneity and redundancy problems that graph data…

Machine Learning · Computer Science 2024-10-24 Jianjun Wei , Yue Liu , Xin Huang , Xin Zhang , Wenyi Liu , Xu Yan

Heterogeneous graphs are widely present in real-world complex networks, where the diversity of node and relation types leads to complex and rich semantics. Efforts for modeling complex relation semantics in heterogeneous graphs are…

Computation and Language · Computer Science 2025-11-25 Wenda Li , Tongya Zheng , Shunyu Liu , Yu Wang , Kaixuan Chen , Hanyang Yuan , Bingde Hu , Zujie Ren , Mingli Song , Gang Chen

Unsupervised heterogeneous graph representation learning (UHGRL) has gained increasing attention due to its significance in handling practical graphs without labels. However, heterophily has been largely ignored, despite its ubiquitous…

Machine Learning · Computer Science 2025-02-05 Zhixiang Shen , Zhao Kang

Heterogeneous graph neural networks aim to discover discriminative node embeddings and relations from multi-relational networks.One challenge of heterogeneous graph learning is the design of learnable meta-paths, which significantly…

Machine Learning · Computer Science 2023-04-19 Zhaoliang Chen , Zhihao Wu , Luying Zhong , Claudia Plant , Shiping Wang , Wenzhong Guo

Graph Neural Networks (GNNs) have been generalized to process the heterogeneous graphs by various approaches. Unfortunately, these approaches usually model the heterogeneity via various complicated modules. This paper aims to propose a…

Machine Learning · Computer Science 2023-11-23 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Heterogeneous graphs provide a compact, efficient, and scalable way to model data involving multiple disparate modalities. This makes modeling audiovisual data using heterogeneous graphs an attractive option. However, graph structure does…

Sound · Computer Science 2023-03-14 Amir Shirian , Mona Ahmadian , Krishna Somandepalli , Tanaya Guha