English
Related papers

Related papers: Heterogeneous Graph Masked Autoencoders

200 papers

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Self-supervised auto-encoders have emerged as a successful framework for representation learning in computer vision and natural language processing in recent years, However, their application to graph data has been met with limited…

Artificial Intelligence · Computer Science 2023-01-31 Chengyu Sun

Self-supervised learning on graphs can be bifurcated into contrastive and generative methods. Contrastive methods, also known as graph contrastive learning (GCL), have dominated graph self-supervised learning in the past few years, but the…

Machine Learning · Computer Science 2024-02-13 Liang Wang , Xiang Tao , Qiang Liu , Shu Wu , Liang Wang

Spatial-temporal graph representations play a crucial role in urban sensing applications, including traffic analysis, human mobility behavior modeling, and citywide crime prediction. However, a key challenge lies in the noisy and sparse…

Machine Learning · Computer Science 2025-08-15 Qianru Zhang , Xinyi Gao , Haixin Wang , Dong Huang , Siu-Ming Yiu , Hongzhi Yin

Heterogeneous graphs (HGs) also known as heterogeneous information networks have become ubiquitous in real-world scenarios; therefore, HG embedding, which aims to learn representations in a lower-dimension space while preserving the…

Social and Information Networks · Computer Science 2020-12-02 Xiao Wang , Deyu Bo , Chuan Shi , Shaohua Fan , Yanfang Ye , Philip S. Yu

Generative graph self-supervised learning (SSL) aims to learn node representations by reconstructing the input graph data. However, most existing methods focus on unsupervised learning tasks only and very few work has shown its superiority…

Machine Learning · Computer Science 2023-02-08 Xiang Li , Tiandi Ye , Caihua Shan , Dongsheng Li , Ming Gao

Masked graph autoencoder (MGAE) has emerged as a promising self-supervised graph pre-training (SGP) paradigm due to its simplicity and effectiveness. However, existing efforts perform the mask-then-reconstruct operation in the raw data…

Machine Learning · Computer Science 2023-04-07 Wenxuan Tu , Qing Liao , Sihang Zhou , Xin Peng , Chuan Ma , Zhe Liu , Xinwang Liu , Zhiping Cai

The recent past has seen an increasing interest in Heterogeneous Graph Neural Networks (HGNNs), since many real-world graphs are heterogeneous in nature, from citation graphs to email graphs. However, existing methods ignore a tree…

Machine Learning · Computer Science 2025-04-15 Mingyu Guan , Jack W. Stokes , Qinlong Luo , Fuchen Liu , Purvanshi Mehta , Elnaz Nouri , Taesoo Kim

Generative self-supervised learning (SSL), especially masked autoencoders (MAE), has greatly succeeded and garnered substantial research interest in graph machine learning. However, the research of MAE in dynamic graphs is still scant. This…

Machine Learning · Computer Science 2024-09-17 Pengfe Jiao , Xinxun Zhang , Mengzhou Gao , Tianpeng Li , Zhidong Zhao

This paper presents HGEN that pioneers ensemble learning for heterogeneous graphs. We argue that the heterogeneity in node types, nodal features, and local neighborhood topology poses significant challenges for ensemble learning,…

Machine Learning · Computer Science 2026-02-05 Jiajun Shen , Yufei Jin , Yi He , Xingquan Zhu

Hypergraphs are marked by complex topology, expressing higher-order interactions among multiple nodes with hyperedges, and better capturing the topology is essential for effective representation learning. Recent advances in generative…

Machine Learning · Computer Science 2024-04-02 Sunwoo Kim , Shinhwan Kang , Fanchen Bu , Soo Yong Lee , Jaemin Yoo , Kijung Shin

Class imbalance in graph data presents significant challenges for node classification. While existing methods, such as SMOTE-based approaches, partially mitigate this issue, they still exhibit limitations in constructing imbalanced graphs.…

Machine Learning · Computer Science 2024-03-28 Yulan Hu , Sheng Ouyang , Zhirui Yang , Yong Liu

Graph masked autoencoders (GMAE) have emerged as a significant advancement in self-supervised pre-training for graph-structured data. Previous GMAE models primarily utilize a straightforward random masking strategy for nodes or edges during…

Machine Learning · Computer Science 2024-04-25 Chuang Liu , Yuyao Wang , Yibing Zhan , Xueqi Ma , Dapeng Tao , Jia Wu , Wenbin Hu

Many real-world graphs (networks) are heterogeneous with different types of nodes and edges. Heterogeneous graph embedding, aiming at learning the low-dimensional node representations of a heterogeneous graph, is vital for various…

Social and Information Networks · Computer Science 2021-12-15 Wentao Xu , Yingce Xia , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

We propose a novel graph-driven generative model, that unifies multiple heterogeneous learning tasks into the same framework. The proposed model is based on the fact that heterogeneous learning tasks, which correspond to different…

Machine Learning · Computer Science 2019-11-21 Wenlin Wang , Hongteng Xu , Zhe Gan , Bai Li , Guoyin Wang , Liqun Chen , Qian Yang , Wenqi Wang , Lawrence Carin

Real-world graphs are typically complex, exhibiting heterogeneity in the global structure, as well as strong heterophily within local neighborhoods. While a growing body of literature has revealed the limitations of common graph neural…

Machine Learning · Computer Science 2023-10-19 Jintang Li , Zheng Wei , Jiawang Dan , Jing Zhou , Yuchang Zhu , Ruofan Wu , Baokun Wang , Zhang Zhen , Changhua Meng , Hong Jin , Zibin Zheng , Liang Chen

Based on digital pathology slice scanning technology, artificial intelligence algorithms represented by deep learning have achieved remarkable results in the field of computational pathology. Compared to other medical images, pathology…

Image and Video Processing · Electrical Eng. & Systems 2023-11-17 Hao Quan , Xingyu Li , Weixing Chen , Qun Bai , Mingchen Zou , Ruijie Yang , Tingting Zheng , Ruiqun Qi , Xinghua Gao , Xiaoyu Cui

Inspired by the success of contrastive learning (CL) in computer vision and natural language processing, graph contrastive learning (GCL) has been developed to learn discriminative node representations on graph datasets. However, the…

Machine Learning · Computer Science 2023-01-03 Zehong Wang , Qi Li , Donghua Yu , Xiaolong Han , Xiao-Zhi Gao , Shigen Shen

Heterogeneous graph pre-training (HGP) has demonstrated remarkable performance across various domains. However, the issue of heterophily in real-world heterogeneous graphs (HGs) has been largely overlooked. To bridge this research gap, we…

Machine Learning · Computer Science 2025-01-16 Haosen Wang , Chenglong Shi , Can Xu , Surong Yan , Pan Tang

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song