English
Related papers

Related papers: Heta: Distributed Training of Heterogeneous Graph …

200 papers

Recent years have witnessed fast developments of graph neural networks (GNNs) that have benefited myriad graph analytic tasks and applications. Most GNNs rely on the homophily assumption that nodes belonging to the same class are more…

Machine Learning · Computer Science 2026-04-21 Xin Zheng , Yi Wang , Yixin Liu , Ming Li , Miao Zhang , Di Jin , Philip S. Yu , Shirui Pan

Graph Convolutional Network (GCN) has achieved extraordinary success in learning effective task-specific representations of nodes in graphs. However, regarding Heterogeneous Information Network (HIN), existing HIN-oriented GCN methods still…

Machine Learning · Computer Science 2021-09-09 Yaming Yang , Ziyu Guan , Jianxin Li , Wei Zhao , Jiangtao Cui , Quan Wang

In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations…

Machine Learning · Computer Science 2024-08-30 Yurui Lai , Xiaoyang Lin , Renchi Yang , Hongtao Wang

Heterogeneous Graph Neural Networks (HGNNs) have broadened the applicability of graph representation learning to heterogeneous graphs. However, the irregular memory access pattern of HGNNs leads to the buffer thrashing issue in HGNN…

Hardware Architecture · Computer Science 2024-04-09 Runzhen Xue , Mingyu Yan , Dengke Han , Yihan Teng , Zhimin Tang , Xiaochun Ye , Dongrui Fan

Training Graph Neural Networks (GNNs) on real-world graphs consisting of billions of nodes and edges is quite challenging, primarily due to the substantial memory needed to store the graph and its intermediate node and edge features, and…

Machine Learning · Computer Science 2023-08-08 Kaidi Cao , Rui Deng , Shirley Wu , Edward W Huang , Karthik Subbian , Jure Leskovec

Mining Electronic Health Records (EHRs) becomes a promising topic because of the rich information they contain. By learning from EHRs, machine learning models can be built to help human experts to make medical decisions and thus improve…

Machine Learning · Computer Science 2021-01-19 Zheng Liu , Xiaohan Li , Hao Peng , Lifang He , Philip S. Yu

With the ubiquitous graph-structured data in various applications, models that can learn compact but expressive vector representations of nodes have become highly desirable. Recently, bearing the message passing paradigm, graph neural…

Social and Information Networks · Computer Science 2021-04-13 Tong Chen , Hongzhi Yin , Jie Ren , Zi Huang , Xiangliang Zhang , Hao Wang

In this paper, we focus on graph representation learning of heterogeneous information network (HIN), in which various types of vertices are connected by various types of relations. Most of the existing methods conducted on HIN revise…

Machine Learning · Computer Science 2019-12-24 Huiting Hong , Hantao Guo , Yucheng Lin , Xiaoqing Yang , Zang Li , Jieping Ye

Real-world graphs are typically complex, exhibiting heterogeneity in the global structure, as well as strong heterophily within local neighborhoods. While a growing body of literature has revealed the limitations of common graph neural…

Machine Learning · Computer Science 2023-10-19 Jintang Li , Zheng Wei , Jiawang Dan , Jing Zhou , Yuchang Zhu , Ruofan Wu , Baokun Wang , Zhang Zhen , Changhua Meng , Hong Jin , Zibin Zheng , Liang Chen

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Federated Graph Learning (FGL) aims to collaboratively and privately optimize graph models on divergent data for different tasks. A critical challenge in FGL is to enable effective yet efficient federated optimization against multifaceted…

Machine Learning · Computer Science 2024-11-05 Zhuoning Guo , Ruiqian Han , Hao Liu

Graph representation learning has attracted much attention in supporting high quality candidate search at scale. Despite its effectiveness in learning embedding vectors for objects in the user-item interaction network, the computational…

Information Retrieval · Computer Science 2020-03-05 Qiaoyu Tan , Ninghao Liu , Xing Zhao , Hongxia Yang , Jingren Zhou , Xia Hu

Recently, heterogeneous graph neural networks (HGNNs) have achieved impressive success in representation learning by capturing long-range dependencies and heterogeneity at the node level. However, few existing studies have delved into the…

Machine Learning · Computer Science 2024-04-17 Jinhui Yuan , Shan Lu , Peibo Duan , Jieyue He

Heterogeneous graphs have attracted a lot of research interests recently due to the success for representing complex real-world systems. However, existing methods have two pain points in embedding them into low-dimensional spaces: the…

Machine Learning · Computer Science 2024-06-18 Qijie Bai , Changli Nie , Haiwei Zhang , Zhicheng Dou , Xiaojie Yuan

Real-world graph data environments intrinsically exist noise (e.g., link and structure errors) that inevitably disturb the effectiveness of graph representation and downstream learning tasks. For homogeneous graphs, the latest works use…

Machine Learning · Computer Science 2024-12-25 Xiong Zhang , Cheng Xie , Haoran Duan , Beibei Yu

Meta-learning extracts common knowledge from learning different tasks and uses it for unseen tasks. It can significantly improve tasks that suffer from insufficient training data, e.g., few shot learning. In most meta-learning methods,…

Machine Learning · Computer Science 2019-11-06 Lu Liu , Tianyi Zhou , Guodong Long , Jing Jiang , Chengqi Zhang

Multi-agent teaming achieves better performance when there is communication among participating agents allowing them to coordinate their actions for maximizing shared utility. However, when collaborating a team of agents with different…

Multiagent Systems · Computer Science 2021-11-01 Esmaeil Seraj , Zheyuan Wang , Rohan Paleja , Matthew Sklar , Anirudh Patel , Matthew Gombolay

Graph representation learning is to learn universal node representations that preserve both node attributes and structural information. The derived node representations can be used to serve various downstream tasks, such as node…

Machine Learning · Computer Science 2020-11-16 Yuxiang Ren , Bo Liu , Chao Huang , Peng Dai , Liefeng Bo , Jiawei Zhang

Graph representation learning for hypergraphs can be used to extract patterns among higher-order interactions that are critically important in many real world problems. Current approaches designed for hypergraphs, however, are unable to…

Machine Learning · Computer Science 2019-11-11 Ruochi Zhang , Yuesong Zou , Jian Ma

Distributed training of GNNs enables learning on massive graphs (e.g., social and e-commerce networks) that exceed the storage and computational capacity of a single machine. To reach performance comparable to centralized training,…

Machine Learning · Computer Science 2023-05-18 Jiong Zhu , Aishwarya Reganti , Edward Huang , Charles Dickens , Nikhil Rao , Karthik Subbian , Danai Koutra