English
Related papers

Related papers: Heta: Distributed Training of Heterogeneous Graph …

200 papers

Optimizing power control in multi-cell cellular networks with deep learning enables such a non-convex problem to be implemented in real-time. When channels are time-varying, the deep neural networks (DNNs) need to be re-trained frequently,…

Machine Learning · Computer Science 2020-11-09 Jia Guo , Chenyang Yang

Recently, graph neural networks have shown the superiority of modeling the complex topological structures in heterogeneous network-based recommender systems. Due to the diverse interactions among nodes and abundant semantics emerging from…

Machine Learning · Computer Science 2022-08-04 Tiankai Gu , Chaokun Wang , Cheng Wu , Jingcao Xu , Yunkai Lou , Changping Wang , Kai Xu , Can Ye , Yang Song

Graph Neural Networks (GNNs) are widely used in graph representation learning. However, most GNN methods are designed for either homogeneous or heterogeneous graphs. In this paper, we propose a new model, Hop-Hop Relation-aware Graph Neural…

Machine Learning · Computer Science 2020-12-22 Li Zhang , Yan Ge , Haiping Lu

Graph Convolutional Networks (GCNs), particularly for large-scale graphs, are crucial across numerous domains. However, training distributed full-batch GCNs on large-scale graphs suffers from inefficient memory access patterns and high…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-27 Chen Zhuang , Lingqi Zhang , Du Wu , Peng Chen , Jiajun Huang , Xin Liu , Rio Yokota , Nikoli Dryden , Toshio Endo , Satoshi Matsuoka , Mohamed Wahib

Graph Convolutional Networks (GCNs) are predominantly tailored for graphs displaying homophily, where similar nodes connect, but often fail on heterophilic graphs. The strategy of adopting distinct approaches to learn from homophilic and…

Machine Learning · Computer Science 2025-04-09 Han Lei , Jiaxing Xu , Xia Dong , Yiping Ke

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs. In this project we study hierarchical message passing models that leverage a…

Machine Learning · Computer Science 2021-08-17 Ladislav Rampášek , Guy Wolf

Graph neural networks (GNN) have shown great success in learning from graph-structured data. They are widely used in various applications, such as recommendation, fraud detection, and search. In these domains, the graphs are typically large…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-03-15 Da Zheng , Xiang Song , Chengru Yang , Dominique LaSalle , George Karypis

Detecting vulnerabilities in source code is a critical task for software security assurance. Graph Neural Network (GNN) machine learning can be a promising approach by modeling source code as graphs. Early approaches treated code elements…

Cryptography and Security · Computer Science 2025-02-25 Yu Luo , Weifeng Xu , Dianxiang Xu

Recent advances in Graph Neural Networks (GNNs) have revolutionized graph-structured data modeling, yet traditional GNNs struggle with complex heterogeneous structures prevalent in real-world scenarios. Despite progress in handling…

Machine Learning · Computer Science 2025-01-07 Zongwei Li , Lianghao Xia , Hua Hua , Shijie Zhang , Shuangyang Wang , Chao Huang

Social networks are considered to be heterogeneous graph neural networks (HGNNs) with deep learning technological advances. HGNNs, compared to homogeneous data, absorb various aspects of information about individuals in the training stage.…

Machine Learning · Computer Science 2022-10-11 Yuecen Wei , Xingcheng Fu , Qingyun Sun , Hao Peng , Jia Wu , Jinyan Wang , Xianxian Li

Heterogeneous graph is a kind of data structure widely existing in real life. Nowadays, the research of graph neural network on heterogeneous graph has become more and more popular. The existing heterogeneous graph neural network algorithms…

Artificial Intelligence · Computer Science 2021-06-28 Xinliang Wu , Mengying Jiang , Guizhong Liu

Graph neural network (GNN) has been demonstrated to be a powerful model in many domains for its effectiveness in learning over graphs. To scale GNN training for large graphs, a widely adopted approach is distributed training which…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-19 Haiyang Lin , Mingyu Yan , Xiaocheng Yang , Mo Zou , Wenming Li , Xiaochun Ye , Dongrui Fan

Graph neural networks (GNNs) have emerged as the state of the art for a variety of graph-related tasks and have been widely used in Heterogeneous Graphs (HetGs), where meta-paths help encode specific semantics between various node types.…

Machine Learning · Computer Science 2025-02-25 Xuqi Mao , Zhenying He , X. Sean Wang

In recent years, heterogeneous graph neural networks (HGNNs) have achieved excellent performance in handling heterogeneous information networks (HINs). Curriculum learning is a machine learning strategy where training examples are presented…

Machine Learning · Computer Science 2024-05-13 Yili Wang

Heterogeneous information networks (HINs) can be used to model various real-world systems. As HINs consist of multiple types of nodes, edges, and node features, it is nontrivial to directly apply graph neural network (GNN) techniques in…

Machine Learning · Computer Science 2025-01-15 Zhaoqing Li , Maiqi Jiang , Shengyuan Chen , Bo Li , Guorong Chen , Xiao Huang

Graph Neural Networks (GNNs) are a framework for graph representation learning, where a model learns to generate low dimensional node embeddings that encapsulate structural and feature-related information. GNNs are usually trained in an…

Machine Learning · Computer Science 2020-12-15 Davide Buffelli , Fabio Vandin

Federated graph learning is a widely recognized technique that promotes collaborative training of graph neural networks (GNNs) by multi-client graphs.However, existing approaches heavily rely on the communication of model parameters or…

Machine Learning · Computer Science 2025-05-06 Hao Zhang , Xunkai Li , Yinlin Zhu , Lianglin Hu

Graph neural networks (GNNs) naturally align with sparse operators and unstructured discretizations, making them a promising paradigm for physics-informed machine learning in computational mechanics. Motivated by discrete physics losses and…

Machine Learning · Computer Science 2026-02-10 Jianchuan Yang , Xi Chen , Jidong Zhao

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

Machine Learning · Computer Science 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

Data continuously emitted from industrial ecosystems such as social or e-commerce platforms are commonly represented as heterogeneous graphs (HG) composed of multiple node/edge types. State-of-the-art graph learning methods for HGs known as…

Machine Learning · Computer Science 2022-10-14 Minji Yoon , John Palowitch , Dustin Zelle , Ziniu Hu , Ruslan Salakhutdinov , Bryan Perozzi