English
Related papers

Related papers: Teaching MLPs to Master Heterogeneous Graph-Struct…

200 papers

Real-world graphs exhibit increasing heterophily, where nodes no longer tend to be connected to nodes with the same label, challenging the homophily assumption of classical graph neural networks (GNNs) and impeding their performance.…

Machine Learning · Computer Science 2024-08-22 Jiajun Zhou , Chenxuan Xie , Shengbo Gong , Jiaxu Qian , Shanqing Yu , Qi Xuan , Xiaoniu Yang

We study the challenging problem for inference tasks on large-scale graph datasets of Graph Neural Networks: huge time and memory consumption, and try to overcome it by reducing reliance on graph structure. Even though distilling graph…

Machine Learning · Computer Science 2024-03-05 Junxian Li , Bin Shi , Erfei Cui , Hua Wei , Qinghua Zheng

Weather Forecasting is an attractive challengeable task due to its influence on human life and complexity in atmospheric motion. Supported by massive historical observed time series data, the task is suitable for data-driven approaches,…

Machine Learning · Computer Science 2022-09-20 Minbo Ma , Peng Xie , Fei Teng , Tianrui Li , Bin Wang , Shenggong Ji , Junbo Zhang

Graph Neural Networks (GNNs) have been widely adopted due to their strong performance. However, GNN training often relies on expensive, high-performance computing platforms, limiting accessibility for many tasks. Profiling of representative…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Tong Qiao , Ao Zhou , Yingjie Qi , Yiou Wang , Han Wan , Jianlei Yang , Chunming Hu

Precise and timely fault diagnosis is a prerequisite for a distribution system to ensure minimum downtime and maintain reliable operation. This necessitates access to a comprehensive procedure that can provide the grid operators with…

Artificial Intelligence · Computer Science 2024-09-11 Dibaloke Chanda , Nasim Yahya Soltani

Learning on text-attributed graphs has motivated the use of Large Language Models (LLMs) for graph learning. However, most fusion strategies are applied uniformly across all nodes and attain only small overall performance gains. We argue…

Machine Learning · Computer Science 2025-10-14 Donald Loveland , Yao-An Yang , Danai Koutra

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

Heterogeneous graph neural networks (HGNNs) deliver powerful capacity in heterogeneous graph representation learning. The execution of HGNNs is usually accelerated by GPUs. Therefore, characterizing and understanding the execution pattern…

Hardware Architecture · Computer Science 2022-08-10 Mingyu Yan , Mo Zou , Xiaocheng Yang , Wenming Li , Xiaochun Ye , Dongrui Fan , Yuan Xie

While graph heterophily has been extensively studied in recent years, a fundamental research question largely remains nascent: How and to what extent will graph heterophily affect the prediction performance of graph neural networks (GNNs)?…

Machine Learning · Computer Science 2023-06-27 Shuaicheng Zhang , Haohui Wang , Si Zhang , Dawei Zhou

Graph Neural Networks (GNNs) have been widely applied to various fields for learning over graph-structured data. They have shown significant improvements over traditional heuristic methods in various tasks such as node classification and…

Machine Learning · Computer Science 2022-06-10 Seongjun Yun , Seoyoon Kim , Junhyun Lee , Jaewoo Kang , Hyunwoo J. Kim

As the size of real-world graphs increases, training Graph Neural Networks (GNNs) has become time-consuming and requires acceleration. While previous works have demonstrated the potential of utilizing FPGA for accelerating GNN training, few…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-06 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Graph Neural Networks (GNNs) have shown exceptional performance in the task of link prediction. Despite their effectiveness, the high latency brought by non-trivial neighborhood data dependency limits GNNs in practical deployments.…

Machine Learning · Computer Science 2023-06-06 Zhichun Guo , William Shiao , Shichang Zhang , Yozen Liu , Nitesh V. Chawla , Neil Shah , Tong Zhao

Real-world networks and knowledge graphs are usually heterogeneous networks. Representation learning on heterogeneous networks is not only a popular but a pragmatic research field. The main challenge comes from the heterogeneity -- the…

Social and Information Networks · Computer Science 2021-02-17 Jie Zhang , Jinru Ding , Suyuan Liu , Hongyan Wu

Federated Graph Learning (FGL) aims to collaboratively and privately optimize graph models on divergent data for different tasks. A critical challenge in FGL is to enable effective yet efficient federated optimization against multifaceted…

Machine Learning · Computer Science 2024-11-05 Zhuoning Guo , Ruiqian Han , Hao Liu

Graph Neural Networks (GNNs) have demonstrated impressive performance in learning representations from graph-structured data. However, their message-passing mechanism inherently relies on the assumption of label consistency among connected…

Machine Learning · Computer Science 2026-04-28 Taihua Xu , Genhao Tian , Jicong Fan , Xibei Yang , Qinghua Zhang , Yun Cui

To bridge the gaps between topology-aware Graph Neural Networks (GNNs) and inference-efficient Multi-Layer Perceptron (MLPs), GLNN proposes to distill knowledge from a well-trained teacher GNN into a student MLP. Despite their great…

Machine Learning · Computer Science 2023-06-12 Lirong Wu , Haitao Lin , Yufei Huang , Stan Z. Li

Heterogeneous Graph Neural Network (HGNN) has been successfully employed in various tasks, but we cannot accurately know the importance of different design dimensions of HGNNs due to diverse architectures and applied scenarios. Besides, in…

Machine Learning · Computer Science 2022-05-16 Tianyu Zhao , Cheng Yang , Yibo Li , Quan Gan , Zhenyi Wang , Fengqi Liang , Huan Zhao , Yingxia Shao , Xiao Wang , Chuan Shi

Although the convolutional neural network (CNN) has achieved excellent performance in vision tasks by extracting the intra-sample representation, it will take a higher training expense because of stacking numerous convolutional layers.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Ziheng Jiao , Hongyuan Zhang , Xuelong Li

Graph Neural Networks (GNNs) have shown great success in many applications such as recommendation systems, molecular property prediction, traffic prediction, etc. Recently, CPU-FPGA heterogeneous platforms have been used to accelerate many…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-12-23 Yi-Chien Lin , Bingyi Zhang , Viktor Prasanna

Graph Neural Networks (GNN) have recently gained popularity in the forecasting domain due to their ability to model complex spatial and temporal patterns in tasks such as traffic forecasting and region-based demand forecasting. Most of…

Machine Learning · Computer Science 2023-12-08 Abishek Sriramulu , Nicolas Fourrier , Christoph Bergmeir