English
Related papers

Related papers: HINormer: Representation Learning On Heterogeneous…

200 papers

Recently, graph neural networks have shown the superiority of modeling the complex topological structures in heterogeneous network-based recommender systems. Due to the diverse interactions among nodes and abundant semantics emerging from…

Machine Learning · Computer Science 2022-08-04 Tiankai Gu , Chaokun Wang , Cheng Wu , Jingcao Xu , Yunkai Lou , Changping Wang , Kai Xu , Can Ye , Yang Song

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

Machine Learning · Computer Science 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

Factors such as the proliferation of renewable energy and electrification contribute to grid congestion as a pressing problem. Topology control is an appealing method for relieving congestion, but traditional approaches for topology…

Machine Learning · Computer Science 2025-10-06 Matthijs de Jong , Jan Viebahn , Yuliya Shapovalova

Heterogeneous information network (HIN) embedding, aiming to map the structure and semantic information in a HIN to distributed representations, has drawn considerable research attention. Graph neural networks for HIN embeddings typically…

Social and Information Networks · Computer Science 2020-07-07 Di Jin , Zhizhi Yu , Dongxiao He , Carl Yang , Philip S. Yu , Jiawei Han

In this paper, we focus on graph representation learning of heterogeneous information network (HIN), in which various types of vertices are connected by various types of relations. Most of the existing methods conducted on HIN revise…

Machine Learning · Computer Science 2019-12-24 Huiting Hong , Hantao Guo , Yucheng Lin , Xiaoqing Yang , Zang Li , Jieping Ye

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Graph Neural Networks (GNNs) have emerged as promising solutions for collaborative filtering (CF) through the modeling of user-item interaction graphs. The nucleus of existing GNN-based recommender systems involves recursive message passing…

Machine Learning · Computer Science 2024-05-21 Peiyan Zhang , Yuchen Yan , Xi Zhang , Chaozhuo Li , Senzhang Wang , Feiran Huang , Sunghun Kim

Graph transformers (GTs) have emerged as a promising architecture that is theoretically more expressive than message-passing graph neural networks (GNNs). However, typical GT models have at least quadratic complexity and thus cannot scale…

Machine Learning · Computer Science 2024-04-09 Chenhui Deng , Zichao Yue , Zhiru Zhang

Graph neural networks (GNNs) rely mainly on the message-passing paradigm to propagate node features and build interactions, and different graph learning problems require different ranges of node interactions. In this work, we explore the…

Machine Learning · Computer Science 2026-01-08 Fang Wu , Siyuan Li , Stan Z. Li

Hypergraphs as an expressive and general structure have attracted considerable attention from various research domains. Most existing hypergraph node representation learning techniques are based on graph neural networks, and thus adopt the…

Machine Learning · Computer Science 2023-12-04 Shilin Qu , Weiqing Wang , Yuan-Fang Li , Xin Zhou , Fajie Yuan

Heterophilic Graph Neural Networks (HGNNs) have shown promising results for semi-supervised learning tasks on graphs. Notably, most real-world heterophilic graphs are composed of a mixture of nodes with different neighbor patterns,…

Machine Learning · Computer Science 2025-02-26 Jinluan Yang , Zhengyu Chen , Teng Xiao , Wenqiao Zhang , Yong Lin , Kun Kuang

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen

Heterogeneous graph neural networks (HGNNs) have demonstrated strong capability in modeling complex semantics across multi-type nodes and relations. However, their scalability to large-scale graphs remains challenging due to structural…

Machine Learning · Computer Science 2025-12-12 Fuyan Ou , Siqi Ai , Yulin Hu

As more deep learning models are being applied in real-world applications, there is a growing need for modeling and learning the representations of neural networks themselves. An efficient representation can be used to predict target…

Machine Learning · Computer Science 2023-10-17 Yun Yi , Haokui Zhang , Rong Xiao , Nannan Wang , Xiaoyu Wang

Hypergraphs play a pivotal role in the modelling of data featuring higher-order relations involving more than two entities. Hypergraph neural networks emerge as a powerful tool for processing hypergraph-structured data, delivering…

Machine Learning · Computer Science 2024-06-04 Zexi Liu , Bohan Tang , Ziyuan Ye , Xiaowen Dong , Siheng Chen , Yanfeng Wang

Graph neural networks (GNNs) have shown significant success in learning graph representations. However, recent studies reveal that GNNs often fail to outperform simple MLPs on heterophilous graph tasks, where connected nodes may differ in…

Machine Learning · Computer Science 2025-04-10 Songwei Zhao , Yuan Jiang , Zijing Zhang , Yang Yu , Hechang Chen

Heterogeneous graph representation learning aims to learn low-dimensional vector representations of different types of entities and relations to empower downstream tasks. Existing methods either capture semantic relationships but indirectly…

Machine Learning · Computer Science 2025-08-14 Hao Xu , Shengqi Sang , Peizhen Bai , Laurence Yang , Haiping Lu

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

With the ubiquitous graph-structured data in various applications, models that can learn compact but expressive vector representations of nodes have become highly desirable. Recently, bearing the message passing paradigm, graph neural…

Social and Information Networks · Computer Science 2021-04-13 Tong Chen , Hongzhi Yin , Jie Ren , Zi Huang , Xiangliang Zhang , Hao Wang

Graph convolution networks (GCNs) have been enormously successful in learning representations over several graph-based machine learning tasks. Specific to learning rich node representations, most of the methods have solely relied on the…

Machine Learning · Computer Science 2022-11-03 Ashish Tiwari , Sresth Tosniwal , Shanmuganathan Raman