English
Related papers

Related papers: Graph Highway Networks

200 papers

Current Graph Neural Networks (GNNs) suffer from the over-smoothing problem, which results in indistinguishable node representations and low model performance with more GNN layers. Many methods have been put forward to tackle this problem…

Machine Learning · Computer Science 2022-10-25 Xinshun Feng , Herun Wan , Shangbin Feng , Hongrui Wang , Jun Zhou , Qinghua Zheng , Minnan Luo

This paper presents HGEN that pioneers ensemble learning for heterogeneous graphs. We argue that the heterogeneity in node types, nodal features, and local neighborhood topology poses significant challenges for ensemble learning,…

Machine Learning · Computer Science 2026-02-05 Jiajun Shen , Yufei Jin , Yi He , Xingquan Zhu

Graph Convolutional Network (GCN) are widely used in Graph Anomaly Detection (GAD) due to their natural compatibility with graph structures, resulting in significant performance improvements. However, most researchers approach GAD as a…

Machine Learning · Computer Science 2024-11-05 Shelei Li , Yong Chai Tan , Tai Vincent

Most graph neural networks (GNNs) use the message passing paradigm, in which node features are propagated on the input graph. Recent works pointed to the distortion of information flowing from distant nodes as a factor limiting the…

Multi-view data containing complementary and consensus information can facilitate representation learning by exploiting the intact integration of multi-view features. Because most objects in real world often have underlying connections,…

Machine Learning · Computer Science 2023-08-15 Zhaoliang Chen , Lele Fu , Shunxin Xiao , Shiping Wang , Claudia Plant , Wenzhong Guo

Modern neural networks have shown promise for solving partial differential equations over surfaces, often by discretizing the surface as a mesh and learning with a mesh-aware graph neural network. However, graph neural networks suffer from…

Machine Learning · Computer Science 2026-05-13 Edward Berman , Luisa Li , Jung Yeon Park , Robin Walters

Graph convolution networks (GCNs) are currently mainstream in learning with irregular data. These models rely on message passing and attention mechanisms that capture context and node-to-node relationships. With multi-head attention, GCNs…

Machine Learning · Computer Science 2022-03-28 Hichem Sahbi

Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not optimal for…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Bo Jiang , Ziyan Zhang , Doudou Lin , Jin Tang

Node representation learning by using Graph Neural Networks (GNNs) has been widely explored. However, in recent years, compelling evidence has revealed that GNN-based node representation learning can be substantially deteriorated by…

Machine Learning · Computer Science 2023-12-19 Jun Zhuang , Mohammad Al Hasan

There has been tremendous success in the field of graph neural networks (GNNs) as a result of the development of the message-passing (MP) layer, which updates the representation of a node by combining it with its neighbors to address…

Machine Learning · Computer Science 2022-02-11 Hyeokjin Kwon , Jong-Min Lee

Existing approaches for graph neural networks commonly suffer from the oversmoothing issue, regardless of how neighborhoods are aggregated. Most methods also focus on transductive scenarios for fixed graphs, leading to poor generalization…

Machine Learning · Computer Science 2020-06-25 Kyuyong Shin , Wonyoung Shin , Jung-Woo Ha , Sunyoung Kwon

Hypergraphs, with their capacity to depict high-order relationships, have emerged as a significant extension of traditional graphs. Although Graph Neural Networks (GNNs) have remarkable performance in graph representation learning, their…

Machine Learning · Computer Science 2024-11-07 Khaled Mohammed Saifuddin , Mehmet Emin Aktas , Esra Akbas

Heterogeneous graph neural networks (HGNNs) have attracted increasing research interest in recent three years. Most existing HGNNs fall into two classes. One class is meta-path-based HGNNs which either require domain knowledge to handcraft…

Machine Learning · Computer Science 2022-09-02 Nan Wu , Chaofan Wang

Graph Neural Networks (GNNs) have achieved promising performance on a wide range of graph-based tasks. Despite their success, one severe limitation of GNNs is the over-smoothing issue (indistinguishable representations of nodes in different…

Machine Learning · Computer Science 2019-11-19 Deli Chen , Yankai Lin , Wei Li , Peng Li , Jie Zhou , Xu Sun

Graph neural networks (GNNs) have demonstrated excellent performance in semi-supervised node classification tasks. Despite this, two primary challenges persist: heterogeneity and heterophily. Each of these two challenges can significantly…

Machine Learning · Computer Science 2025-04-14 Kangkang Lu , Yanhua Yu , Zhiyong Huang , Yunshan Ma , Xiao Wang , Meiyu Liang , Yuling Wang , Yimeng Ren , Tat-Seng Chua

Graph Neural Networks (GNNs) show strong expressive power on graph data mining, by aggregating information from neighbors and using the integrated representation in the downstream tasks. The same aggregation methods and parameters for each…

Machine Learning · Computer Science 2022-03-22 Xiaojun Ma , Qin Chen , Yuanyi Ren , Guojie Song , Liang Wang

Graph Convolutional Network (GCN) has achieved extraordinary success in learning effective task-specific representations of nodes in graphs. However, regarding Heterogeneous Information Network (HIN), existing HIN-oriented GCN methods still…

Machine Learning · Computer Science 2021-09-09 Yaming Yang , Ziyu Guan , Jianxin Li , Wei Zhao , Jiangtao Cui , Quan Wang

As much as Graph Convolutional Networks (GCNs) have shown tremendous success in recommender systems and collaborative filtering (CF), the mechanism of how they, especially the core components (\textit{i.e.,} neighborhood aggregation)…

Information Retrieval · Computer Science 2022-04-26 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

Graph neural networks (GNNs) rely mainly on the message-passing paradigm to propagate node features and build interactions, and different graph learning problems require different ranges of node interactions. In this work, we explore the…

Machine Learning · Computer Science 2026-01-08 Fang Wu , Siyuan Li , Stan Z. Li

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen