English
Related papers

Related papers: Preventing Over-Smoothing for Hypergraph Neural Ne…

200 papers

Graph Convolutional Networks (GCN) with multi-hop aggregation is more expressive than one-hop GCN but suffers from higher model complexity. Finding the shortest aggregation range that achieves comparable expressiveness and minimizes this…

Machine Learning · Computer Science 2021-10-15 Peihao Wang , Yuehao Wang , Hua Lin , Jianbo Shi

Many real-world interactions are group-based rather than pairwise such as papers with multiple co-authors and users jointly engaging with items. Hypergraph neural networks have shown great promise at modeling higher-order relations, but…

Machine Learning · Computer Science 2025-08-14 Xiaoyu Li , Guangyu Tang , Jiaojiao Jiang

Graph convolution networks have recently garnered a lot of attention for representation learning on non-Euclidean feature spaces. Recent research has focused on stacking multiple layers like in convolutional neural networks for the…

Machine Learning · Computer Science 2021-05-05 Rangan Das , Bikram Boote , Saumik Bhattacharya , Ujjwal Maulik

Message passing has evolved as an effective tool for designing Graph Neural Networks (GNNs). However, most existing methods for message passing simply sum or average all the neighboring features to update node representations. They are…

Machine Learning · Computer Science 2022-06-17 Rui Yang , Wenrui Dai , Chenglin Li , Junni Zou , Hongkai Xiong

Heterogeneous graph neural networks (HGNNs) have demonstrated their superiority in exploiting auxiliary information for recommendation tasks. However, graphs constructed using meta-paths in HGNNs are usually too dense and contain a large…

Information Retrieval · Computer Science 2025-06-02 Lei Sang , Yu Wang , Yiwen Zhang

Graph Neural Networks (GNNs) are well-suited for learning on homophilous graphs, i.e., graphs in which edges tend to connect nodes of the same type. Yet, achievement of consistent GNN performance on heterophilous graphs remains an open…

Machine Learning · Computer Science 2023-08-30 Andrea Cavallo , Claas Grohnfeldt , Michele Russo , Giulio Lovisotto , Luca Vassio

With the tremendous success of Graph Convolutional Networks (GCNs), they have been widely applied to recommender systems and have shown promising performance. However, most GCN-based methods rigorously stick to a common GCN learning…

Information Retrieval · Computer Science 2022-09-07 Shaowen Peng , Kazunari Sugiyama , Tsunenori Mine

User-item interaction data in collaborative filtering and graph modeling tasks often exhibit power-law characteristics, which suggest the suitability of hyperbolic space modeling. Hyperbolic Graph Convolution Neural Networks (HGCNs) are a…

Information Retrieval · Computer Science 2024-12-13 Lu Zhang , Ning Wu

Graph Neural Network (GNN) achieves great success for node-level and graph-level tasks via encoding meaningful topological structures of networks in various domains, ranging from social to biological networks. However, repeated aggregation…

Machine Learning · Computer Science 2025-08-26 Tanvir Hossain , Khaled Mohammed Saifuddin , Muhammad Ifte Khairul Islam , Farhan Tanvir , Esra Akbas

Oversmoothing in Graph Neural Networks (GNNs) poses a significant challenge as network depth increases, leading to homogenized node representations and a loss of expressiveness. In this work, we approach the oversmoothing problem from a…

Machine Learning · Computer Science 2024-12-11 Biswadeep Chakraborty , Harshit Kumar , Saibal Mukhopadhyay

Heterogeneous Graph Neural Networks (HGNNs) have exhibited powerful performance in heterogeneous graph learning by aggregating information from various types of nodes and edges. However, existing heterogeneous graph models often struggle to…

Machine Learning · Computer Science 2025-09-30 Ranhui Yan , Jia cai

Hypergraphs offer a generalized framework for capturing high-order relationships between entities and have been widely applied in various domains, including healthcare, social networks, and bioinformatics. Hypergraph neural networks, which…

Machine Learning · Computer Science 2025-12-03 Akash Choudhuri , Yongjian Zhong , Bijaya Adhikari

In the graph domain, deep graph networks based on Message Passing Neural Networks (MPNNs) or Graph Transformers often cause over-smoothing of node features, limiting their expressive capacity. Many upsampling techniques involving node and…

Machine Learning · Computer Science 2026-02-03 Xiaotang Wang , Yun Zhu , Haizhou Shi , Yongchao Liu , Yongqi Zhang

Molecular interactions often involve high-order relationships that cannot be fully captured by traditional graph-based models limited to pairwise connections. Hypergraphs naturally extend graphs by enabling multi-way interactions, making…

Machine Learning · Computer Science 2025-05-12 Tien Dang , Truong-Son Hy

Graph Convolutional Networks (GCNs) are widely used to improve recommendation accuracy and performance by effectively learning the representations of user and item nodes. However, two major challenges remain: (1) the lack of further…

Information Retrieval · Computer Science 2025-05-15 Tao Huang , Yihong Chen , Wei Fan , Wei Zhou , Junhao Wen

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Spectral Graph Neural Networks (GNNs), alternatively known as graph filters, have gained increasing prevalence for heterophily graphs. Optimal graph filters rely on Laplacian eigendecomposition for Fourier transform. In an attempt to avert…

Machine Learning · Computer Science 2024-05-22 Keke Huang , Yu Guang Wang , Ming Li , and Pietro Liò

Modern neural networks have shown promise for solving partial differential equations over surfaces, often by discretizing the surface as a mesh and learning with a mesh-aware graph neural network. However, graph neural networks suffer from…

Machine Learning · Computer Science 2026-05-13 Edward Berman , Luisa Li , Jung Yeon Park , Robin Walters

Hypergraph Neural networks (HyperGNNs) and hypergraph signal denoising (HyperGSD) are two fundamental topics in higher-order network modeling. Understanding the connection between these two domains is particularly useful for designing novel…

Machine Learning · Computer Science 2023-09-18 Fuli Wang , Karelia Pena-Pena , Wei Qian , Gonzalo R. Arce

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.e., manually…

Machine Learning · Computer Science 2024-05-08 Mingguo He , Zhewei Wei , Shikun Feng , Zhengjie Huang , Weibin Li , Yu Sun , Dianhai Yu