English
Related papers

Related papers: Hierarchical graph neural nets can capture long-ra…

200 papers

Graph neural networks emerge as a promising modeling method for applications dealing with datasets that are best represented in the graph domain. In specific, developing recommendation systems often require addressing sparse structured data…

Machine Learning · Computer Science 2020-08-03 Dom Huh

Most Graph Neural Networks (GNNs) operate at the first-order scale, even though multi-scale representations are known to be crucial in domains such as image classification. In this work, we investigate whether GNNs can similarly benefit…

Machine Learning · Computer Science 2026-04-15 Qin Jiang , Chengjia Wang , Michael Lones , Dongdong Chen , Wei Pang

Message-passing graph neural networks (GNNs) excel at capturing local relationships but struggle with long-range dependencies in graphs. In contrast, graph transformers (GTs) enable global information exchange but often oversimplify the…

Machine Learning · Computer Science 2024-10-08 Dexiong Chen , Till Hendrik Schulz , Karsten Borgwardt

We present a hierarchical neural message passing architecture for learning on molecular graphs. Our model takes in two complementary graph representations: the raw molecular graph representation and its associated junction tree, where nodes…

Machine Learning · Computer Science 2020-06-23 Matthias Fey , Jan-Gin Yuen , Frank Weichert

Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer. In principle, such networks are not able to capture…

Machine Learning · Computer Science 2023-11-29 Vijay Prakash Dwivedi , Ladislav Rampášek , Mikhail Galkin , Ali Parviz , Guy Wolf , Anh Tuan Luu , Dominique Beaini

The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classification has gradually…

Computation and Language · Computer Science 2022-09-16 Shuai Hua , Xinxin Li , Yunpeng Jing , Qunfeng Liu

Hypergraphs provide an effective modeling approach for modeling high-order relationships in many real-world datasets. To capture such complex relationships, several hypergraph neural networks have been proposed for learning hypergraph…

Machine Learning · Computer Science 2024-04-08 Rongping Ye , Xiaobing Pei , Haoran Yang , Ruiqi Wang

Graph neural networks (GNNs) are typically applied to static graphs that are assumed to be known upfront. This static input structure is often informed purely by insight of the machine learning practitioner, and might not be optimal for the…

Recently, implicit graph neural networks (GNNs) have been proposed to capture long-range dependencies in underlying graphs. In this paper, we introduce and justify two weaknesses of implicit GNNs: the constrained expressiveness due to their…

Machine Learning · Computer Science 2022-10-18 Juncheng Liu , Bryan Hooi , Kenji Kawaguchi , Xiaokui Xiao

Most of the current hypergraph learning methodologies and benchmarking datasets in the hypergraph realm are obtained by lifting procedures from their graph analogs, leading to overshadowing specific characteristics of hypergraphs. This…

Artificial Intelligence · Computer Science 2025-03-19 Lev Telyatnikov , Maria Sofia Bucarelli , Guillermo Bernardez , Olga Zaghen , Simone Scardapane , Pietro Lio

Graph Neural Networks (GNNs) draw their strength from explicitly modeling the topological information of structured data. However, existing GNNs suffer from limited capability in capturing the hierarchical graph representation which plays…

Machine Learning · Computer Science 2021-03-30 Jinyu Yang , Peilin Zhao , Yu Rong , Chaochao Yan , Chunyuan Li , Hehuan Ma , Junzhou Huang

Many popular variants of graph neural networks (GNNs) that are capable of handling multi-relational graphs may suffer from vanishing gradients. In this work, we propose a novel GNN architecture based on the Gated Graph Neural Network with…

Machine Learning · Computer Science 2020-07-21 Denis Lukovnikov , Jens Lehmann , Asja Fischer

Heterogeneous graph is a kind of data structure widely existing in real life. Nowadays, the research of graph neural network on heterogeneous graph has become more and more popular. The existing heterogeneous graph neural network algorithms…

Artificial Intelligence · Computer Science 2021-06-28 Xinliang Wu , Mengying Jiang , Guizhong Liu

With many frameworks based on message passing neural networks proposed to predict molecular and bulk properties, machine learning methods have tremendously shifted the paradigms of computational sciences underpinning physics, material…

Machine Learning · Computer Science 2021-09-03 Zun Wang , Chong Wang , Sibo Zhao , Yong Xu , Shaogang Hao , Chang Yu Hsieh , Bing-Lin Gu , Wenhui Duan

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

Many real-world graphs (networks) are heterogeneous with different types of nodes and edges. Heterogeneous graph embedding, aiming at learning the low-dimensional node representations of a heterogeneous graph, is vital for various…

Social and Information Networks · Computer Science 2021-12-15 Wentao Xu , Yingce Xia , Weiqing Liu , Jiang Bian , Jian Yin , Tie-Yan Liu

Heterogeneous graph learning aims to capture complex relationships and diverse relational semantics among entities in a heterogeneous graph to obtain meaningful representations for nodes and edges. Recent advancements in heterogeneous graph…

Computation and Language · Computer Science 2024-05-21 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Long Xia , Dawei Yin , Chao Huang

Recent studies have highlighted the limitations of message-passing based graph neural networks (GNNs), e.g., limited model expressiveness, over-smoothing, over-squashing, etc. To alleviate these issues, Graph Transformers (GTs) have been…

Machine Learning · Computer Science 2023-03-06 Qiheng Mao , Zemin Liu , Chenghao Liu , Jianling Sun

Social and information networks are gaining huge popularity recently due to their various applications. Knowledge representation through graphs in the form of nodes and edges should preserve as many characteristics of the original data as…

Machine Learning · Computer Science 2021-02-08 Rucha Bhalchandra Joshi , Subhankar Mishra