English
Related papers

Related papers: Multi-Level Attention Pooling for Graph Neural Net…

200 papers

There has been significant progress in improving the performance of graph neural networks (GNNs) through enhancements in graph data, model architecture design, and training strategies. For fairness in graphs, recent studies achieve fair…

Machine Learning · Computer Science 2023-12-20 Zhimeng Jiang , Xiaotian Han , Chao Fan , Zirui Liu , Na Zou , Ali Mostafavi , Xia Hu

Graph neural networks (GNNs) are important tools for transductive learning tasks, such as node classification in graphs, due to their expressive power in capturing complex interdependency between nodes. To enable graph neural network…

Machine Learning · Computer Science 2022-05-17 Man Wu , Shirui Pan , Lan Du , Xingquan Zhu

Graph pooling is a central component of a myriad of graph neural network (GNN) architectures. As an inheritance from traditional CNNs, most approaches formulate graph pooling as a cluster assignment problem, extending the idea of local…

Machine Learning · Computer Science 2020-10-23 Diego Mesquita , Amauri H. Souza , Samuel Kaski

Graph-structured data consisting of objects (i.e., nodes) and relationships among objects (i.e., edges) are ubiquitous. Graph-level learning is a matter of studying a collection of graphs instead of a single graph. Traditional graph-level…

Machine Learning · Computer Science 2022-06-01 Ge Zhang , Jia Wu , Jian Yang , Shan Xue , Wenbin Hu , Chuan Zhou , Hao Peng , Quan Z. Sheng , Charu Aggarwal

Graph Neural Networks (GNNs) have achieved state-of-the-art results on many graph analysis tasks such as node classification and link prediction. However, important unsupervised problems on graphs, such as graph clustering, have proved more…

Machine Learning · Computer Science 2023-06-02 Anton Tsitsulin , John Palowitch , Bryan Perozzi , Emmanuel Müller

In terms of accuracy, Graph Neural Networks (GNNs) are the best architectural choice for the node classification task. Their drawback in real-world deployment is the latency that emerges from the neighbourhood processing operation. One…

Machine Learning · Computer Science 2024-11-22 Pavel Rumiantsev , Mark Coates

Graph neural architecture search has sparked much attention as Graph Neural Networks (GNNs) have shown powerful reasoning capability in many relational tasks. However, the currently used graph search space overemphasizes learning node…

Machine Learning · Computer Science 2022-06-01 Shaofei Cai , Liang Li , Xinzhe Han , Jiebo Luo , Zheng-Jun Zha , Qingming Huang

Graph Neural Networks have become one of the indispensable tools to learn from graph-structured data, and their usefulness has been shown in wide variety of tasks. In recent years, there have been tremendous improvements in architecture…

Machine Learning · Statistics 2021-11-15 Sunil Kumar Maurya , Xin Liu , Tsuyoshi Murata

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

The application of deep learning to symbolic domains remains an active research endeavour. Graph neural networks (GNN), consisting of trained neural modules which can be arranged in different topologies at run time, are sound alternatives…

Social and Information Networks · Computer Science 2019-12-02 Pedro H. C. Avelar , Henrique Lemos , Marcelo O. R. Prates , Luis Lamb

We aim to better understand attention over nodes in graph neural networks (GNNs) and identify factors influencing its effectiveness. We particularly focus on the ability of attention GNNs to generalize to larger, more complex or noisy…

Machine Learning · Computer Science 2019-10-29 Boris Knyazev , Graham W. Taylor , Mohamed R. Amer

In many important graph data processing applications the acquired information includes both node features and observations of the graph topology. Graph neural networks (GNNs) are designed to exploit both sources of evidence but they do not…

Machine Learning · Computer Science 2021-10-28 Eli Chien , Jianhao Peng , Pan Li , Olgica Milenkovic

We address a largely open problem of multilabel classification over graphs. Unlike traditional vector input, a graph has rich variable-size substructures which are related to the labels in some ways. We believe that uncovering these…

Machine Learning · Computer Science 2018-04-12 Kien Do , Truyen Tran , Thin Nguyen , Svetha Venkatesh

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs. In this project we study hierarchical message passing models that leverage a…

Machine Learning · Computer Science 2021-08-17 Ladislav Rampášek , Guy Wolf

Most Graph Neural Networks (GNNs) propagate messages by treating node embeddings as holistic feature vectors, implicitly assuming uniform relevance across feature dimensions. This limits their ability to selectively transmit informative…

Machine Learning · Computer Science 2025-12-24 Longlong Li , Mengyang Zhao , Guanghui Wang , Cunquan Qu

The attention mechanism enables graph neural networks (GNNs) to learn the attention weights between the target node and its one-hop neighbors, thereby improving the performance further. However, most existing GNNs are oriented toward…

Machine Learning · Computer Science 2022-06-24 Yundong Sun , Dongjie Zhu , Haiwen Du , Zhaoshuo Tian

Graph neural networks (GNNs) have emerged as powerful tools for learning protein structures by capturing spatial relationships at the residue level. However, existing GNN-based methods often face challenges in learning multiscale…

Machine Learning · Computer Science 2026-02-03 Shih-Hsin Wang , Yuhao Huang , Taos Transue , Justin Baker , Jonathan Forstater , Thomas Strohmer , Bao Wang

Message Passing Neural Networks (MPNNs) hold a key position in machine learning on graphs, but they struggle with unintended behaviors, such as over-smoothing and over-squashing, due to irregular data structures. The observation and…

Machine Learning · Computer Science 2025-08-26 Junhyun Lee , Veronika Thost , Bumsoo Kim , Jaewoo Kang , Tengfei Ma

Graph Neural Networks (GNNs) are widely adopted in advanced AI systems due to their capability of representation learning on graph data. Even though GNN explanation is crucial to increase user trust in the systems, it is challenging due to…

Machine Learning · Computer Science 2022-08-08 Tien-Cuong Bui , Wen-syan Li , Sang-Kyun Cha

Graph neural networks have attracted wide attentions to enable representation learning of graph data in recent works. In complement to graph convolution operators, graph pooling is crucial for extracting hierarchical representation of graph…

Machine Learning · Computer Science 2020-06-22 Xing Gao , Wenrui Dai , Chenglin Li , Hongkai Xiong , Pascal Frossard