English
Related papers

Related papers: Pathfinder Discovery Networks for Neural Message P…

200 papers

Message passing plays a vital role in graph neural networks (GNNs) for effective feature learning. However, the over-reliance on input topology diminishes the efficacy of message passing and restricts the ability of GNNs. Despite efforts to…

Machine Learning · Computer Science 2024-12-03 Junshu Sun , Chenxue Yang , Xiangyang Ji , Qingming Huang , Shuhui Wang

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

Modelling long-range dependencies is critical for scene understanding tasks in computer vision. Although CNNs have excelled in many vision tasks, they are still limited in capturing long-range structured relationships as they typically…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Li Zhang , Dan Xu , Anurag Arnab , Philip H. S. Torr

By leveraging recent progress of stochastic gradient descent methods, several works have shown that graphs could be efficiently laid out through the optimization of a tailored objective function. In the meantime, Deep Learning (DL)…

Machine Learning · Computer Science 2021-08-11 Loann Giovannangeli , Frederic Lalanne , David Auber , Romain Giot , Romain Bourqui

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Graph Neural Networks (GNNs) have received much attention in the graph deep learning domain. However, recent research empirically and theoretically shows that deep GNNs suffer from over-fitting and over-smoothing problems. The usual…

Machine Learning · Computer Science 2022-09-05 Chuxiong Sun , Jie Hu , Hongming Gu , Jinpeng Chen , Mingchuan Yang

Most existing graph neural networks (GNNs) learn node embeddings using the framework of message passing and aggregation. Such GNNs are incapable of learning relative positions between graph nodes within a graph. To empower GNNs with the…

Machine Learning · Computer Science 2024-11-05 Zhenyue Qin , Yiqun Zhang Saeed Anwar , Dongwoo Kim , Yang Liu , Pan Ji , Tom Gedeon

Graph Neural Networks (GNNs) are key tools for graph representation learning, demonstrating strong results across diverse prediction tasks. In this paper, we present Convexified Message-Passing Graph Neural Networks (CGNNs), a novel and…

Machine Learning · Computer Science 2026-01-27 Saar Cohen , Noa Agmon , Uri Shaham

Message passing neural networks (MPNNs) have emerged as go-to models for learning on graph-structured data in the past decade. Despite their effectiveness, most of such models still incur severe issues such as over-smoothing and…

Machine Learning · Computer Science 2025-11-26 Haoran Zheng , Renchi Yang , Yubo Zhou , Jianliang Xu

Graph Neural Networks (GNNs) typically operate by message-passing, where the state of a node is updated based on the information received from its neighbours. Most message-passing models act as graph convolutions, where features are mixed…

Lots of learning tasks require dealing with graph data which contains rich relation information among elements. Modeling physics systems, learning molecular fingerprints, predicting protein interface, and classifying diseases demand a model…

Machine Learning · Computer Science 2021-10-07 Jie Zhou , Ganqu Cui , Shengding Hu , Zhengyan Zhang , Cheng Yang , Zhiyuan Liu , Lifeng Wang , Changcheng Li , Maosong Sun

Graph Neural Networks (GNNs) have shown to be powerful tools for graph analytics. The key idea is to recursively propagate and aggregate information along edges of the given graph. Despite their success, however, the existing GNNs are…

Machine Learning · Computer Science 2020-11-16 Dongsheng Luo , Wei Cheng , Wenchao Yu , Bo Zong , Jingchao Ni , Haifeng Chen , Xiang Zhang

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

Graph Drawing techniques have been developed in the last few years with the purpose of producing aesthetically pleasing node-link layouts. Recently, the employment of differentiable loss functions has paved the road to the massive usage of…

Machine Learning · Computer Science 2022-07-04 Matteo Tiezzi , Gabriele Ciravegna , Marco Gori

Graph neural networks (GNNs) aim to learn well-trained representations in a lower-dimension space for downstream tasks while preserving the topological structures. In recent years, attention mechanism, which is brilliant in the fields of…

Social and Information Networks · Computer Science 2026-05-12 Chengcheng Sun , Chenhao Li , Xiang Lin , Tianji Zheng , Fanrong Meng , Xiaobin Rui , Zhixiao Wang

We propose Graph Tree Networks (GTNets), a deep graph learning architecture with a new general message passing scheme that originates from the tree representation of graphs. In the tree representation, messages propagate upward from the…

Machine Learning · Computer Science 2022-04-28 Nan Wu , Chaofan Wang

Graph neural networks (GNNs) is widely used to learn a powerful representation of graph-structured data. Recent work demonstrates that transferring knowledge from self-supervised tasks to downstream tasks could further improve graph…

Machine Learning · Computer Science 2021-07-21 Xueting Han , Zhenhuan Huang , Bang An , Jing Bai

Strategies to improve the predicting performance of Message-Passing Neural-Networks for molecular property predictions can be achieved by simplifying how the message is passed and by using descriptors that capture multiple aspects of…

Machine Learning · Computer Science 2025-10-22 Alma C. Castaneda-Leautaud , Rommie E. Amaro

Graph neural networks (GNNs) have attracted much attention because of their excellent performance on tasks such as node classification. However, there is inadequate understanding on how and why GNNs work, especially for node representation…

Machine Learning · Computer Science 2020-06-09 Guoji Fu , Yifan Hou , Jian Zhang , Kaili Ma , Barakeel Fanseu Kamhoua , James Cheng

We propose Scalable Message Passing Neural Networks (SMPNNs) and demonstrate that, by integrating standard convolutional message passing into a Pre-Layer Normalization Transformer-style block instead of attention, we can produce…

Machine Learning · Computer Science 2026-03-11 Haitz Sáez de Ocáriz Borde , Artem Lukoianov , Anastasis Kratsios , Michael Bronstein , Xiaowen Dong