English
Related papers

Related papers: Link Prediction with Untrained Message Passing Lay…

200 papers

Recently, machine learning, particularly message-passing graph neural networks (MPNNs), has gained traction in enhancing exact optimization algorithms. For example, MPNNs speed up solving mixed-integer optimization problems by imitating…

Machine Learning · Computer Science 2023-10-17 Chendi Qian , Didier Chételat , Christopher Morris

Neural Processes (NPs) are powerful and flexible models able to incorporate uncertainty when representing stochastic processes, while maintaining a linear time complexity. However, NPs produce a latent description by aggregating independent…

Machine Learning · Computer Science 2020-09-30 Ben Day , Cătălina Cangea , Arian R. Jamasb , Pietro Liò

Graph Neural Networks (GNNs), especially message-passing neural networks (MPNNs), have emerged as powerful architectures for learning on graphs in diverse applications. However, MPNNs face challenges when modeling non-local interactions in…

Machine Learning · Statistics 2024-01-31 Ilyes Batatia , Lars L. Schaaf , Huajie Chen , Gábor Csányi , Christoph Ortner , Felix A. Faber

A hallmark of graph neural networks is their ability to distinguish the isomorphism class of their inputs. This study derives hardness results for the classification variant of graph isomorphism in the message-passing model (MPNN). MPNN…

Machine Learning · Computer Science 2020-10-19 Andreas Loukas

The ability of message-passing neural networks (MPNNs) to fit complex functions over graphs is limited as most graph convolutions amplify the same signal across all feature channels, a phenomenon known as rank collapse, and over-smoothing…

Machine Learning · Computer Science 2024-12-10 Andreas Roth , Franka Bause , Nils M. Kriege , Thomas Liebig

Link prediction, which consists of predicting edges based on graph features, is a fundamental task in many graph applications. As for several related problems, Graph Neural Networks (GNNs), which are based on an attribute-centric…

Machine Learning · Computer Science 2023-05-24 Zexi Huang , Mert Kosan , Arlei Silva , Ambuj Singh

In recent studies, neural message passing has proved to be an effective way to design graph neural networks (GNNs), which have achieved state-of-the-art performance in many graph-based tasks. However, current neural-message passing…

Machine Learning · Computer Science 2021-04-21 Wentao Zhang , Yu Shen , Zheyu Lin , Yang Li , Xiaosen Li , Wen Ouyang , Yangyu Tao , Zhi Yang , Bin Cui

Graph Neural Networks (GNNs) have been widely used for various learning tasks, ranging from node classification to link prediction. They have demonstrated excellent performance in multiple domains involving graph-structured data. However,…

Machine Learning · Computer Science 2026-03-19 Steven E. Wilson , Sina Khanmohammadi

We study the problem of embedding edgeless nodes such as users who newly enter the underlying network, while using graph neural networks (GNNs) widely studied for effective representation learning of graphs. Our study is motivated by the…

Social and Information Networks · Computer Science 2022-11-01 Yong-Min Shin , Cong Tran , Won-Yong Shin , Xin Cao

Link prediction is a fundamental problem in graph data analysis. While most of the literature focuses on transductive link prediction that requires all the graph nodes and majority of links in training, inductive link prediction, which only…

Machine Learning · Computer Science 2021-10-01 Huidong Liang , Junbin Gao

It has been observed that message-passing graph neural networks (GNN) sometimes struggle to maintain a healthy balance between the efficient/scalable modeling of long-range dependencies across nodes while avoiding unintended consequences…

Machine Learning · Computer Science 2025-05-21 Yongyi Yang , Tang Liu , Yangkun Wang , Zengfeng Huang , David Wipf

In this study, we introduce a domain-decomposition-based distributed training and inference approach for message-passing neural networks (MPNN). Our objective is to address the challenge of scaling edge-based graph neural networks as the…

Machine Learning · Computer Science 2025-02-20 Priyesh Kakka , Sheel Nidhan , Rishikesh Ranade , Jay Pathak , Jonathan F. MacArt

Message passing neural networks have become a method of choice for learning on graphs, in particular the prediction of chemical properties and the acceleration of molecular dynamics studies. While they readily scale to large training data…

Machine Learning · Computer Science 2021-06-08 Kristof T. Schütt , Oliver T. Unke , Michael Gastegger

Graph neural networks (GNNs) are a class of deep models that operate on data with arbitrary topology represented as graphs. We introduce an efficient memory layer for GNNs that can jointly learn node representations and coarsen the graph.…

Machine Learning · Computer Science 2020-06-11 Amir Hosein Khasahmadi , Kaveh Hassani , Parsa Moradi , Leo Lee , Quaid Morris

Hypergraphs are vital in modelling data with higher-order relations containing more than two entities, gaining prominence in machine learning and signal processing. Many hypergraph neural networks leverage message passing over hypergraph…

Machine Learning · Computer Science 2025-08-09 Bohan Tang , Siheng Chen , Xiaowen Dong

Message Passing Neural Networks (MPNNs) are a common type of Graph Neural Network (GNN), in which each node's representation is computed recursively by aggregating representations (messages) from its immediate neighbors akin to a…

Machine Learning · Computer Science 2022-04-22 Lingxiao Zhao , Wei Jin , Leman Akoglu , Neil Shah

Modelling long-range dependencies is critical for scene understanding tasks in computer vision. Although convolution neural networks (CNNs) have excelled in many vision tasks, they are still limited in capturing long-range structured…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Li Zhang , Mohan Chen , Anurag Arnab , Xiangyang Xue , Philip H. S. Torr

Graph neural networks (GNNs) based on message passing between neighboring nodes are known to be insufficient for capturing long-range interactions in graphs. In this project we study hierarchical message passing models that leverage a…

Machine Learning · Computer Science 2021-08-17 Ladislav Rampášek , Guy Wolf

Graph kernels are historically the most widely-used technique for graph classification tasks. However, these methods suffer from limited performance because of the hand-crafted combinatorial features of graphs. In recent years, graph neural…

Machine Learning · Computer Science 2022-02-28 Aosong Feng , Chenyu You , Shiqiang Wang , Leandros Tassiulas

Message passing neural networks have recently evolved into a state-of-the-art approach to representation learning on graphs. Existing methods perform synchronous message passing along all edges in multiple subsequent rounds and consequently…

Machine Learning · Computer Science 2020-12-21 Julian Busch , Jiaxing Pi , Thomas Seidl