English
Related papers

Related papers: Position: Graph Foundation Models are Already Here

200 papers

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

Leveraging Graph Neural Networks (GNNs) as graph encoders and aligning the resulting representations with Large Language Models (LLMs) through alignment instruction tuning has become a mainstream paradigm for constructing Graph Language…

Machine Learning · Computer Science 2026-05-13 Haibo Chen , Xin Wang , Jiaheng Chao , Ling Feng , Wenwu Zhu

Graph Neural Networks (GNNs) are a powerful representational tool for solving problems on graph-structured inputs. In almost all cases so far, however, they have been applied to directly recovering a final solution from raw inputs, without…

Machine Learning · Statistics 2020-01-16 Petar Veličković , Rex Ying , Matilde Padovano , Raia Hadsell , Charles Blundell

Large language models (LLMs) have shown remarkable generalization capability with exceptional performance in various language modeling tasks. However, they still exhibit inherent limitations in precisely capturing and returning grounded…

Computation and Language · Computer Science 2024-01-01 Yijun Tian , Huan Song , Zichen Wang , Haozhu Wang , Ziqing Hu , Fang Wang , Nitesh V. Chawla , Panpan Xu

Graph Neural Networks (GNNs) have attracted considerable attention and have emerged as a new promising paradigm to process graph-structured data. GNNs are usually stacked to multiple layers and the node representations in each layer are…

Machine Learning · Computer Science 2020-09-25 Yihao Chen , Xin Tang , Xianbiao Qi , Chun-Guang Li , Rong Xiao

Atomistic materials modeling is a critical task with wide-ranging applications, from drug discovery to materials science, where accurate predictions of the target material property can lead to significant advancements in scientific…

Graph neural networks (GNNs) have been predominantly driven by message-passing, where node representations are iteratively updated via local neighborhood aggregation. Despite their success, message-passing suffers from fundamental…

Machine Learning · Computer Science 2025-12-16 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

Machine Learning · Computer Science 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational…

Machine Learning · Computer Science 2019-11-19 Ferran Alet , Adarsh K. Jeewajee , Maria Bauza , Alberto Rodriguez , Tomas Lozano-Perez , Leslie Pack Kaelbling

Graph learning has rapidly evolved into a critical subfield of machine learning and artificial intelligence (AI). Its development began with early graph-theoretic methods, gaining significant momentum with the advent of graph neural…

Machine Learning · Computer Science 2025-11-10 Feng Xia , Ciyuan Peng , Jing Ren , Falih Gozi Febrinanto , Renqiang Luo , Vidya Saikrishna , Shuo Yu , Xiangjie Kong

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

The significant increase in world population and urbanisation has brought several important challenges, in particular regarding the sustainability, maintenance and planning of urban mobility. At the same time, the exponential increase of…

Machine Learning · Computer Science 2021-04-28 João Rico , José Barateiro , Arlindo Oliveira

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Recent years have seen the vast potential of Graph Neural Networks (GNN) in many fields where data is structured as graphs (e.g., chemistry, recommender systems). In particular, GNNs are becoming increasingly popular in the field of…

Graph Neural Networks (GNN) have recently gained popularity in the forecasting domain due to their ability to model complex spatial and temporal patterns in tasks such as traffic forecasting and region-based demand forecasting. Most of…

Machine Learning · Computer Science 2023-12-08 Abishek Sriramulu , Nicolas Fourrier , Christoph Bergmeir

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

Deep neural networks have enabled researchers to create powerful generalized frameworks, such as transformers, that can be used to solve well-studied problems in various application domains, such as text and image. However, such generalized…

Machine Learning · Computer Science 2025-02-12 Rudrajit Dawn , Madhusudan Ghosh , Partha Basuchowdhuri , Sudip Kumar Naskar

Relational data present in real world graph representations demands for tools capable to study it accurately. In this regard Graph Neural Network (GNN) is a powerful tool, wherein various models for it have also been developed over the past…

Hardware Architecture · Computer Science 2021-03-22 Robert Guirado , Akshay Jain , Sergi Abadal , Eduard Alarcón

Graph Neural Networks (GNNs) have paved the way for being a cornerstone in graph-related learning tasks. Yet, the ability of GNNs to capture structural interactions within graphs remains under-explored. In this work, we address this gap by…

Machine Learning · Computer Science 2025-03-04 Asela Hevapathige , Qing Wang