English
Related papers

Related papers: Billion-Scale Graph Foundation Models

200 papers

Graph neural networks (GNNs) leverage the connectivity and structure of real-world graphs to learn intricate properties and relationships between nodes. Many real-world graphs exceed the memory capacity of a GPU due to their sheer size, and…

Machine Learning · Computer Science 2025-10-30 Aditya K. Ranjan , Siddharth Singh , Cunyang Wei , Abhinav Bhatele

Efficient traffic management is crucial for maintaining urban mobility, especially in densely populated areas where congestion, accidents, and delays can lead to frustrating and expensive commutes. However, existing prediction methods face…

Machine Learning · Computer Science 2023-05-25 Xuhong Wang , Ding Wang , Liang Chen , Yilun Lin

Graph Neural Network (GNN) research is rapidly growing thanks to the capacity of GNNs in learning distributed representations from graph-structured data. However, centralizing a massive amount of real-world graph data for GNN training is…

Large language models (LLMs) excel at complex reasoning but remain limited by static and incomplete parametric knowledge. Retrieval-augmented generation (RAG) mitigates this by incorporating external knowledge, yet existing RAGs struggle…

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Recent advancements in graph learning have revolutionized the way to understand and analyze data with complex structures. Notably, Graph Neural Networks (GNNs), i.e. neural network architectures designed for learning graph representations,…

Machine Learning · Computer Science 2024-07-09 Yu Huang , Min Zhou , Menglin Yang , Zhen Wang , Muhan Zhang , Jie Wang , Hong Xie , Hao Wang , Defu Lian , Enhong Chen

Graph machine learning has gained great attention in both academia and industry recently. Most of the graph machine learning models, such as Graph Neural Networks (GNNs), are trained over massive graph data. However, in many real-world…

Machine Learning · Computer Science 2022-10-19 Xingbo Fu , Binchi Zhang , Yushun Dong , Chen Chen , Jundong Li

Recent advances in graph machine learning have shifted to data-centric paradigms, driven by two emerging fields: (1) Federated graph learning (FGL) enables multi-client collaboration but faces challenges from data and task heterogeneity,…

Machine Learning · Computer Science 2025-11-17 Yinlin Zhu , Xunkai Li , Jishuo Jia , Miao Hu , Di Wu , Meikang Qiu

Graphs are a central representation in biomedical research, capturing molecular interaction networks, gene regulatory circuits, cell--cell communication maps, and knowledge graphs. Despite their importance, currently there is not a broadly…

Machine Learning · Computer Science 2026-04-09 Sakib Mostafa , Lei Xing , Md. Tauhidul Islam

Equivariant graph neural networks force fields (EGraFFs) have shown great promise in modelling complex interactions in atomic systems by exploiting the graphs' inherent symmetries. Recent works have led to a surge in the development of…

Graph neural networks (GNNs) excel in graph representation learning by integrating graph structure and node features. Existing GNNs, unfortunately, fail to account for the uncertainty of class probabilities that vary with the depth of the…

Machine Learning · Computer Science 2025-06-17 Qingfeng Chen , Shiyuan Li , Yixin Liu , Shirui Pan , Geoffrey I. Webb , Shichao Zhang

As AI workloads increase in scope, generalization capability becomes challenging for small task-specific models and their demand for large amounts of labeled training samples increases. On the contrary, Foundation Models (FMs) are trained…

Artificial Intelligence · Computer Science 2024-04-19 Aristeidis Tsaris , Philipe Ambrozio Dias , Abhishek Potnis , Junqi Yin , Feiyi Wang , Dalton Lunga

Foundation models have shown remarkable cross-domain generalization in language and vision, inspiring the development of graph foundation models (GFMs). However, existing GFMs typically assume centralized access to multi-domain graphs,…

Machine Learning · Computer Science 2025-10-10 Zhengyu Wu , Yinlin Zhu , Xunkai Li , Ziang Qiu , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Graph foundation models (GFMs) have recently attracted interest due to the promise of graph neural network (GNN) architectures that generalize zero-shot across graphs of arbitrary scales, feature dimensions, and domains. While existing work…

Machine Learning · Computer Science 2026-03-25 Benjamin Gutteridge , Michael Bronstein , Xiaowen Dong

While it is well-known and acknowledged that the performance of graph algorithms is heavily dependent on the input data, there has been surprisingly little research to quantify and predict the impact the graph structure has on performance.…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-04 Merijn Verstraaten , Ana Lucia Varbanescu , Cees de Laat

Combining multiple knowledge graphs (KGs) across linguistic boundaries is a persistent challenge due to semantic heterogeneity and the complexity of graph environments. We propose a framework for cross-lingual graph fusion, leveraging the…

Computation and Language · Computer Science 2026-03-24 Kaung Myat Kyaw , Khush Agarwal , Jonathan Chan

Graph neural networks (GNNs) are gaining increasing popularity as a promising approach to machine learning on graphs. Unlike traditional graph workloads where each vertex/edge is associated with a scalar, GNNs attach a feature tensor to…

Machine Learning · Computer Science 2020-09-30 Yuwei Hu , Zihao Ye , Minjie Wang , Jiali Yu , Da Zheng , Mu Li , Zheng Zhang , Zhiru Zhang , Yida Wang

The growing interests and applications of graph learning in diverse domains have propelled the development of a unified model generalizing well across different graphs and tasks, known as the Graph Foundation Model (GFM). Existing research…

Machine Learning · Computer Science 2025-06-17 Trung-Kien Nguyen , Heng Ping , Shixuan Li , Peiyu Zhang , Nikos Kanakaris , Nicholas Kotov , Paul Bogdan

The BFS algorithm is a basic graph data processing algorithm and many other graph data processing algorithms have similar architectural features with BFS algorithm and can be built on the basis of BFS algorithm model. We analyze the…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-30 Chenglong Zhang

In federated graph learning (FGL), a complete graph is divided into multiple subgraphs stored in each client due to privacy concerns, and all clients jointly train a global graph model by only transmitting model parameters. A pain point of…

Machine Learning · Computer Science 2025-03-26 Bo Yan , Zhongjian Zhang , Huabin Sun , Mengmei Zhang , Yang Cao , Chuan Shi