English
Related papers

Related papers: Towards Graph Foundation Models: Learning Generali…

200 papers

In recent years, large language models (LLMs) have emerged as promising candidates for graph tasks. Many studies leverage natural language to describe graphs and apply LLMs for reasoning, yet most focus narrowly on performance benchmarks…

Machine Learning · Computer Science 2026-01-28 Yuxiang Wang , Xinnan Dai , Wenqi Fan , Yao Ma

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph neural networks (GNNs) have achieved tremendous success on multiple graph-based learning tasks by fusing network structure and node features. Modern GNN models are built upon iterative aggregation of neighbor's/proximity features by…

Machine Learning · Computer Science 2021-06-15 Susheel Suresh , Vinith Budde , Jennifer Neville , Pan Li , Jianzhu Ma

Non-IID transfer learning on graphs is crucial in many high-stakes domains. The majority of existing works assume stationary distribution for both source and target domains. However, real-world graphs are intrinsically dynamic, presenting…

Machine Learning · Computer Science 2024-08-14 Haohui Wang , Yuzhen Mao , Yujun Yan , Yaoqing Yang , Jianhui Sun , Kevin Choi , Balaji Veeramani , Alison Hu , Edward Bowen , Tyler Cody , Dawei Zhou

Graph neural networks (GNNs) have become powerful tools for processing graph-based information in various domains. A desirable property of GNNs is transferability, where a trained network can swap in information from a different graph…

Machine Learning · Computer Science 2024-06-24 A. Martina Neuman , Jason J. Bramburger

Graph Neural Networks (GNNs) extend convolutional neural networks to operate on graphs. Despite their impressive performances in various graph learning tasks, the theoretical understanding of their generalization capability is still…

Machine Learning · Computer Science 2025-06-10 Zhiyang Wang , Juan Cervino , Alejandro Ribeiro

Recent empirical studies have explored the idea of continuing to train a model at test-time for a given task, known as test-time training (TTT), and have found it to yield significant performance improvements. However, there is limited…

Machine Learning · Computer Science 2026-02-10 Jonas Hübotter , Patrik Wolf , Alexander Shevchenko , Dennis Jüni , Andreas Krause , Gil Kur

Graph neural networks (GNNs) have brought revolutionary advancements to the field of link prediction (LP), providing powerful tools for mining potential relationships in graphs. However, existing methods face challenges when dealing with…

Machine Learning · Computer Science 2025-12-30 Huashen Lu , Wensheng Gan , Guoting Chen , Zhichao Huang , Philip S. Yu

Pre-training of neural networks has recently revolutionized the field of Natural Language Processing (NLP) and has before demonstrated its effectiveness in computer vision. At the same time, advances around the detection of fake news were…

Computation and Language · Computer Science 2024-02-29 Gregor Donabauer , Udo Kruschwitz

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

Machine Learning · Computer Science 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli

Graph neural networks (GNNs) have been demonstrated to achieve state-of-the-art for a number of graph-based learning tasks, which leads to a rise in their employment in various domains. However, it has been shown that GNNs may inherit and…

Machine Learning · Computer Science 2022-05-23 O. Deniz Kose , Yanning Shen

Although pretraining has garnered significant attention and popularity in recent years, its application in graph-based recommender systems is relatively limited. It is challenging to exploit prior knowledge by pretraining in widely used…

Information Retrieval · Computer Science 2023-10-23 Mingdai Yang , Zhiwei Liu , Liangwei Yang , Xiaolong Liu , Chen Wang , Hao Peng , Philip S. Yu

Graphs provide a natural representation of relational structure that arises across diverse domains. Despite this ubiquity, graph structure is typically learned in a modality- and task-isolated manner, where graph representations are…

Machine Learning · Computer Science 2026-05-27 Ziming Li , Xiaoming Wu , Zehong Wang , Jiazheng Li , Yijun Tian , Jinhe Bi , Yunpu Ma , Yanfang Ye , Chuxu Zhang

Analytical hardware performance models yield swift estimation of desired hardware performance metrics. However, developing these analytical models for modern processors with sophisticated microarchitectures is an extremely laborious task…

Machine Learning · Computer Science 2022-10-12 Ondrej Sykora , Phitchaya Mangpo Phothilimthana , Charith Mendis , Amir Yazdanbakhsh

Hypergraph neural networks have been promising tools for handling learning tasks involving higher-order data, with notable applications in web graphs, such as modeling multi-way hyperlink structures and complex user interactions. Yet, their…

Machine Learning · Computer Science 2025-01-28 Yifan Wang , Gonzalo R. Arce , Guangmo Tong

Recently, graph neural networks (GNNs) have proved to be suitable in tasks on unstructured data. Particularly in tasks as community detection, node classification, and link prediction. However, most GNN models still operate with static…

Machine Learning · Computer Science 2019-06-07 Darwin Saire Pilco , Adín Ramírez Rivera

Graph learning tasks often hinge on identifying key substructure patterns -- such as triadic closures in social networks or benzene rings in molecular graphs -- that underpin downstream performance. However, most existing graph neural…

Machine Learning · Computer Science 2025-05-27 Zehong Wang , Zheyuan Zhang , Tianyi Ma , Nitesh V Chawla , Chuxu Zhang , Yanfang Ye

Graph Neural Networks (GNNs) have attracted increasing attention in recent years and have achieved excellent performance in semi-supervised node classification tasks. The success of most GNNs relies on one fundamental assumption, i.e., the…

Machine Learning · Computer Science 2024-12-03 Junchao Lin , Yuan Wan , Jingwen Xu , Xingchen Qi

Foundation models, such as Large Language Models (LLMs) or Large Vision Models (LVMs), have emerged as one of the most powerful tools in the respective fields. However, unlike text and image data, graph data do not have a definitive…

Machine Learning · Computer Science 2025-04-28 Lecheng Kong , Jiarui Feng , Hao Liu , Chengsong Huang , Jiaxin Huang , Yixin Chen , Muhan Zhang

Recent advances in CV and NLP have inspired researchers to develop general-purpose graph foundation models through pre-training across diverse domains. However, a fundamental challenge arises from the substantial differences in graph…

Social and Information Networks · Computer Science 2025-06-02 Shuo Wang , Bokui Wang , Zhixiang Shen , Boyan Deng , Zhao Kang