English
Related papers

Related papers: SA$^{2}$GFM: Enhancing Robust Graph Foundation Mod…

200 papers

This paper proposes a topology-aware graph reinforcement learning approach to address the routing policy optimization problem in cloud server environments. The method builds a unified framework for state representation and structural…

Machine Learning · Computer Science 2025-09-08 Yuxi Wang , Heyao Liu , Guanzi Yao , Nyutian Long , Yue Kang

In traditional Graph Neural Networks (GNNs), the assumption of a fixed embedding manifold often limits their adaptability to diverse graph geometries. Recently, Hamiltonian system-inspired GNNs have been proposed to address the dynamic…

Machine Learning · Computer Science 2024-07-25 Jiaxu Liu , Xinping Yi , Tianle Zhang , Xiaowei Huang

Foundation Models (FMs) serve as a general class for the development of artificial intelligence systems, offering broad potential for generalization across a spectrum of downstream tasks. Despite extensive research into self-supervised…

Machine Learning · Computer Science 2024-06-17 Yuhao Xu , Xinqi Liu , Keyu Duan , Yi Fang , Yu-Neng Chuang , Daochen Zha , Qiaoyu Tan

Automatic Modulation Recognition (AMR) is an essential part of Intelligent Transportation System (ITS) dynamic spectrum allocation. However, current deep learning-based AMR (DL-AMR) methods are challenged to extract discriminative and…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Mingyuan Shao , Zhengqiu Fu , Dingzhao Li , Fuqing Zhang , Yilin Cai , Shaohua Hong , Lin Cao , Yuan Peng , Jie Qi

While Graph Neural Networks (GNNs) and Large Language Models (LLMs) are powerful approaches for learning on Text-Attributed Graphs (TAGs), a comprehensive understanding of their robustness remains elusive. Current evaluations are…

Machine Learning · Computer Science 2025-10-21 Runlin Lei , Lu Yi , Mingguo He , Pengyu Qiu , Zhewei Wei , Yongchao Liu , Chuntao Hong

Graph Neural Networks (GNNs) have shown promising potential in graph representation learning. The majority of GNNs define a local message-passing mechanism, propagating information over the graph by stacking multiple layers. These methods,…

Machine Learning · Computer Science 2024-02-20 Ali Behrouz , Farnoosh Hashemi

Large Language Models (LLMs) are increasingly applied to tasks involving structured inputs such as graphs. Abstract Meaning Representations (AMRs), which encode rich semantics as directed graphs, offer a rigorous testbed for evaluating LLMs…

Computation and Language · Computer Science 2025-12-11 Rafiq Kamel , Filippo Guerranti , Simon Geisler , Stephan Günnemann

Foundation models excel at language, where sentences become tokens, and vision, where images become pixels, because both reduce to discrete symbols on a shared, fixed grid. Knowledge Graphs share the discreteness, but not the geometry.…

Artificial Intelligence · Computer Science 2026-05-08 Kossi Amouzouvi , Robert Wardenga , Jens Lehmann , Sahar Vahdati

Graph Neural Networks (GNNs) have shown remarkable performance on graph-structured data. However, recent empirical studies suggest that GNNs are very susceptible to distribution shift. There is still significant ambiguity about why…

Machine Learning · Computer Science 2023-06-07 Qi Zhu , Yizhu Jiao , Natalia Ponomareva , Jiawei Han , Bryan Perozzi

Graph foundation models (GFMs) aim to reuse a single backbone across diverse graph domains, yet their transfer is often uneven and can exhibit negative transfer. While most prior work improves transfer through architectural or adaptation…

Machine Learning · Computer Science 2026-05-29 Jiajun Zhu , Ying Chen , Peihao Wang , Yixuan He , Pan Li , Aditya Akella , Zhangyang Wang

Using Large Language Models (LLMs) to process graph-structured data is an active research area, yet current state-of-the-art approaches typically rely on multi-step pipelines with Graph Neural Network (GNN) encoders that compress rich…

Machine Learning · Computer Science 2026-05-12 Dario Vajda

Graph Prompt Learning (GPL) has recently emerged as a promising paradigm for downstream adaptation of pre-trained graph models, mitigating the misalignment between pre-training objectives and downstream tasks. Recently, the focus of GPL has…

Machine Learning · Computer Science 2026-05-25 Dongxiao He , Wenxuan Sun , Yongqi Huang , Jitao Zhao , Di Jin

Recommender systems (RS) serve as a fundamental tool for navigating the vast expanse of online information, with deep learning advancements playing an increasingly important role in improving ranking accuracy. Among these, graph neural…

Information Retrieval · Computer Science 2025-02-18 Bin Wu , Yihang Wang , Yuanhao Zeng , Jiawei Liu , Jiashu Zhao , Cheng Yang , Yawen Li , Long Xia , Dawei Yin , Chuan Shi

Molecular representation learning, a cornerstone for downstream tasks like molecular captioning and molecular property prediction, heavily relies on Graph Neural Networks (GNN). However, GNN suffers from the over-smoothing problem, where…

Machine Learning · Computer Science 2025-08-13 Zihang Shao , Wentao Lei , Lei Wang , Wencai Ye , Li Liu

To develop a preliminary understanding towards Graph Foundation Models, we study the extent to which pretrained Graph Neural Networks can be applied across datasets, an effort requiring to be agnostic to dataset-specific features and their…

Unsupervised domain adaptation (UDA) is vital for alleviating the workload of labeling 3D point cloud data and mitigating the absence of labels when facing a newly defined domain. Various methods of utilizing images to enhance the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Jingyi Xu , Weidong Yang , Lingdong Kong , Youquan Liu , Rui Zhang , Qingyuan Zhou , Ben Fei

The representation learning on textual graph is to generate low-dimensional embeddings for the nodes based on the individual textual features and the neighbourhood information. Recent breakthroughs on pretrained language models and graph…

Computation and Language · Computer Science 2023-10-10 Junhan Yang , Zheng Liu , Shitao Xiao , Chaozhuo Li , Defu Lian , Sanjay Agrawal , Amit Singh , Guangzhong Sun , Xing Xie

We present Gradient Gating (G$^2$), a novel framework for improving the performance of Graph Neural Networks (GNNs). Our framework is based on gating the output of GNN layers with a mechanism for multi-rate flow of message passing…

In recent years, graph neural networks (GNNs) have emerged as a potent tool for learning on graph-structured data and won fruitful successes in varied fields. The majority of GNNs follow the message-passing paradigm, where representations…

Machine Learning · Computer Science 2024-08-30 Yurui Lai , Xiaoyang Lin , Renchi Yang , Hongtao Wang

Graph self-supervised learning (SSL) is now a go-to method for pre-training graph foundation models (GFMs). There is a wide variety of knowledge patterns embedded in the graph data, such as node properties and clusters, which are crucial to…

Machine Learning · Computer Science 2025-05-15 Ziwen Zhao , Yixin Su , Yuhua Li , Yixiong Zou , Ruixuan Li , Rui Zhang