English
Related papers

Related papers: Relation-Aware Graph Foundation Model

200 papers

Graphs are fundamental data structures which concisely capture the relational structure in many important real-world domains, such as knowledge graphs, physical and social interactions, language, and chemistry. Here we introduce a powerful…

Machine Learning · Computer Science 2018-03-12 Yujia Li , Oriol Vinyals , Chris Dyer , Razvan Pascanu , Peter Battaglia

Temporal Knowledge Graph Forecasting (TKGF) aims to predict future events based on the observed events in history. Recently, Large Language Models (LLMs) have exhibited remarkable capabilities, generating significant research interest in…

Information Retrieval · Computer Science 2025-01-22 He Chang , Jie Wu , Zhulin Tao , Yunshan Ma , Xianglin Huang , Tat-Seng Chua

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Task planning in language agents is emerging as an important research topic alongside the development of large language models (LLMs). It aims to break down complex user requests in natural language into solvable sub-tasks, thereby…

Machine Learning · Computer Science 2024-10-29 Xixi Wu , Yifei Shen , Caihua Shan , Kaitao Song , Siwei Wang , Bohang Zhang , Jiarui Feng , Hong Cheng , Wei Chen , Yun Xiong , Dongsheng Li

Graph foundation models (GFMs) seek transferable representations across graph domains but are limited by structural heterogeneity and incompatible node feature spaces. We propose Structure-Centric Graph Foundation Models (SCGFM), which…

Machine Learning · Computer Science 2026-05-12 Xiaodong He , Haolan He , Ruiyi Fang , Ming Sun , Zhao Kang

Graph Neural Networks (GNNs) have been widely applied to various fields due to their powerful representations of graph-structured data. Despite the success of GNNs, most existing GNNs are designed to learn node representations on the fixed…

Machine Learning · Computer Science 2021-06-14 Seongjun Yun , Minbyul Jeong , Sungdong Yoo , Seunghun Lee , Sean S. Yi , Raehyun Kim , Jaewoo Kang , Hyunwoo J. Kim

Data has become a foundational asset driving innovation across domains such as finance, healthcare, and e-commerce. In these areas, predictive modeling over relational tables is commonly employed, with increasing emphasis on reducing manual…

Databases · Computer Science 2025-08-29 Lianpeng Qiao , Ziqi Cao , Kaiyu Feng , Ye Yuan , Guoren Wang

Large Language Models (LLMs) present massive inherent knowledge and superior semantic comprehension capability, which have revolutionized various tasks in natural language processing. Despite their success, a critical gap remains in…

Computation and Language · Computer Science 2025-02-11 Ben Liu , Jihai Zhang , Fangquan Lin , Cheng Yang , Min Peng

Large language models (LLMs) have demonstrated immense potential across various tasks. However, research for exploring and improving the capabilities of LLMs in interpreting graph structures remains limited. To address this gap, we conduct…

Computation and Language · Computer Science 2025-02-17 Jie He , Yijun Yang , Wanqiu Long , Deyi Xiong , Victor Gutierrez-Basulto , Jeff Z. Pan

A comprehensive representation of an image requires understanding objects and their mutual relationship, especially in image-to-graph generation, e.g., road network extraction, blood-vessel network extraction, or scene graph generation.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Suprosanna Shit , Rajat Koner , Bastian Wittmann , Johannes Paetzold , Ivan Ezhov , Hongwei Li , Jiazhen Pan , Sahand Sharifzadeh , Georgios Kaissis , Volker Tresp , Bjoern Menze

Pre-trained Language Models (PLMs) have the potential to transform software development tasks. However, despite significant advances, current PLMs struggle to capture the structured and relational attributes of code, such as control flow…

Software Engineering · Computer Science 2026-05-06 Mert Tiftikci , Amir Molzam Sharifloo , Mira Mezini

Graphs are essential for modeling complex relationships and capturing structured interactions in data. Graph Neural Networks (GNNs) are particularly effective when such relational structure is explicitly available, but many real-world…

Graphics · Computer Science 2026-03-02 Haozhe Chen , Soheila Farokhi , Kelvyn Bladen , Hamid Karimi , Kevin R. Moon

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Session search involves a series of interactive queries and actions to fulfill user's complex information need. Current strategies typically prioritize sequential modeling for deep semantic understanding, overlooking the graph structure in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Songhao Wu , Quan Tu , Hong Liu , Jia Xu , Zhongyi Liu , Guannan Zhang , Ran Wang , Xiuying Chen , Rui Yan

Large Language Models (LLMs) have achieved remarkable success across various domains. However, they still face significant challenges, including high computational costs for training and limitations in solving complex reasoning problems.…

Machine Learning · Computer Science 2025-05-20 Hang Gao , Chenhao Zhang , Tie Wang , Junsuo Zhao , Fengge Wu , Changwen Zheng , Huaping Liu

Knowledge graphs (KGs) have commonly been constructed using predefined symbolic relation schemas, typically implemented as categorical relation labels. This design has notable shortcomings: real-world relations are often contextual,…

Computation and Language · Computer Science 2026-01-15 Kanyao Han , Yushang Lai

Graphs are widely used to model relational data. As graphs are getting larger and larger in real-world scenarios, there is a trend to store and compute subgraphs in multiple local systems. For example, recently proposed \emph{subgraph…

Machine Learning · Computer Science 2024-01-30 Zaixi Zhang , Qingyong Hu , Yang Yu , Weibo Gao , Qi Liu

Attention mechanisms are critical to the success of large language models (LLMs), driving significant advancements in multiple fields. However, for graph-structured data, which requires emphasis on topological connections, they fall short…

Artificial Intelligence · Computer Science 2025-05-06 Zhong Guan , Likang Wu , Hongke Zhao , Ming He , Jianpin Fan

In recent years, Graph Foundation Models (GFMs) have gained significant attention for their potential to generalize across diverse graph domains and tasks. Some works focus on Domain-Specific GFMs, which are designed to address a variety of…

Machine Learning · Computer Science 2025-03-13 Yuxiang Wang , Wenqi Fan , Suhang Wang , Yao Ma

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are…

Machine Learning · Computer Science 2022-04-19 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv , Hui Xiong