English
Related papers

Related papers: Text-Free Multi-domain Graph Pre-training: Toward …

200 papers

Heterogeneous graph learning aims to capture complex relationships and diverse relational semantics among entities in a heterogeneous graph to obtain meaningful representations for nodes and edges. Recent advancements in heterogeneous graph…

Computation and Language · Computer Science 2024-05-21 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Long Xia , Dawei Yin , Chao Huang

Graph neural networks (GNNs) and heterogeneous graph neural networks (HGNNs) are prominent techniques for homogeneous and heterogeneous graph representation learning, yet their performance in an end-to-end supervised framework greatly…

Machine Learning · Computer Science 2024-08-27 Xingtong Yu , Yuan Fang , Zemin Liu , Xinming Zhang

Graph neural networks have emerged as a powerful tool for graph representation learning, but their performance heavily relies on abundant task-specific supervision. To reduce labeling requirement, the "pre-train, prompt" paradigms have…

Machine Learning · Computer Science 2024-08-27 Xingtong Yu , Zhenghao Liu , Yuan Fang , Zemin Liu , Sihong Chen , Xinming Zhang

Graphs have emerged as a natural choice to represent and analyze the intricate patterns and rich information of the Web, enabling applications such as online page classification and social recommendation. The prevailing "pre-train,…

Machine Learning · Computer Science 2025-02-06 Yihong Ma , Ning Yan , Jiayu Li , Masood Mortazavi , Nitesh V. Chawla

Data-to-text generation has recently attracted substantial interests due to its wide applications. Existing methods have shown impressive performance on an array of tasks. However, they rely on a significant amount of labeled data for each…

Computation and Language · Computer Science 2020-10-13 Wenhu Chen , Yu Su , Xifeng Yan , William Yang Wang

Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from…

Machine Learning · Computer Science 2023-12-19 Mouxiang Chen , Zemin Liu , Chenghao Liu , Jundong Li , Qiheng Mao , Jianling Sun

Graph transformation that predicts graph transition from one mode to another is an important and common problem. Despite much progress in developing advanced graph transformation techniques in recent years, the fundamental assumption…

Machine Learning · Computer Science 2023-05-25 Shiyu Wang , Guangji Bai , Qingyang Zhu , Zhaohui Qin , Liang Zhao

Multi-graph learning is crucial for extracting meaningful signals from collections of heterogeneous graphs. However, effectively integrating information across graphs with differing topologies, scales, and semantics, often in the absence of…

Machine Learning · Computer Science 2026-02-02 Zahra Moslemi , Ziyi Liang , Norbert Fortin , Babak Shahbaba

Signed Graph Neural Networks (SGNNs) are effective in learning expressive representations for signed graphs but typically require substantial task-specific labels, limiting their applicability in label-scarce industrial scenarios. In…

Machine Learning · Computer Science 2025-08-19 Zian Zhai , Sima Qing , Xiaoyang Wang , Wenjie Zhang

Multi-domain graph pre-training integrates knowledge from diverse domains to enhance performance in the target domains, which is crucial for building graph foundation models. Despite initial success, existing solutions often fall short of…

Machine Learning · Computer Science 2026-03-03 Li Sun , Zhenhao Huang , Silei Chen , Lanxu Yang , Junda Ye , Sen Su , Philip S. Yu

Graph pre-training strategies have been attracting a surge of attention in the graph mining community, due to their flexibility in parameterizing graph neural networks (GNNs) without any label information. The key idea lies in encoding…

Machine Learning · Computer Science 2022-08-23 Dawei Zhou , Lecheng Zheng , Dongqi Fu , Jiawei Han , Jingrui He

Model pre-training on large text corpora has been demonstrated effective for various downstream applications in the NLP domain. In the graph mining domain, a similar analogy can be drawn for pre-training graph models on large graphs in the…

Computation and Language · Computer Science 2023-06-06 Han Xie , Da Zheng , Jun Ma , Houyu Zhang , Vassilis N. Ioannidis , Xiang Song , Qing Ping , Sheng Wang , Carl Yang , Yi Xu , Belinda Zeng , Trishul Chilimbi

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on…

Neurons and Cognition · Quantitative Biology 2026-02-11 Xinxu Wei , Kanhao Zhao , Yong Jiao , Lifang He , Yu Zhang

The pre-training on the graph neural network model can learn the general features of large-scale networks or networks of the same type by self-supervised methods, which allows the model to work even when node labels are missing. However,…

Machine Learning · Computer Science 2022-04-19 Ke-jia Chen , Jiajun Zhang , Linpu Jiang , Yunyun Wang , Yuxuan Dai

In this paper we address multi-target domain adaptation (MTDA), where given one labeled source dataset and multiple unlabeled target datasets that differ in data distributions, the task is to learn a robust predictor for all the target…

Computer Vision and Pattern Recognition · Computer Science 2021-04-05 Subhankar Roy , Evgeny Krivosheev , Zhun Zhong , Nicu Sebe , Elisa Ricci

Graph-based recommendation has achieved great success in recent years. The classical graph recommendation model utilizes ID embedding to store essential collaborative information. However, this ID-based paradigm faces challenges in…

Information Retrieval · Computer Science 2026-05-12 Yiwen Chen , Yiqing Wu , Huishi Luo , Fuzhen Zhuang , Deqing Wang , Zhao Zhang

Graph learning plays a vital role in mining and analyzing complex relationships within graph data and has been widely applied to real-world scenarios such as social, citation, and e-commerce networks. Foundation models in computer vision…

Machine Learning · Computer Science 2025-11-19 Haihong Zhao , Zhixun Li , Chenyi Zi , Aochuan Chen , Fugee Tsung , Jia Li , Jeffrey Xu Yu

Traditional machine learning algorithms assume that the training and test data have the same distribution, while this assumption does not necessarily hold in real applications. Domain adaptation methods take into account the deviations in…

Machine Learning · Statistics 2019-02-26 Elif Vural

In recent years, graph prompting has emerged as a promising research direction, enabling the learning of additional tokens or subgraphs appended to the original graphs without requiring retraining of pre-trained graph models across various…

Machine Learning · Computer Science 2025-05-28 Qunzhong Wang , Xiangguo Sun , Hong Cheng

Given the ubiquity of graph data and its applications in diverse domains, building a Graph Foundation Model (GFM) that can work well across different graphs and tasks with a unified backbone has recently garnered significant interests. A…

Machine Learning · Computer Science 2024-06-18 Zhikai Chen , Haitao Mao , Jingzhe Liu , Yu Song , Bingheng Li , Wei Jin , Bahare Fatemi , Anton Tsitsulin , Bryan Perozzi , Hui Liu , Jiliang Tang