English
Related papers

Related papers: A Survey on Self-Supervised Graph Foundation Model…

200 papers

Semi-supervised learning (SSL) addresses the critical challenge of training accurate models when labeled data is scarce but unlabeled data is abundant. Graph-based SSL (GSSL) has emerged as a popular framework that captures data structure…

Machine Learning · Statistics 2026-02-10 Nadav Katz , Ariel Jaffe

Generative graph self-supervised learning (SSL) aims to learn node representations by reconstructing the input graph data. However, most existing methods focus on unsupervised learning tasks only and very few work has shown its superiority…

Machine Learning · Computer Science 2023-02-08 Xiang Li , Tiandi Ye , Caihua Shan , Dongsheng Li , Ming Gao

Graph Structure Learning (GSL) has recently garnered considerable attention due to its ability to optimize both the parameters of Graph Neural Networks (GNNs) and the computation graph structure simultaneously. Despite the proliferation of…

Machine Learning · Computer Science 2023-10-10 Zhixun Li , Liang Wang , Xin Sun , Yifan Luo , Yanqiao Zhu , Dingshuo Chen , Yingtao Luo , Xiangxin Zhou , Qiang Liu , Shu Wu , Liang Wang , Jeffrey Xu Yu

The Spatial Knowledge Graphs (SKG) are experiencing growing adoption as a means to model real-world entities, proving especially invaluable in domains like crisis management and urban planning. Considering that RDF specifications offer…

Artificial Intelligence · Computer Science 2024-11-05 Amin Anjomshoaa , Hannah Schuster , Axel Polleres

Pretraining plays a pivotal role in acquiring generalized knowledge from large-scale data, achieving remarkable successes as evidenced by large models in CV and NLP. However, progress in the graph domain remains limited due to fundamental…

Artificial Intelligence · Computer Science 2024-06-21 Yu Song , Haitao Mao , Jiachen Xiao , Jingzhe Liu , Zhikai Chen , Wei Jin , Carl Yang , Jiliang Tang , Hui Liu

Graph Convolutional Networks (GCNs) show promising results for semi-supervised learning tasks on graphs, thus become favorable comparing with other approaches. Despite the remarkable success of GCNs, it is difficult to train GCNs with…

Machine Learning · Computer Science 2020-08-14 Xianfeng Tang , Huaxiu Yao , Yiwei Sun , Yiqi Wang , Jiliang Tang , Charu Aggarwal , Prasenjit Mitra , Suhang Wang

Fine-tuning pre-trained language models (PLMs) has recently shown a potential to improve knowledge graph completion (KGC). However, most PLM-based methods focus solely on encoding textual information, neglecting the long-tailed nature of…

Computation and Language · Computer Science 2025-02-03 Youmin Ko , Hyemin Yang , Taeuk Kim , Hyunjoon Kim

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

The integration of Large Language Models (LLMs) with Graph Representation Learning (GRL) marks a significant evolution in analyzing complex data structures. This collaboration harnesses the sophisticated linguistic capabilities of LLMs to…

Machine Learning · Computer Science 2024-02-12 Qiheng Mao , Zemin Liu , Chenghao Liu , Zhuo Li , Jianling Sun

Recently, researchers utilize Knowledge Graph (KG) as side information in recommendation system to address cold start and sparsity issue and improve the recommendation performance. Existing KG-aware recommendation model use the feature of…

Information Retrieval · Computer Science 2019-08-20 Chang-You Tai , Meng-Ru Wu , Yun-Wei Chu , Shao-Yu Chu

Graph Neural Networks (GNNs) have emerged as powerful tools for supervised machine learning over graph-structured data, while sampling-based node representation learning is widely utilized in unsupervised learning. However, scalability…

Machine Learning · Computer Science 2024-07-23 Vipul Gupta , Xin Chen , Ruoyun Huang , Fanlong Meng , Jianjun Chen , Yujun Yan

We study the problem of learning features through self-supervision that are generalisable to multiple graphs. State-of-the-art graph self-supervision restricts training to only one graph, resulting in graph-specific models that are…

Machine Learning · Computer Science 2024-07-31 Laya Das , Sai Munikoti , Nrushad Joshi , Mahantesh Halappanavar

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

This paper studies semi-supervised graph classification, a crucial task with a wide range of applications in social network analysis and bioinformatics. Recent works typically adopt graph neural networks to learn graph-level representations…

Machine Learning · Computer Science 2023-04-25 Wei Ju , Xiao Luo , Meng Qu , Yifan Wang , Chong Chen , Minghua Deng , Xian-Sheng Hua , Ming Zhang

Graph neural networks (GNNs) often struggle to learn discriminative node representations for heterophilic graphs, where connected nodes tend to have dissimilar labels and feature similarity provides weak structural cues. We propose…

Machine Learning · Computer Science 2025-12-30 Ayushman Raghuvanshi , Gonzalo Mateos , Sundeep Prabhakar Chepuri

Self-supervised learning on graphs has recently achieved remarkable success in graph representation learning. With hundreds of self-supervised pretext tasks proposed over the past few years, the research community has greatly developed, and…

Machine Learning · Computer Science 2022-10-06 Lirong Wu , Yufei Huang , Haitao Lin , Zicheng Liu , Tianyu Fan , Stan Z. Li

Graph-based semi-supervised learning has proven to be an effective approach for query-focused multi-document summarization. The problem of previous semi-supervised learning is that sentences are ranked without considering the higher level…

Computation and Language · Computer Science 2014-01-03 Jiwei Li , Sujian Li

Graph structure learning is a well-established problem that aims at optimizing graph structures adaptive to specific graph datasets to help message passing neural networks (i.e., GNNs) to yield effective and robust node embeddings. However,…

Machine Learning · Computer Science 2023-06-21 Wentao Zhao , Qitian Wu , Chenxiao Yang , Junchi Yan

Graph Self-Supervised Learning (GSSL) provides a robust pathway for acquiring embeddings without expert labelling, a capability that carries profound implications for molecular graphs due to the staggering number of potential molecules and…

Machine Learning · Computer Science 2023-10-19 Hanchen Wang , Jean Kaddour , Shengchao Liu , Jian Tang , Joan Lasenby , Qi Liu

Foundation models (FMs), powered by self-supervised learning (SSL), have redefined the capabilities of artificial intelligence, demonstrating exceptional performance in domains like natural language processing and computer vision. These…

Machine Learning · Computer Science 2025-06-23 Hamdi Altaheri , Fakhri Karray , Md. Milon Islam , S M Taslim Uddin Raju , Amir-Hossein Karimi