English
Related papers

Related papers: SSTAG: Structure-Aware Self-Supervised Learning Me…

200 papers

In recent years, graph neural networks (GNNs) have facilitated the development of graph data mining. However, training GNNs requires sufficient labeled task-specific data, which is expensive and sometimes unavailable. To be less dependent…

Machine Learning · Computer Science 2025-10-15 Shengyin Sun , Chen Ma , Jiehao Chen

Deep learning on graphs has attracted significant interests recently. However, most of the works have focused on (semi-) supervised learning, resulting in shortcomings including heavy label reliance, poor generalization, and weak…

Machine Learning · Computer Science 2022-05-05 Yixin Liu , Ming Jin , Shirui Pan , Chuan Zhou , Yu Zheng , Feng Xia , Philip S. Yu

Graph Self-Supervised Learning (GSSL) has emerged as a powerful paradigm for generating high-quality representations for graph-structured data. While multi-scale graph contrastive learning has received increasing attention, many existing…

Machine Learning · Computer Science 2026-05-14 Mohamed Mahmoud Amar , Nairouz Mrabah , Mohamed Bouguessa , Abdoulaye Baniré Diallo

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Temporal graph learning aims to generate high-quality representations for graph-based tasks with dynamic information, which has recently garnered increasing attention. In contrast to static graphs, temporal graphs are typically organized as…

Machine Learning · Computer Science 2024-04-30 Meng Liu , Ke Liang , Yawei Zhao , Wenxuan Tu , Sihang Zhou , Xinbiao Gan , Xinwang Liu , Kunlun He

Motivated by the limitations of current spectral analysis methods-such as reliance on single-modality data, limited generalizability, and poor interpretability-we propose a novel multi-modal spectral analysis framework that integrates prior…

Machine Learning · Computer Science 2025-09-03 Jiheng Liang , Ziru Yu , Zujie Xie , Yuchen Guo , Yulan Guo , Xiangyang Yu

Traditional Graph Self-Supervised Learning (GSSL) struggles to capture complex structural properties well. This limitation stems from two main factors: (1) the inadequacy of conventional Graph Neural Networks (GNNs) in representing…

Machine Learning · Computer Science 2025-02-25 Asiri Wijesinghe , Hao Zhu , Piotr Koniusz

Handling heterogeneous data in tabular datasets poses a significant challenge for deep learning models. While attention-based architectures and self-supervised learning have achieved notable success, their application to tabular data…

Machine Learning · Computer Science 2025-02-27 Anay Majee , Maria Xenochristou , Wei-Peng Chen

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Self-supervised representation learning on text-attributed graphs, which aims to create expressive and generalizable representations for various downstream tasks, has received increasing research attention lately. However, existing methods…

Computation and Language · Computer Science 2023-10-24 Yichuan Li , Kaize Ding , Kyumin Lee

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

Machine Learning · Computer Science 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

Foundation models have achieved great success in natural language processing (NLP) and computer vision (CV). Their success largely stems from the ability to integrate multi-domain knowledge in pre-training and transfer it to target domains.…

Computation and Language · Computer Science 2025-07-01 Zihao Zhao , Xinlong Zhai , Jinyu Yang , Chuan Shi

graph neural networks (GNNs) are the dominant paradigm for modeling and handling graph structure data by learning universal node representation. The traditional way of training GNNs depends on a great many labeled data, which results in…

Machine Learning · Computer Science 2022-09-12 Shuai Ma , Jian-wei Liu , Xin Zuo

Inspired by the success of large language models, there is a trend toward developing graph foundation models to conduct diverse downstream tasks in various domains. However, current models often require extra fine-tuning to apply their…

Machine Learning · Computer Science 2025-05-16 Kai Wang , Siqiang Luo , Caihua Shan , Yifei Shen

Large Language Models (LLMs) have achieved impressive results in processing text data, which has sparked interest in applying these models beyond textual data, such as graphs. In the field of graph learning, there is a growing interest in…

Artificial Intelligence · Computer Science 2024-10-10 Sheng Ouyang , Yulan Hu , Ge Chen , Yong Liu

Graph Neural Networks (GNNs) have evolved to understand graph structures through recursive exchanges and aggregations among nodes. To enhance robustness, self-supervised learning (SSL) has become a vital tool for data augmentation.…

Computation and Language · Computer Science 2024-05-08 Jiabin Tang , Yuhao Yang , Wei Wei , Lei Shi , Lixin Su , Suqi Cheng , Dawei Yin , Chao Huang

Recently, research on Text-Attributed Graphs (TAGs) has gained significant attention due to the prevalence of free-text node features in real-world applications and the advancements in Large Language Models (LLMs) that bolster TAG…

Machine Learning · Computer Science 2025-02-25 Yun Zhu , Haizhou Shi , Xiaotang Wang , Yongchao Liu , Yaoke Wang , Boci Peng , Chuntao Hong , Siliang Tang

Textual graphs are ubiquitous in real-world applications, featuring rich text information with complex relationships, which enables advanced research across various fields. Textual graph representation learning aims to generate…

Machine Learning · Computer Science 2024-08-22 Wenbin Hu , Huihao Jing , Qi Hu , Haoran Li , Yangqiu Song

Graph Neural Networks (GNNs) have emerged as powerful tools for learning over structured data, including text-attributed graphs (TAGs), which are common in domains such as citation networks, social platforms, and knowledge graphs. GNNs are…

Machine Learning · Computer Science 2026-04-23 Peyman Baghershahi , Gregoire Fournier , Pranav Nyati , Sourav Medya

Graph-structured data is prevalent in the real world. Recently, due to the powerful emergent capabilities, Large Language Models (LLMs) have shown promising performance in modeling graphs. The key to effectively applying LLMs on graphs is…

Computation and Language · Computer Science 2024-10-16 Haitong Luo , Xuying Meng , Suhang Wang , Tianxiang Zhao , Fali Wang , Hanyun Cao , Yujun Zhang