English
Related papers

Related papers: Beyond Single-Granularity Prompts: A Multi-Scale C…

200 papers

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Graph neural networks have emerged as a powerful tool for graph representation learning, but their performance heavily relies on abundant task-specific supervision. To reduce labeling requirement, the "pre-train, prompt" paradigms have…

Machine Learning · Computer Science 2024-08-27 Xingtong Yu , Zhenghao Liu , Yuan Fang , Zemin Liu , Sihong Chen , Xinming Zhang

Graphs have emerged as a natural choice to represent and analyze the intricate patterns and rich information of the Web, enabling applications such as online page classification and social recommendation. The prevailing "pre-train,…

Machine Learning · Computer Science 2025-02-06 Yihong Ma , Ning Yan , Jiayu Li , Masood Mortazavi , Nitesh V. Chawla

Graphs can inherently model interconnected objects on the Web, thereby facilitating a series of Web applications, such as web analyzing and content recommendation. Recently, Graph Neural Networks (GNNs) have emerged as a mainstream…

Computation and Language · Computer Science 2024-08-27 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

The recent "pre-train, prompt, predict training" paradigm has gained popularity as a way to learn generalizable models with limited labeled data. The approach involves using a pre-trained model and a prompting function that applies a…

Machine Learning · Computer Science 2023-06-01 Xuansheng Wu , Kaixiong Zhou , Mingchen Sun , Xin Wang , Ninghao Liu

Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph…

Machine Learning · Computer Science 2023-02-28 Zemin Liu , Xingtong Yu , Yuan Fang , Xinming Zhang

Recently, ''pre-training and fine-tuning'' has been adopted as a standard workflow for many graph tasks since it can take general graph knowledge to relieve the lack of graph annotations from each application. However, graph tasks with node…

Social and Information Networks · Computer Science 2023-12-19 Xiangguo Sun , Hong Cheng , Jia Li , Bo Liu , Jihong Guan

The "Graph pre-training and fine-tuning" paradigm has significantly improved Graph Neural Networks(GNNs) by capturing general knowledge without manual annotations for downstream tasks. However, due to the immense gap of data and tasks…

Machine Learning · Computer Science 2024-02-22 Yuchen Yan , Peiyan Zhang , Zheng Fang , Qingqing Long

Recently, much exertion has been paid to design graph self-supervised methods to obtain generalized pre-trained models, and adapt pre-trained models onto downstream tasks through fine-tuning. However, there exists an inherent gap between…

Machine Learning · Computer Science 2023-08-16 Yun Zhu , Jianhao Guo , Siliang Tang

Graph neural networks (GNNs) and heterogeneous graph neural networks (HGNNs) are prominent techniques for homogeneous and heterogeneous graph representation learning, yet their performance in an end-to-end supervised framework greatly…

Machine Learning · Computer Science 2024-08-27 Xingtong Yu , Yuan Fang , Zemin Liu , Xinming Zhang

Graph Neural Networks (GNNs) are powerful in learning semantics of graph data. Recently, a new paradigm "pre-train and prompt" has shown promising results in adapting GNNs to various tasks with less supervised data. The success of such…

Machine Learning · Computer Science 2024-06-04 Qingqing Ge , Zeyuan Zhao , Yiding Liu , Anfeng Cheng , Xiang Li , Shuaiqiang Wang , Dawei Yin

Pre-trained graph neural networks (GNNs) transfer well, but adapting them to downstream tasks remains challenging due to mismatches between pre-training objectives and task requirements. Graph prompt tuning offers a parameter-efficient…

Machine Learning · Computer Science 2026-02-06 Long D. Nguyen , Binh P. Nguyen

Continual Graph Learning (CGL), which aims to accommodate new tasks over evolving graph data without forgetting prior knowledge, is garnering significant research interest. Mainstream solutions adopt the memory replay-based idea, ie,…

Machine Learning · Computer Science 2025-02-11 Qi Wang , Tianfei Zhou , Ye Yuan , Rui Mao

Chain-of-thought (CoT) prompting has achieved remarkable success in natural language processing (NLP). However, its vast potential remains largely unexplored for graphs. This raises an interesting question: How can we design CoT prompting…

Computation and Language · Computer Science 2025-06-03 Xingtong Yu , Chang Zhou , Zhongwei Kuai , Xinming Zhang , Yuan Fang

In recent years, graph prompting has emerged as a promising research direction, enabling the learning of additional tokens or subgraphs appended to the original graphs without requiring retraining of pre-trained graph models across various…

Machine Learning · Computer Science 2025-05-28 Qunzhong Wang , Xiangguo Sun , Hong Cheng

Given the ubiquity of graph data, it is intriguing to ask: Is it possible to train a graph foundation model on a broad range of graph data across diverse domains? A major hurdle toward this goal lies in the fact that graphs from different…

Machine Learning · Computer Science 2024-09-24 Xingtong Yu , Chang Zhou , Yuan Fang , Xinming Zhang

Dynamic graphs capture evolving interactions between entities, such as in social networks, online learning platforms, and crowdsourcing projects. For dynamic graph modeling, dynamic graph neural networks (DGNNs) have emerged as a mainstream…

Machine Learning · Computer Science 2025-03-04 Xingtong Yu , Zhenghao Liu , Xinming Zhang , Yuan Fang

Signed Graph Neural Networks (SGNNs) are effective in learning expressive representations for signed graphs but typically require substantial task-specific labels, limiting their applicability in label-scarce industrial scenarios. In…

Machine Learning · Computer Science 2025-08-19 Zian Zhai , Sima Qing , Xiaoyang Wang , Wenjie Zhang

Graph learning models have demonstrated great prowess in learning expressive representations from large-scale graph data in a wide variety of real-world scenarios. As a prevalent strategy for training powerful graph learning models, the…

Machine Learning · Computer Science 2025-06-11 Xingbo Fu , Zehong Wang , Zihan Chen , Jiazheng Li , Yaochen Zhu , Zhenyu Lei , Cong Shen , Yanfang Ye , Chuxu Zhang , Jundong Li

The chain-of-thought technique has been received well in multi-modal tasks. It is a step-by-step linear reasoning process that adjusts the length of the chain to improve the performance of generated prompts. However, human thought processes…

Artificial Intelligence · Computer Science 2024-04-09 Juncheng Yang , Zuchao Li , Shuai Xie , Wei Yu , Shijun Li , Bo Du
‹ Prev 1 2 3 10 Next ›