English
Related papers

Related papers: HGMP:Heterogeneous Graph Multi-Task Prompt Learnin…

200 papers

Heterogeneous graphs are widely used to model multi-relational systems, but missing node attributes remain a major bottleneck for downstream learning. In this paper, we identify and formalize type-dependent information asymmetry: the…

Machine Learning · Computer Science 2026-05-01 Ta-Yang Wang , Rajgopal Kannan , Viktor Prasanna

The advent of the "pre-train, prompt" paradigm has recently extended its generalization ability and data efficiency to graph representation learning, following its achievements in Natural Language Processing (NLP). Initial graph prompt…

Machine Learning · Computer Science 2025-01-20 Jiapeng Zhu , Zichen Ding , Jianxiang Yu , Jiaqi Tan , Xiang Li , Weining Qian

In heterogeneous graphs, we can observe complex structures such as tree-like or hierarchical structures. Recently, the hyperbolic space has been widely adopted in many studies to effectively learn these complex structures. Although these…

Machine Learning · Computer Science 2026-01-14 Jongmin Park , Seunghoon Han , Hyewon Lee , Won-Yong Shin , Sungsu Lim

Urban region representation is crucial for various urban downstream tasks. However, despite the proliferation of methods and their success, acquiring general urban region knowledge and adapting to different tasks remains challenging.…

Artificial Intelligence · Computer Science 2025-07-04 Jiahui Jin , Yifan Song , Dong Kan , Haojia Zhu , Xiangguo Sun , Zhicheng Li , Xigang Sun , Jinghui Zhang

Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many tasks. Transferring…

Machine Learning · Computer Science 2022-12-19 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy

Incremental learning aims to overcome catastrophic forgetting when learning deep networks from sequential tasks. With impressive learning efficiency and performance, prompt-based methods adopt a fixed backbone to sequential tasks by…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yu-Ming Tang , Yi-Xing Peng , Wei-Shi Zheng

Graph neural networks (GNNs) have been applied into a variety of graph tasks. Most existing work of GNNs is based on the assumption that the given graph data is optimal, while it is inevitable that there exists missing or incomplete edges…

Machine Learning · Computer Science 2022-05-13 Qianggang Ding , Deheng Ye , Tingyang Xu , Peilin Zhao

Domain generalization on graphs aims to develop models with robust generalization capabilities, ensuring effective performance on the testing set despite disparities between testing and training distributions. However, existing methods…

Machine Learning · Computer Science 2024-11-21 Qin Tian , Chen Zhao , Minglai Shao , Wenjun Wang , Yujie Lin , Dong Li

Existing gradient-based meta-learning approaches to few-shot learning assume that all tasks have the same input feature space. However, in the real world scenarios, there are many cases that the input structures of tasks can be different,…

Artificial Intelligence · Computer Science 2021-09-29 Jiayi Chen , Aidong Zhang

Discovering distinct features and their relations from data can help us uncover valuable knowledge crucial for various tasks, e.g., classification. In neuroimaging, these features could help to understand, classify, and possibly prevent…

Machine Learning · Computer Science 2022-02-15 Usman Mahmood , Zening Fu , Vince Calhoun , Sergey Plis

Graph Neural Networks (GNNs) have demonstrated strong performance in graph mining tasks due to their message-passing mechanism, which is aligned with the homophily assumption that adjacent nodes exhibit similar behaviors. However, in many…

Machine Learning · Computer Science 2024-05-29 Zhuonan Zheng , Yuanchen Bei , Sheng Zhou , Yao Ma , Ming Gu , HongJia XU , Chengyu Lai , Jiawei Chen , Jiajun Bu

Data-Free Meta-Learning (DFML) aims to derive knowledge from a collection of pre-trained models without accessing their original data, enabling the rapid adaptation to new unseen tasks. Current methods often overlook the heterogeneity among…

Machine Learning · Computer Science 2024-12-10 Yongxian Wei , Zixuan Hu , Li Shen , Zhenyi Wang , Yu Li , Chun Yuan , Dacheng Tao

We present a novel methodology to jointly perform multi-task learning and infer intrinsic relationship among tasks by an interpretable and sparse graph. Unlike existing multi-task learning methodologies, the graph structure is not assumed…

Machine Learning · Computer Science 2020-09-15 Shujian Yu , Francesco Alesiani , Ammar Shaker , Wenzhe Yin

Real-world networks and knowledge graphs are usually heterogeneous networks. Representation learning on heterogeneous networks is not only a popular but a pragmatic research field. The main challenge comes from the heterogeneity -- the…

Social and Information Networks · Computer Science 2021-02-17 Jie Zhang , Jinru Ding , Suyuan Liu , Hongyan Wu

Self-supervised learning (SSL) methods have been increasingly applied to diverse downstream tasks due to their superior generalization capabilities and low annotation costs. However, most existing heterogeneous graph SSL models convert…

Machine Learning · Computer Science 2025-06-10 Di Lin , Wanjing Ren , Xuanbin Li , Rui Zhang

Pre-training GNNs to extract transferable knowledge and apply it to downstream tasks has become the de facto standard of graph representation learning. Recent works focused on designing self-supervised pre-training tasks to extract useful…

Machine Learning · Computer Science 2024-04-24 Zhe Zhao , Pengkun Wang , Xu Wang , Haibin Wen , Xiaolong Xie , Zhengyang Zhou , Qingfu Zhang , Yang Wang

We consider the problem of learning efficient and inductive graph convolutional networks for text classification with a large number of examples and features. Existing state-of-the-art graph embedding based methods such as predictive text…

Computation and Language · Computer Science 2020-09-01 Rahul Ragesh , Sundararajan Sellamanickam , Arun Iyer , Ram Bairi , Vijay Lingam

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.e., manually…

Machine Learning · Computer Science 2024-05-08 Mingguo He , Zhewei Wei , Shikun Feng , Zhengjie Huang , Weibin Li , Yu Sun , Dianhai Yu

Large Language Models (LLMs) have the ability to solve a variety of tasks, such as text summarization and mathematical questions, just out of the box, but they are often trained with a single task in mind. Due to high computational costs,…

Computation and Language · Computer Science 2025-01-22 Chen Dun , Mirian Hipolito Garcia , Guoqing Zheng , Ahmed Hassan Awadallah , Anastasios Kyrillidis , Robert Sim

Prompt tuning has emerged as a lightweight strategy for adapting foundation models to downstream tasks, particularly for resource-constrained systems. As pre-trained prompts become valuable assets, combining multiple source prompts offers a…

Computation and Language · Computer Science 2025-10-16 Enming Zhang , Liwen Cao , Yanru Wu , Zijie Zhao , Yang Li