English
Related papers

Related papers: GraphCLIP: Enhancing Transferability in Graph Foun…

200 papers

Graph neural networks (GNNs) and heterogeneous graph neural networks (HGNNs) are prominent techniques for homogeneous and heterogeneous graph representation learning, yet their performance in an end-to-end supervised framework greatly…

Machine Learning · Computer Science 2024-08-27 Xingtong Yu , Yuan Fang , Zemin Liu , Xinming Zhang

Large scale pretrained models have revolutionized Natural Language Processing (NLP) and Computer Vision (CV), showcasing remarkable cross domain generalization abilities. However, in graph learning, models are typically trained on…

Computation and Language · Computer Science 2025-10-03 Ruyue Liu , Rong Yin , Xiangzhen Bo , Xiaoshuai Hao , Yong Liu , Jinwen Zhong , Can Ma , Weiping Wang

Graph few-shot learning, which aims to classify nodes from novel classes with only a few labeled examples, is a widely studied problem in graph learning. However, existing methods often face two key limitations. First, the predominant graph…

Artificial Intelligence · Computer Science 2026-05-26 Renchu Guan , Yajun Wang , Chunli Guo , Bowen Cao , Fausto Giunchiglia , Wei Pang , Yonghao Liu , Xiaoyue Feng

Graphs are ubiquitous structures found in numerous real-world applications, such as drug discovery, recommender systems, and social network analysis. To model graph-structured data, graph neural networks (GNNs) have become a popular tool.…

Computation and Language · Computer Science 2025-02-10 Zehong Wang , Sidney Liu , Zheyuan Zhang , Tianyi Ma , Chuxu Zhang , Yanfang Ye

Existing foundation models, such as CLIP, aim to learn a unified embedding space for multimodal data, enabling a wide range of downstream web-based applications like search, recommendation, and content classification. However, these models…

Machine Learning · Computer Science 2025-04-28 Yufei He , Yuan Sui , Xiaoxin He , Yue Liu , Yifei Sun , Bryan Hooi

Few-shot node classification is tasked to provide accurate predictions for nodes from novel classes with only few representative labeled nodes. This problem has drawn tremendous attention for its projection to prevailing real-world…

Machine Learning · Computer Science 2022-12-13 Zhen Tan , Song Wang , Kaize Ding , Jundong Li , Huan Liu

Recent adapter-based CLIP tuning (e.g., Tip-Adapter) is a strong few-shot learner, achieving efficiency by caching support features for fast prototype matching. However, these methods rely on global uni-modal feature vectors, overlooking…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Mohammed Rahman Sherif Khan Mohammad , Ardhendu Behera , Sandip Pradhan , Swagat Kumar , Amr Ahmed

Zero-shot and few-shot learning aim to improve generalization to unseen concepts, which are promising in many realistic scenarios. Due to the lack of data in unseen domain, relation modeling between seen and unseen domains is vital for…

Machine Learning · Computer Science 2019-09-02 Chenrui Zhang , Xiaoqing Lyu , Zhi Tang

Representation learning on text-attributed graphs (TAGs) integrates structural connectivity with rich textual semantics, enabling applications in diverse domains. Current methods largely rely on contrastive learning to maximize cross-modal…

Graphics · Computer Science 2025-10-15 Heng Zhang , Tianyi Zhang , Yuling Shi , Xiaodong Gu , Yaomin Shen , Zijian Zhang , Yilei Yuan , Hao Zhang , Jin Huang

Graph few-shot learning has garnered significant attention for its ability to rapidly adapt to downstream tasks with limited labeled data, sparking considerable interest among researchers. Recent advancements in graph few-shot learning…

Machine Learning · Computer Science 2025-01-13 Yonghao Liu , Fausto Giunchiglia , Ximing Li , Lan Huang , Xiaoyue Feng , Renchu Guan

In recent studies on domain adaptation, significant emphasis has been placed on the advancement of learning shared knowledge from a source domain to a target domain. Recently, the large vision-language pre-trained model, i.e., CLIP has…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Ruoyu Feng , Tao Yu , Xin Jin , Xiaoyuan Yu , Lei Xiao , Zhibo Chen

Large-scale "pre-train and prompt learning" paradigms have demonstrated remarkable adaptability, enabling broad applications across diverse domains such as question answering, image recognition, and multimodal retrieval. This approach fully…

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui

Large-scale foundation models like CLIP have shown strong zero-shot generalization but struggle with domain shifts, limiting their adaptability. In our work, we introduce \textsc{StyLIP}, a novel domain-agnostic prompt learning strategy for…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Ankit Jha

Capitalizing on vast amount of image-text data, large-scale vision-language pre-training has demonstrated remarkable zero-shot capabilities and has been utilized in several applications. However, models trained on general everyday…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Umair Nawaz , Muhammad Awais , Hanan Gani , Muzammal Naseer , Fahad Khan , Salman Khan , Rao Muhammad Anwer

Graph foundation models (GFMs) have recently emerged as a promising paradigm for achieving broad generalization across various graph data. However, existing GFMs are often trained on datasets that may not fully reflect real-world graphs,…

Machine Learning · Computer Science 2025-10-10 Adrian Hayler , Xingyue Huang , İsmail İlkan Ceylan , Michael Bronstein , Ben Finkelshtein

Few-shot segmentation remains challenging due to the limitations of its labeling information for unseen classes. Most previous approaches rely on extracting high-level feature maps from the frozen visual encoder to compute the pixel-wise…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Jin Wang , Bingfeng Zhang , Jian Pang , Honglong Chen , Weifeng Liu

Representation learning on text-attributed graphs (TAGs) is vital for real-world applications, as they combine semantic textual and contextual structural information. Research in this field generally consist of two main perspectives:…

Computation and Language · Computer Science 2024-10-15 Yaoke Wang , Yun Zhu , Wenqiao Zhang , Yueting Zhuang , Yunfei Li , Siliang Tang

Graph neural networks (GNNs) are often trained on individual datasets, requiring specialized models and significant hyperparameter tuning due to the unique structures and features of each dataset. This approach limits the scalability and…

Machine Learning · Computer Science 2026-02-17 Divyansha Lachi , Mehdi Azabou , Vinam Arora , Eva Dyer

Text-attributed Graphs (TAGs) are commonly found in the real world, such as social networks and citation networks, and consist of nodes represented by textual descriptions. Currently, mainstream machine learning methods on TAGs involve a…

Social and Information Networks · Computer Science 2023-09-07 Xuanwen Huang , Kaiqiao Han , Dezheng Bao , Quanjin Tao , Zhisheng Zhang , Yang Yang , Qi Zhu