English
Related papers

Related papers: Training-Only Heterogeneous Image-Patch-Text Graph…

200 papers

Transfer learning enables the sharing of common knowledge among models for a variety of downstream tasks, but traditional methods suffer in limited training data settings and produce narrow models incapable of effectively generalizing under…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Kevin Vogt-Lowell , Noah Lee , Theodoros Tsiligkaridis , Marc Vaillant

Recently, large-scale pre-trained vision-language models (e.g. CLIP and ALIGN) have demonstrated remarkable effectiveness in acquiring transferable visual representations. To leverage the valuable knowledge encoded within these models for…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Yi Zhang , Ce Zhang , Xueting Hu , Zhihai He

Learning on text-attributed graphs (TAGs), in which nodes are associated with one or more texts, has been the subject of much recent work. However, most approaches tend to make strong assumptions about the downstream task of interest, are…

Computation and Language · Computer Science 2024-07-11 William Brannon , Wonjune Kang , Suyash Fulay , Hang Jiang , Brandon Roy , Deb Roy , Jad Kabbara

For text-to-video retrieval (T2VR), which aims to retrieve unlabeled videos by ad-hoc textual queries, CLIP-based methods are dominating. Compared to CLIP4Clip which is efficient and compact, the state-of-the-art models tend to compute…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Kaibin Tian , Ruixiang Zhao , Hu Hu , Runquan Xie , Fengzong Lian , Zhanhui Kang , Xirong Li

Recent years have witnessed the emerging success of graph neural networks (GNNs) for modeling structured data. However, most GNNs are designed for homogeneous graphs, in which all nodes and edges belong to the same types, making them…

Machine Learning · Computer Science 2020-03-04 Ziniu Hu , Yuxiao Dong , Kuansan Wang , Yizhou Sun

Contrastive Language-Image Pre-training (CLIP) has been shown to learn visual representations with great transferability, which achieves promising accuracy for zero-shot classification. To further improve its downstream performance,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzheng Ma , Xupeng Miao , Xuming He , Bin Cui

Few-shot graph anomaly detection (GAD) has recently garnered increasing attention, which aims to discern anomalous patterns among abundant unlabeled test nodes under the guidance of a limited number of labeled training nodes. Existing…

Machine Learning · Computer Science 2024-10-14 Jiazhen Chen , Sichao Fu , Zhibin Zhang , Zheng Ma , Mingbin Feng , Tony S. Wirjanto , Qinmu Peng

Although open-vocabulary classification models like Contrastive Language Image Pretraining (CLIP) have demonstrated strong zero-shot learning capabilities, their robustness to common image corruptions remains poorly understood. Through…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sarthak Kumar Maharana , Baoming Zhang , Leonid Karlinsky , Rogerio Feris , Yunhui Guo

In few-shot classification, the aim is to learn models able to discriminate classes using only a small number of labeled examples. In this context, works have proposed to introduce Graph Neural Networks (GNNs) aiming at exploiting the…

Machine Learning · Computer Science 2021-01-29 Yuqing Hu , Vincent Gripon , Stéphane Pateux

Incremental Learning (IL) aims to learn new tasks while preserving previously acquired knowledge. Integrating the zero-shot learning capabilities of pre-trained vision-language models into IL methods has marked a significant advancement.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Haihua Luo , Xuming Ran , Jiangrong Shen , Timo Hämäläinen , Zhonghua Chen , Qi Xu , Fengyu Cong

The purpose of few-shot recognition is to recognize novel categories with a limited number of labeled examples in each class. To encourage learning from a supplementary view, recent approaches have introduced auxiliary semantic modalities…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Siteng Huang , Min Zhang , Yachen Kang , Donglin Wang

Few-shot image classification remains a critical challenge in the field of computer vision, particularly in data-scarce environments. Existing methods typically rely on pre-trained visual-language models, such as CLIP. However, due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Xi Yang , Pai Peng , Wulin Xie , Xiaohuan Lu , Jie Wen

Most few-shot learning works rely on the same domain assumption between the base and the target tasks, hindering their practical applications. This paper proposes an adaptive transformer network (ADAPTER), a simple but effective solution…

Machine Learning · Computer Science 2024-01-26 Naeem Paeedeh , Mahardhika Pratama , Muhammad Anwar Ma'sum , Wolfgang Mayer , Zehong Cao , Ryszard Kowlczyk

Recently there is a growing focus on graph data, and multi-view graph clustering has become a popular area of research interest. Most of the existing methods are only applicable to homophilous graphs, yet the extensive real-world graph data…

Machine Learning · Computer Science 2024-01-08 Zichen Wen , Yawen Ling , Yazhou Ren , Tianyi Wu , Jianpeng Chen , Xiaorong Pu , Zhifeng Hao , Lifang He

Few-shot classification consists of learning a predictive model that is able to effectively adapt to a new class, given only a few annotated samples. To solve this challenging problem, meta-learning has become a popular paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Nikita Dvornik , Cordelia Schmid , Julien Mairal

Beyond the success of Contrastive Language-Image Pre-training (CLIP), recent trends mark a shift toward exploring the applicability of lightweight vision-language models for resource-constrained scenarios. These models often deliver…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Chu Myaet Thwal , Ye Lin Tun , Minh N. H. Nguyen , Eui-Nam Huh , Choong Seon Hong

Few-shot learning focuses on learning a new visual concept with very limited labelled examples. A successful approach to tackle this problem is to compare the similarity between examples in a learned metric space based on convolutional…

Machine Learning · Computer Science 2024-02-06 Heda Song , Mercedes Torres Torres , Ender Özcan , Isaac Triguero

Pre-trained Vision-Language Models (VLMs), like CLIP, exhibit strong generalization ability to downstream tasks but struggle in few-shot scenarios. Existing prompting techniques primarily focus on global text and image representations, yet…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Xin Liu , Jiamin Wu , and Wenfei Yang , Xu Zhou , Tianzhu Zhang

Multi-label image classification allows predicting a set of labels from a given image. Unlike multiclass classification, where only one label per image is assigned, such a setup is applicable for a broader range of applications. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Kirill Prokofiev , Vladislav Sovrasov

In a recent, strongly emergent literature on few-shot CLIP adaptation, Linear Probe (LP) has been often reported as a weak baseline. This has motivated intensive research building convoluted prompt learning or feature adaptation strategies.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Yunshi Huang , Fereshteh Shakeri , Jose Dolz , Malik Boudiaf , Houda Bahig , Ismail Ben Ayed