English
Related papers

Related papers: CAILA: Concept-Aware Intra-Layer Adapters for Comp…

200 papers

Pre-trained Vision-Language Models (VLMs) struggle with Zero-Shot Anomaly Detection (ZSAD) due to a critical adaptation gap: they lack the local inductive biases required for dense prediction and employ inflexible feature fusion paradigms.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Ke Ma , Jun Long , Hongxiao Fei , Liujie Hua , Zhen Dai , Yueyi Luo

Contrastive vision-language models (VLMs) such as CLIP achieve strong zero-shot recognition yet remain vulnerable to spurious correlations, particularly background over-reliance. We introduce Cluster-based Concept Importance (CCI), a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Aishwarya Agarwal , Srikrishna Karanam , Vineet Gandhi

Vision-Language Pre-Trained models, notably CLIP, that utilize contrastive learning have proven highly adept at extracting generalizable visual features. To inherit the well-learned knowledge of VLP models for downstream tasks, several…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yi Zhang , Weicheng Lin , Liang-Jie Zhang

Vision-language pretraining on large datasets of images-text pairs is one of the main building blocks of current Vision-Language Models. While with additional training, these models excel in various downstream tasks, including visual…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Madhukar Reddy Vongala , Saurabh Srivastava , Jana Košecká

The contrastive vision-language pre-training, known as CLIP, demonstrates remarkable potential in perceiving open-world visual concepts, enabling effective zero-shot image recognition. Nevertheless, few-shot learning methods based on CLIP…

Computer Vision and Pattern Recognition · Computer Science 2024-01-12 Cheng Cheng , Lin Song , Ruoyi Xue , Hang Wang , Hongbin Sun , Yixiao Ge , Ying Shan

Recent progress towards learning from limited supervision has encouraged efforts towards designing models that can recognize novel classes at test time (generalized zero-shot learning or GZSL). GZSL approaches assume knowledge of all…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Hari Chandana Kuchibhotla , Sumitra S Malagi , Shivam Chandhok , Vineeth N Balasubramanian

Zero-Shot Learning (ZSL) has received extensive attention and successes in recent years especially in areas of fine-grained object recognition, retrieval, and image captioning. Key to ZSL is to transfer knowledge from the seen to the unseen…

Computer Vision and Pattern Recognition · Computer Science 2019-12-11 Xingxing Zhang , Shupeng Gui , Zhenfeng Zhu , Yao Zhao , Ji Liu

This paper studies the problem of Generalized Zero-shot Learning (G-ZSL), whose goal is to classify instances belonging to both seen and unseen classes at the test time. We propose a novel space decomposition method to solve G-ZSL. Some…

Machine Learning · Computer Science 2021-08-31 Hanze Dong , Yanwei Fu , Sung Ju Hwang , Leonid Sigal , Xiangyang Xue

The fusion of vision and language has brought about a transformative shift in computer vision through the emergence of Vision-Language Models (VLMs). However, the resource-intensive nature of existing VLMs poses a significant challenge. We…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Jordan Shipard , Arnold Wiliem , Kien Nguyen Thanh , Wei Xiang , Clinton Fookes

Large pretrained language models (LMs) have shown impressive In-Context Learning (ICL) ability, where the model learns to do an unseen task via a prompt consisting of input-output examples as the demonstration, without any parameter…

Computation and Language · Computer Science 2023-06-21 Jiacheng Ye , Zhiyong Wu , Jiangtao Feng , Tao Yu , Lingpeng Kong

In Zero-shot learning (ZSL), we classify unseen categories using textual descriptions about their expected appearance when observed (class embeddings) and a disjoint pool of seen classes, for which annotated visual data are accessible. We…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Jacopo Cavazza

Zero-shot learning (ZSL) makes object recognition in images possible in absence of visual training data for a part of the classes from a dataset. When the number of classes is large, classes are usually represented by semantic class…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Yannick Le Cacheux , Adrian Popescu , Hervé Le Borgne

Zero-shot learning (ZSL) enables the recognition of novel classes by leveraging semantic knowledge transfer from known to unknown categories. This knowledge, typically encapsulated in attribute descriptions, aids in identifying…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Haojian Huang , Xiaozhen Qiao , Zhuo Chen , Haodong Chen , Bingyu Li , Zhe Sun , Mulin Chen , Xuelong Li

Zero-Shot Learning (ZSL) is an emerging research that aims to solve the classification problems with very few training data. The present works on ZSL mainly focus on the mapping of learning semantic space to visual space. It encounters many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Zeng Ting , Xiang Hongxin , Xie Cheng , Yang Yun , Liu Qing

Existing zero-shot learning (ZSL) methods usually learn a projection function between a feature space and a semantic embedding space(text or attribute space) in the training seen classes or testing unseen classes. However, the projection…

Computer Vision and Pattern Recognition · Computer Science 2018-01-26 Guangfeng Lin , Caixia Fan , Wanjun Chen , Yajun Chen , Fan Zhao

People easily recognize new visual categories that are new combinations of known components. This compositional generalization capacity is critical for learning in real-world domains like vision and language because the long tail of new…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yuval Atzmon , Felix Kreuk , Uri Shalit , Gal Chechik

Zero-shot learning (ZSL) enables solving a task without the need to see its examples. In this paper, we propose two ZSL frameworks that learn to synthesize parameters for novel unseen classes. First, we propose to cast the problem of ZSL as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

Zero-shot learning (ZSL) aims to recognize the novel object categories using the semantic representation of categories, and the key idea is to explore the knowledge of how the novel class is semantically related to the familiar classes.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Ying Shi , Wei Wei , Zhiming Zheng

Although zero-shot learning (ZSL) has an inferential capability of recognizing new classes that have never been seen before, it always faces two fundamental challenges of the cross modality and crossdomain challenges. In order to alleviate…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Cheng Xie , Hongxin Xiang , Ting Zeng , Yun Yang , Beibei Yu , Qing Liu

Vision-language models (VLMs) like CLIP have showcased a remarkable ability to extract transferable features for downstream tasks. Nonetheless, the training process of these models is usually based on a coarse-grained contrastive loss…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Ali Abdollah , Amirmohammad Izadi , Armin Saghafian , Reza Vahidimajd , Mohammad Mozafari , Amirreza Mirzaei , Mohammadmahdi Samiei , Mahdieh Soleymani Baghshah