English
Related papers

Related papers: Prompting Language-Informed Distribution for Compo…

200 papers

Current pre-trained vision-language models, such as CLIP, have demonstrated remarkable zero-shot generalization capabilities across various downstream tasks. However, their performance significantly degrades when test inputs exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Junhui Yin , Xinyu Zhang , Lin Wu , Xiaojie Wang

In zero-shot learning (ZSL) community, it is generally recognized that transductive learning performs better than inductive one as the unseen-class samples are also used in its training stage. How to generate pseudo labels for unseen-class…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Bo Liu , Lihua Hu , Qiulei Dong , Zhanyi Hu

Vision-language models (VLMs) classify the query video by calculating a similarity score between the visual features and text-based class label representations. Recently, large language models (LLMs) have been used to enrich the text-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Adeel Yousaf , Muzammal Naseer , Salman Khan , Fahad Shahbaz Khan , Mubarak Shah

Contrastive language-image pretraining (CLIP) links vision and language modalities into a unified embedding space, yielding the tremendous potential for vision-language (VL) tasks. While early concurrent works have begun to study this…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Zhecan Wang , Noel Codella , Yen-Chun Chen , Luowei Zhou , Jianwei Yang , Xiyang Dai , Bin Xiao , Haoxuan You , Shih-Fu Chang , Lu Yuan

Learning novel concepts, remembering previous knowledge, and adapting it to future tasks occur simultaneously throughout a human's lifetime. To model such comprehensive abilities, continual zero-shot learning (CZSL) has recently been…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Wenxuan Zhang , Paul Janson , Kai Yi , Ivan Skorokhodov , Mohamed Elhoseiny

Vision-language models, such as CLIP, have shown impressive generalization capacities when using appropriate text descriptions. While optimizing prompts on downstream labeled data has proven effective in improving performance, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Xingyu Zhu , Beier Zhu , Yi Tan , Shuo Wang , Yanbin Hao , Hanwang Zhang

Supervised learning requires a sufficient training dataset which includes all label. However, there are cases that some class is not in the training data. Zero-Shot Learning (ZSL) is the task of predicting class that is not in the training…

Machine Learning · Computer Science 2020-07-02 Toshitaka Hayashi , Hamido Fujita

Vision-language models (VLMs) like CLIP have been cherished for their ability to perform zero-shot visual recognition on open-vocabulary concepts. This is achieved by selecting the object category whose textual representation bears the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Shaunak Halbe , Junjiao Tian , K J Joseph , James Seale Smith , Katherine Stevo , Vineeth N Balasubramanian , Zsolt Kira

Generative Zero-shot learning (ZSL) learns a generator to synthesize visual samples for unseen classes, which is an effective way to advance ZSL. However, existing generative methods rely on the conditions of Gaussian noise and the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Wenjin Hou , Shiming Chen , Shuhuang Chen , Ziming Hong , Yan Wang , Xuetao Feng , Salman Khan , Fahad Shahbaz Khan , Xinge You

Generalized Zero-Shot Learning (GZSL) aims to train a classifier that can generalize to unseen classes, using a set of attributes as auxiliary information, and the visual features extracted from a pre-trained convolutional neural network.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Paola Cascante-Bonilla , Leonid Karlinsky , James Seale Smith , Yanjun Qi , Vicente Ordonez

Zero-shot learning (ZSL) aims at recognizing unseen class examples (e.g., images) with knowledge transferred from seen classes. This is typically achieved by exploiting a semantic feature space shared by both seen and unseen classes, e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Jingcai Guo

Contrastive vision-language models like CLIP have shown great progress in transfer learning. In the inference stage, the proper text description, also known as prompt, needs to be carefully designed to correctly classify the given images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Tony Huang , Jack Chu , Fangyun Wei

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

Zero-shot learning (ZSL) enables solving a task without the need to see its examples. In this paper, we propose two ZSL frameworks that learn to synthesize parameters for novel unseen classes. First, we propose to cast the problem of ZSL as…

Computer Vision and Pattern Recognition · Computer Science 2019-07-19 Soravit Changpinyo , Wei-Lun Chao , Boqing Gong , Fei Sha

Machine Learning (ML) techniques for image classification routinely require many labelled images for training the model and while testing, we ought to use images belonging to the same domain as those used for training. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Preeti Jagdish Sajjan , Frank G. Glavin

Methods proposed in the literature for zero-shot learning (ZSL) are typically suitable for offline learning and cannot continually learn from sequential streaming data. The sequential data comes in the form of tasks during training.…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Chandan Gautam , Sethupathy Parameswaran , Ashish Mishra , Suresh Sundaram

Zero-Shot Learning (ZSL) is a classification task where we do not have even a single training labeled example from a set of unseen classes. Instead, we only have prior information (or description) about seen and unseen classes, often in the…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Shabnam Daghaghi , Tharun Medini , Anshumali Shrivastava

Pretrained language models (PLMs) have demonstrated remarkable performance in various natural language processing tasks: Unidirectional PLMs (e.g., GPT) are well known for their superior text generation capabilities; bidirectional PLMs…

Computation and Language · Computer Science 2022-10-13 Yu Meng , Jiaxin Huang , Yu Zhang , Jiawei Han

Transductive zero-shot learning with vision-language models leverages image-image similarities within the dataset to achieve better classification accuracy compared to the inductive setting. However, there is little work that explores the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-15 Oindrila Saha , Logan Lawrence , Grant Van Horn , Subhransu Maji

To recognize objects of the unseen classes, most existing Zero-Shot Learning(ZSL) methods first learn a compatible projection function between the common semantic space and the visual space based on the data of source seen classes, then…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Ziyu Wan , Dongdong Chen , Yan Li , Xingguang Yan , Junge Zhang , Yizhou Yu , Jing Liao