English
Related papers

Related papers: Prompt Tuning for Zero-shot Compositional Learning

200 papers

Zero-shot learning (ZSL) aims to recognize unseen classes accurately by learning seen classes and known attributes, but correlations in attributes were ignored by previous study which lead to classification results confused. To solve this…

Computer Vision and Pattern Recognition · Computer Science 2020-09-15 Chunlai Chai , Yukuan Lou , Shijin Zhang

Zero-shot learning (ZSL) aims to recognize instances of unseen classes solely based on the semantic descriptions of the classes. Existing algorithms usually formulate it as a semantic-visual correspondence problem, by learning mappings from…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Kai Li , Martin Renqiang Min , Yun Fu

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen attribute-object pairs based on a limited set of observed examples. Current CZSL methodologies, despite their advancements, tend to neglect the distinct specificity levels…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Yun Li , Zhe Liu , Hang Chen , Lina Yao

Generalized zero-shot learning aims to recognize both seen and unseen classes with the help of semantic information that is shared among different classes. It inevitably requires consistent visual-semantic alignment. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Huajie Jiang , Zhengxian Li , Xiaohan Yu , Yongli Hu , Baocai Yin , Jian Yang , Yuankai Qi

Zero-shot learning (ZSL) aims to train a model on seen classes and recognize unseen classes by knowledge transfer through shared auxiliary information. Recent studies reveal that documents from encyclopedias provide helpful auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiangyan Qu , Jing Yu , Jiamin Zhuang , Gaopeng Gou , Gang Xiong , Qi Wu

Zero-shot learning (ZSL) aims to recognize objects of novel classes without any training samples of specific classes, which is achieved by exploiting the semantic information and auxiliary datasets. Recently most ZSL approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2018-07-25 Huajie Jiang , Ruiping Wang , Shiguang Shan , Xilin Chen

Generalized compositional zero-shot learning means to learn composed concepts of attribute-object pairs in a zero-shot fashion, where a model is trained on a set of seen concepts and tested on a combined set of seen and unseen concepts.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 He Huang , Wei Tang , Jiawei Zhang , Philip S. Yu

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen state-object combinations by leveraging known combinations. Existing studies basically rely on the cross-modal alignment capabilities of CLIP but tend to overlook its…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yue Wang , Shuai Xu , Xuelin Zhu , Yicong Li

Prompt tuning has become a popular strategy for adapting Vision-Language Models (VLMs) to zero/few-shot visual recognition tasks. Some prompting techniques introduce prior knowledge due to its richness, but when learnable tokens are…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Shuchang Zhou , Jiwei Wei , Shiyuan He , Yuyang Zhou , Chaoning Zhang , Jie Zou , Ning Xie , Yang Yang

Compositional Zero-Shot Learning (CZSL) aims to recognize unseen compositions formed from seen state and object during training. Since the same state may be various in the visual appearance while entangled with different objects, CZSL is…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Xiangyu Li , Xu Yang , Kun Wei , Cheng Deng , Muli Yang

In realistic open-set scenarios where labels of a part of testing data are totally unknown, when vision-language (VL) prompt learning methods encounter inputs related to unknown classes (i.e., not seen during training), they always predict…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Ning Liao , Xiaopeng Zhang , Min Cao , Junchi Yan

Zero-shot learning (ZSL) which aims to recognize unseen object classes by only training on seen object classes, has increasingly been of great interest in Machine Learning, and has registered with some successes. Most existing ZSL methods…

Computer Vision and Pattern Recognition · Computer Science 2019-07-04 Wen Tang , Ashkan Panahi , Hamid Krim

One of the hallmarks of human intelligence is the ability to compose learned knowledge into novel concepts which can be recognized without a single training example. In contrast, current state-of-the-art methods require hundreds of training…

Computer Vision and Pattern Recognition · Computer Science 2019-05-16 Senthil Purushwalkam , Maximilian Nickel , Abhinav Gupta , Marc'Aurelio Ranzato

Pre-trained vision-language models are able to interpret visual concepts and language semantics. Prompt learning, a method of constructing prompts for text encoders or image encoders, elicits the potentials of pre-trained models and readily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Zero-shot learning (ZSL) is made possible by learning a projection function between a feature space and a semantic space (e.g.,~an attribute space). Key to ZSL is thus to learn a projection that is robust against the often large domain gap…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Zhiwu Lu , Jiechao Guan , Aoxue Li , Tao Xiang , An Zhao , Ji-Rong Wen

Zero-shot learning (ZSL) aims to recognize novel classes by transferring semantic knowledge from seen classes to unseen classes. Since semantic knowledge is built on attributes shared between different classes, which are highly local,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Yang Liu , Lei Zhou , Xiao Bai , Yifei Huang , Lin Gu , Jun Zhou , Tatsuya Harada

Prompt tuning is a new few-shot transfer learning technique that only tunes the learnable prompt for pre-trained vision and language models such as CLIP. However, existing prompt tuning methods tend to learn spurious or entangled…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Xuehai He , Diji Yang , Weixi Feng , Tsu-Jui Fu , Arjun Akula , Varun Jampani , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Compositional Zero-shot Learning (CZSL) aims to identify novel compositions via known attribute-object pairs. The primary challenge in CZSL tasks lies in the significant discrepancies introduced by the complex interaction between the visual…

Computer Vision and Pattern Recognition · Computer Science 2024-06-24 Suyi Li , Chenyi Jiang , Shidong Wang , Yang Long , Zheng Zhang , Haofeng Zhang

How can we extend a pre-trained model to many language understanding tasks, without labeled or additional unlabeled data? Pre-trained language models (PLMs) have been effective for a wide range of NLP tasks. However, existing approaches…

Computation and Language · Computer Science 2023-05-29 Xuandong Zhao , Siqi Ouyang , Zhiguo Yu , Ming Wu , Lei Li

Prompt tuning, like CoOp, has recently shown promising vision recognizing and transfer learning ability on various downstream tasks with the emergence of large pre-trained vision-language models like CLIP. However, we identify that existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yongzhu Miao , Shasha Li , Jintao Tang , Ting Wang