English
Related papers

Related papers: Data-Efficient Generalization for Zero-shot Compos…

200 papers

Zero-shot sketch-based image retrieval (ZS-SBIR) is challenging due to the cross-domain nature of sketches and photos, as well as the semantic gap between seen and unseen image distributions. Previous methods fine-tune pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Shiyin Dong , Mingrui Zhu , Nannan Wang , Xinbo Gao

Generative Zero-Shot Learning (ZSL) methods synthesize class-related features based on predefined class semantic prototypes, showcasing superior performance. However, this feature generation paradigm falls short of providing interpretable…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Dingjie Fu , Wenjin Hou , Shiming Chen , Shuhuang Chen , Xinge You , Salman Khan , Fahad Shahbaz Khan

This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR), which aims to use sketches from unseen categories as queries to match the images of the same category. Due to the large cross-modality discrepancy, ZS-SBIR…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Decheng Liu , Xu Luo , Chunlei Peng , Nannan Wang , Ruimin Hu , Xinbo Gao

In zero-shot image retrieval (ZSIR) task, embedding learning becomes more attractive, however, many methods follow the traditional metric learning idea and omit the problems behind zero-shot settings. In this paper, we first emphasize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Binghui Chen , Weihong Deng

As a challenging vision-language (VL) task, Composed Image Retrieval (CIR) aims to retrieve target images using multimodal (image+text) queries. Although many existing CIR methods have attained promising performance, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haiwen Li , Delong Liu , Zhaohui Hou , Zhicheng Zhao , Fei Su

Sketch-based image retrieval (SBIR) relies on free-hand sketches to retrieve natural photos within the same class. However, its practical application is limited by its inability to retrieve classes absent from the training set. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yang Liu , Jiale Du , Xinbo Gao , Jungong Han

The problem of zero-shot sketch-based image retrieval (ZS-SBIR) has achieved increasing attention due to its wide applications, e.g. e-commerce. Despite progress made in this field, previous works suffer from using imbalanced samples of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanwen Su , Ge Song , Jiyan Wang , Yuanbo Zhu

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Composed Image Retrieval (CIR) is the task of retrieving a target image from a gallery using a composed query consisting of a reference image and a modification text. Among various CIR approaches, training-free zero-shot methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Seong-Whan Lee

Generalized zero-shot learning (GZSL) is a technique to train a deep learning model to identify unseen classes using the attribute. In this paper, we put forth a new GZSL technique that improves the GZSL classification performance greatly.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Junhan Kim , Kyuhong Shim , Byonghyo Shim

With the development of large language models (LLMs), zero-shot learning has attracted much attention for various NLP tasks. Different from prior works that generate training data with billion-scale natural language generation (NLG) models,…

Computation and Language · Computer Science 2023-05-19 Yue Yu , Yuchen Zhuang , Rongzhi Zhang , Yu Meng , Jiaming Shen , Chao Zhang

Continual learning (CL) can help pre-trained vision-language models efficiently adapt to new or under-trained data distributions without re-training. Nevertheless, during the continual training of the Contrastive Language-Image Pre-training…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Zangwei Zheng , Mingyuan Ma , Kai Wang , Ziheng Qin , Xiangyu Yue , Yang You

Existing Zero-Shot Composed Image Retrieval (ZS-CIR) methods typically train adapters that convert reference images into pseudo-text tokens, which are concatenated with the modifying text and processed by frozen text encoders in pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Rong-Cheng Tu , Zhao Jin , Jingyi Liao , Xiao Luo , Yingjie Wang , Li Shen , Dacheng Tao

Composed image retrieval is a type of image retrieval task where the user provides a reference image as a starting point and specifies a text on how to shift from the starting point to the desired target image. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Xingyu Yang , Daqing Liu , Heng Zhang , Yong Luo , Chaoyue Wang , Jing Zhang

Visual cognition of primates is superior to that of artificial neural networks in its ability to 'envision' a visual object, even a newly-introduced one, in different attributes including pose, position, color, texture, etc. To aid neural…

Computer Vision and Pattern Recognition · Computer Science 2021-02-18 Yunhao Ge , Sami Abu-El-Haija , Gan Xin , Laurent Itti

Remote sensing text--image retrieval (RSTIR) aims to retrieve the matched remote sensing (RS) images from the database according to the descriptive text. Recently, the rapid development of large visual-language pre-training models provides…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Weihang Zhang , Jihao Li , Shuoke Li , Ziqing Niu , Jialiang Chen , Wenkai Zhang

Deep learning models have the ability to extract rich knowledge from large-scale datasets. However, the sharing of data has become increasingly challenging due to concerns regarding data copyright and privacy. Consequently, this hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Bowen Tang , Long Yan , Jing Zhang , Qian Yu , Lu Sheng , Dong Xu

Generalized Zero-shot Semantic Segmentation aims to segment both seen and unseen categories only under the supervision of the seen ones. To tackle this, existing methods adopt the large-scale Vision Language Models (VLMs) which obtain…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jialei Chen , Daisuke Deguchi , Chenkai Zhang , Xu Zheng , Hiroshi Murase

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a novel cross-modal retrieval task, where abstract sketches are used as queries to retrieve natural images under zero-shot scenario. Most existing methods regard ZS-SBIR as a traditional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Zhipeng Wang , Hao Wang , Jiexi Yan , Aming Wu , Cheng Deng

Zero-shot learning (ZSL) is a framework to classify images belonging to unseen classes based on solely semantic information about these unseen classes. In this paper, we propose a new ZSL algorithm using coupled dictionary learning. The…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Mohammad Rostami , Soheil Kolouri , Zak Murez , Yuri Owekcho , Eric Eaton , Kuyngnam Kim