English
Related papers

Related papers: Modality and Task Adaptation for Enhanced Zero-sho…

200 papers

The task of composed image retrieval (CIR) aims to retrieve images based on the query image and the text describing the users' intent. Existing methods have made great progress with the advanced large vision-language (VL) model in CIR task,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yongchao Du , Min Wang , Wengang Zhou , Shuping Hui , Houqiang Li

Composed Image Retrieval (CIR) aims to retrieve a target image from a query composed of a reference image and modification text. Recent training-free zero-shot methods often employ Multimodal Large Language Models (MLLMs) with…

Information Retrieval · Computer Science 2026-02-06 Yi Sun , Jinyu Xu , Qing Xie , Jiachen Li , Yanchun Ma , Yongjian Liu

Composed image retrieval (CIR) allows a user to locate a target image by applying a fine-grained textual edit (e.g., ``turn the dress blue'' or ``remove stripes'') to a reference image. Zero-shot CIR, which embeds the image and the text…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Santhosh Kakarla , Gautama Shastry Bulusu Venkata

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm that enables to retrieve target images based on multimodal queries consisting of reference images and modification texts. Although substantial progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Zhiwei Chen , Yupeng Hu , Zhiheng Fu , Zixu Li , Jiale Huang , Qinlei Huang , Yinwei Wei

Composed Image Retrieval (CIR) aims to find a target image that aligns with user intent, expressed through a reference image and a modification text. While Zero-shot CIR (ZS-CIR) methods sidestep the need for labeled training data by…

Information Retrieval · Computer Science 2025-12-25 Youjin Jung , Seongwoo Cho , Hyun-seok Min , Sungchul Choi

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

Composed Image Retrieval (CIR) provides an effective way to manage and access large-scale visual data. Construction of the CIR model utilizes triplets that consist of a reference image, modification text describing desired changes, and a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Kenta Uesugi , Naoki Saito , Keisuke Maeda , Takahiro Ogawa , Miki Haseyama

Composed Image Retrieval (CIR) aims to retrieve target images by integrating a reference image with a corresponding modification text. CIR requires jointly considering the explicit semantics specified in the query and the implicit semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jiyoung Lim , Heejae Yang , Jee-Hyong Lee

Composed Image Retrieval (CIR) enables users to search for target images using both a reference image and manipulation text, offering substantial advantages over single-modality retrieval systems. However, existing CIR methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhipeng Qian , Zihan Liang , Yufei Ma , Ben Chen , Huangyu Dai , Yiwei Ma , Jiayi Ji , Chenyi Lei , Han Li , Xiaoshuai Sun

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fengyin Lin , Mingkang Li , Da Li , Timothy Hospedales , Yi-Zhe Song , Yonggang Qi

Composed Image Retrieval (CIR) aims to retrieve target images that closely resemble a reference image while integrating user-specified textual modifications, thereby capturing user intent more precisely. Existing training-free zero-shot CIR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuanmin Tang , Xiaoting Qin , Jue Zhang , Jing Yu , Gaopeng Gou , Gang Xiong , Qingwei Ling , Saravan Rajmohan , Dongmei Zhang , Qi Wu

Composed image retrieval (CIR) is a new and flexible image retrieval paradigm, which can retrieve the target image for a multimodal query, including a reference image and its corresponding modification text. Although existing efforts have…

Multimedia · Computer Science 2023-09-06 Haokun Wen , Xian Zhang , Xuemeng Song , Yinwei Wei , Liqiang Nie

Composed Image Retrieval (CIR) is an important image retrieval paradigm that enables users to retrieve a target image using a multimodal query that consists of a reference image and modification text. Although research on CIR has made…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Zixu Li , Yupeng Hu , Zhiheng Fu , Zhiwei Chen , Yongqi Li , Liqiang Nie

Composed Image Retrieval (CIR) task aims to retrieve target images based on reference images and modification texts. Current CIR methods primarily rely on fine-tuning vision-language pre-trained models. However, we find that these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yizhuo Xu , Chaojian Yu , Yuanjie Shao , Tongliang Liu , Qinmu Peng , Xinge You

Composed Image Retrieval (CIR) is an emerging yet challenging task that allows users to search for target images using a multimodal query, comprising a reference image and a modification text specifying the user's desired changes to the…

Multimedia · Computer Science 2025-03-05 Xuemeng Song , Haoqiang Lin , Haokun Wen , Bohan Hou , Mingzhu Xu , Liqiang Nie

Zero-Shot Composed Image Retrieval (ZS-CIR) supports diverse tasks with a broad range of visual content manipulation intentions that can be related to domain, scene, object, and attribute. A key challenge for ZS-CIR is to accurately map…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gaopeng Gou , Gang Xiong , Qi Wu

Composed Image Retrieval (CIR) uses a reference image and a modification text as a query to retrieve a target image satisfying the requirement of ``modifying the reference image according to the text instructions''. However, existing CIR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Guozhi Qiu , Zhiwei Chen , Zixu Li , Qinlei Huang , Zhiheng Fu , Xuemeng Song , Yupeng Hu

Pre-trained multi-modal Vision-Language Models like CLIP are widely used off-the-shelf for a variety of applications. In this paper, we show that the common practice of individually exploiting the text or image encoders of these powerful…

Computer Vision and Pattern Recognition · Computer Science 2025-02-07 Marco Mistretta , Alberto Baldrati , Lorenzo Agnolucci , Marco Bertini , Andrew D. Bagdanov

Composed image retrieval searches for a target image based on a multi-modal user query comprised of a reference image and modification text describing the desired changes. Existing approaches to solving this challenging task learn a mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zheyuan Liu , Weixuan Sun , Yicong Hong , Damien Teney , Stephen Gould

Image retrieval with hybrid-modality queries, also known as composing text and image for image retrieval (CTI-IR), is a retrieval task where the search intention is expressed in a more complex query format, involving both vision and text…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yida Zhao , Yuqing Song , Qin Jin