English
Related papers

Related papers: Pix2Key: Controllable Open-Vocabulary Retrieval wi…

200 papers

Zero-shot composed image retrieval (ZS-CIR) retrieves a target image from a reference image and a text modification without human-annotated CIR triplets. Projection-based ZS-CIR methods are attractive because they do not rely on LLMs at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Mingyu Liu , Sihan Huang , Yijia Fan , Yinlin Yan , Quan Zhang , Jian-Fang Hu , Jianhuang Lai

Composed Image Retrieval (CoIR) has recently gained popularity as a task that considers both text and image queries together, to search for relevant images in a database. Most CoIR approaches require manually annotated datasets, comprising…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lucas Ventura , Antoine Yang , Cordelia Schmid , Gül Varol

Composed Image Retrieval (CIR) is a complex task that retrieves images using a query, which is configured with an image and a caption that describes desired modifications to that image. Supervised CIR approaches have shown strong…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Young Kyun Jang , Dat Huynh , Ashish Shah , Wen-Kai Chen , Ser-Nam Lim

Composed Image Retrieval (CIR) aims to retrieve target images from a gallery based on a reference image and modification text as a combined query. Recent approaches focus on balancing global information from two modalities and encode the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yuxin Yang , Yinan Zhou , Yuxin Chen , Ziqi Zhang , Zongyang Ma , Chunfeng Yuan , Bing Li , Lin Song , Jun Gao , Peng Li , Weiming Hu

Composed Image Retrieval (CIR) aims to retrieve target images based on a hybrid query comprising a reference image and a modification text. Early dual-tower Vision-Language Models (VLMs) struggle with cross-modality compositional reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tianyu Yang , Chenwei He , Xiangzhao Hao , Tianyue Wang , Jiarui Guo , Haiyun Guo , Leigang Qu , Jinqiao Wang , Tat-Seng Chua

Composed Image Retrieval (CIR) presents a significant challenge as it requires jointly understanding a reference image and a modified textual instruction to find relevant target images. Some existing methods attempt to use a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jun Li , Hongjian Dou , Zhenyu Zhang , Kai Li , Shaoguo Liu , Tingting Gao

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xintong Jiang , Yaxiong Wang , Mengjian Li , Yujiao Wu , Bingwen Hu , Xueming Qian

Composed image retrieval attempts to retrieve an image of interest from gallery images through a composed query of a reference image and its corresponding modified text. It has recently attracted attention due to the collaboration of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Shitong Sun , Fanghua Ye , Shaogang Gong

We extend the task of composed image retrieval, where an input query consists of an image and short textual description of how to modify the image. Existing methods have only been applied to non-complex images within narrow domains, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zheyuan Liu , Cristian Rodriguez-Opazo , Damien Teney , Stephen Gould

Composed Image Retrieval (CIR) task aims to retrieve target images based on reference images and modification texts. Current CIR methods primarily rely on fine-tuning vision-language pre-trained models. However, we find that these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yizhuo Xu , Chaojian Yu , Yuanjie Shao , Tongliang Liu , Qinmu Peng , Xinge You

Composed image retrieval (CIR) task takes a composed query of image and text, aiming to search relative images for both conditions. Conventional CIR approaches need a training dataset composed of triplets of query image, query text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Geonmo Gu , Sanghyuk Chun , Wonjae Kim , Yoohoon Kang , Sangdoo Yun

We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yucheng Suo , Fan Ma , Linchao Zhu , Yi Yang

This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image and a query text.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Huaying Zhang , Rintaro Yanagi , Ren Togo , Takahiro Ogawa , Miki Haseyama

Composed image retrieval searches for a target image based on a multi-modal user query comprised of a reference image and modification text describing the desired changes. Existing approaches to solving this challenging task learn a mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zheyuan Liu , Weixuan Sun , Yicong Hong , Damien Teney , Stephen Gould

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve the target image based on a reference image and a text description without requiring in-distribution triplets for training. One prevalent approach follows the vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zining Chen , Zhicheng Zhao , Fei Su , Xiaoqin Zhang , Shijian Lu

The composed image retrieval (CIR) task is to retrieve target images given a reference image and a modification text. Recent methods for CIR leverage large pretrained vision-language models (VLMs) and achieve good performance on…

Machine Learning · Computer Science 2025-07-11 François Gardères , Shizhe Chen , Camille-Sovanneary Gauthier , Jean Ponce

Composed Image Retrieval (CIR) requires both preserving the visual continuity of the reference image and faithfully executing the semantic variables specified in the modification text, which constitute the core challenge of the task.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xingtian Pei , Yukun Song , Changwei Wang , Shunpeng Chen , Rongtao Xu , Shengpeng Xu , Shibiao Xu

Different from Composed Image Retrieval task that requires expensive labels for training task-specific models, Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gang Xiong , Yue Hu , Qi Wu

Composed Image Retrieval (CIR) is the task of retrieving a target image from a database using a multimodal query, which consists of a reference image and a modification text. The text specifies how to alter the reference image to form a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tong Wang , Yunhan Zhao , Shu Kong