English
Related papers

Related papers: G-MIXER: Geodesic Mixup-based Implicit Semantic Ex…

200 papers

Composed Image Retrieval (CIR) is a complex task that retrieves images using a query, which is configured with an image and a caption that describes desired modifications to that image. Supervised CIR approaches have shown strong…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Young Kyun Jang , Dat Huynh , Ashish Shah , Wen-Kai Chen , Ser-Nam Lim

Composed image retrieval (CIR) aims to retrieve the target image based on a multimodal query, i.e., a reference image paired with corresponding modification text. Recent CIR studies leverage vision-language pre-trained (VLP) methods as the…

Multimedia · Computer Science 2024-04-25 Haokun Wen , Xuemeng Song , Xiaolin Chen , Yinwei Wei , Liqiang Nie , Tat-Seng Chua

Composed Image Retrieval (CIR) is a complex task that aims to retrieve images based on a multimodal query. Typical training data consists of triplets containing a reference image, a textual description of desired modifications, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chuong Huynh , Jinyu Yang , Ashish Tawari , Mubarak Shah , Son Tran , Raffay Hamid , Trishul Chilimbi , Abhinav Shrivastava

Composed Image Retrieval (CIR) aims to find a target image that aligns with user intent, expressed through a reference image and a modification text. While Zero-shot CIR (ZS-CIR) methods sidestep the need for labeled training data by…

Information Retrieval · Computer Science 2025-12-25 Youjin Jung , Seongwoo Cho , Hyun-seok Min , Sungchul Choi

Composed Image Retrieval (CIR) enables users to search for target images using both a reference image and manipulation text, offering substantial advantages over single-modality retrieval systems. However, existing CIR methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhipeng Qian , Zihan Liang , Yufei Ma , Ben Chen , Huangyu Dai , Yiwei Ma , Jiayi Ji , Chenyi Lei , Han Li , Xiaoshuai Sun

Composed Image Retrieval (CIR) is a pivotal and complex task in multimodal understanding. Current CIR benchmarks typically feature limited query categories and fail to capture the diverse requirements of real-world scenarios. To bridge this…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Tingyu Song , Yanzhao Zhang , Mingxin Li , Zhuoning Guo , Dingkun Long , Pengjun Xie , Siyue Zhang , Yilun Zhao , Shu Wu

Composed Image Retrieval (CIR) allows users to search for images by combining a reference image with a text prompt that describes desired modifications. While vision-language models like CLIP have popularized this task by embedding multiple…

Human-Computer Interaction · Computer Science 2026-02-17 Ioannis Dravilas , Ioannis Kapetangeorgis , Anastasios Latsoudis , Conor McCarthy , Gonçalo Marcelino , Marcel Worring

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Composed image retrieval (CIR) enables users to search images using a reference image combined with textual modifications. Recent advances in vision-language models have improved CIR, but dataset limitations remain a barrier. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Pranavi Kolouju , Eric Xing , Robert Pless , Nathan Jacobs , Abby Stylianou

As a challenging vision-language task, Zero-Shot Composed Image Retrieval (ZS-CIR) is designed to retrieve target images using bi-modal (image+text) queries. Typical ZS-CIR methods employ an inversion network to generate pseudo-word tokens…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Haiwen Li , Fei Su , Zhicheng Zhao

Retrieval is being redefined by agentic AI, demanding multimodal reasoning beyond conventional similarity-based paradigms. Composed Image Retrieval (CIR) exemplifies this shift as each query combines a reference image with textual…

Information Retrieval · Computer Science 2026-03-02 Zhongyu Yang , Wei Pang , Yingfang Yuan

We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yucheng Suo , Fan Ma , Linchao Zhu , Yi Yang

Composed Image Retrieval (CIR) aims to retrieve target images that closely resemble a reference image while integrating user-specified textual modifications, thereby capturing user intent more precisely. Existing training-free zero-shot CIR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuanmin Tang , Xiaoting Qin , Jue Zhang , Jing Yu , Gaopeng Gou , Gang Xiong , Qingwei Ling , Saravan Rajmohan , Dongmei Zhang , Qi Wu

Existing Zero-Shot Composed Image Retrieval (ZS-CIR) methods typically train adapters that convert reference images into pseudo-text tokens, which are concatenated with the modifying text and processed by frozen text encoders in pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Rong-Cheng Tu , Zhao Jin , Jingyi Liao , Xiao Luo , Yingjie Wang , Li Shen , Dacheng Tao

As a challenging vision-language (VL) task, Composed Image Retrieval (CIR) aims to retrieve target images using multimodal (image+text) queries. Although many existing CIR methods have attained promising performance, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haiwen Li , Delong Liu , Zhaohui Hou , Zhicheng Zhao , Fei Su

Composed image retrieval (CIR) allows a user to locate a target image by applying a fine-grained textual edit (e.g., ``turn the dress blue'' or ``remove stripes'') to a reference image. Zero-shot CIR, which embeds the image and the text…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Santhosh Kakarla , Gautama Shastry Bulusu Venkata

Zero-shot Composed Image Retrieval (ZS-CIR) enables image search using a reference image and a text prompt without requiring specialized text-image composition networks trained on large-scale paired data. However, current ZS-CIR approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Osman Tursun , Sinan Kalkan , Simon Denman , Clinton Fookes

Composed image retrieval (CIR) requires multi-modal models to jointly reason over visual content and semantic modifications presented in text-image input pairs. While current CIR models achieve strong performance on common benchmark cases,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chenchen Zhao , Jianhuan Zhuo , Muxi Chen , Zhaohua Zhang , Wenyu Jiang , Tianwen Jiang , Qiuyong Xiao , Jihong Zhang , Qiang Xu

Composed image retrieval (CIR) task takes a composed query of image and text, aiming to search relative images for both conditions. Conventional CIR approaches need a training dataset composed of triplets of query image, query text, and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Geonmo Gu , Sanghyuk Chun , Wonjae Kim , Yoohoon Kang , Sangdoo Yun

Composed Image Retrieval (CIR) is a challenging task that aims to retrieve the target image with a multimodal query, i.e., a reference image, and its complementary modification text. As previous supervised or zero-shot learning paradigms…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Bohan Hou , Haoqiang Lin , Haokun Wen , Meng Liu , Mingzhu Xu , Xuemeng Song