English
Related papers

Related papers: XR: Cross-Modal Agents for Composed Image Retrieva…

200 papers

Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xintong Jiang , Yaxiong Wang , Mengjian Li , Yujiao Wu , Bingwen Hu , Xueming Qian

Composed Image Retrieval (CIR) aims to retrieve target images that closely resemble a reference image while integrating user-specified textual modifications, thereby capturing user intent more precisely. Existing training-free zero-shot CIR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuanmin Tang , Xiaoting Qin , Jue Zhang , Jing Yu , Gaopeng Gou , Gang Xiong , Qingwei Ling , Saravan Rajmohan , Dongmei Zhang , Qi Wu

The progress of composed image retrieval (CIR), a popular research direction in image retrieval, where a combined visual and textual query is used, is held back by the absence of high-quality training and evaluation data. We introduce a new…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Bill Psomas , George Retsinas , Nikos Efthymiadis , Panagiotis Filntisis , Yannis Avrithis , Petros Maragos , Ondrej Chum , Giorgos Tolias

Composed Image Retrieval (CIR) enables users to search for target images using both a reference image and manipulation text, offering substantial advantages over single-modality retrieval systems. However, existing CIR methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhipeng Qian , Zihan Liang , Yufei Ma , Ben Chen , Huangyu Dai , Yiwei Ma , Jiayi Ji , Chenyi Lei , Han Li , Xiaoshuai Sun

Composed image retrieval (CIR) requires multi-modal models to jointly reason over visual content and semantic modifications presented in text-image input pairs. While current CIR models achieve strong performance on common benchmark cases,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Chenchen Zhao , Jianhuan Zhuo , Muxi Chen , Zhaohua Zhang , Wenyu Jiang , Tianwen Jiang , Qiuyong Xiao , Jihong Zhang , Qiang Xu

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Mingyu Zhang , Zixu Li , Zhiwei Chen , Zhiheng Fu , Xiaowei Zhu , Jiajia Nie , Yinwei Wei , Yupeng Hu

Composed image retrieval (CIR) is a vision language task that retrieves a target image using a reference image and modification text, enabling intuitive specification of desired changes. While effectively fusing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Young-Eun Kim , Seong-Whan Lee

Composed image retrieval (CIR) aims to retrieve the target image based on a multimodal query, i.e., a reference image paired with corresponding modification text. Recent CIR studies leverage vision-language pre-trained (VLP) methods as the…

Multimedia · Computer Science 2024-04-25 Haokun Wen , Xuemeng Song , Xiaolin Chen , Yinwei Wei , Liqiang Nie , Tat-Seng Chua

Composed Image Retrieval (CIR) aims to retrieve target images by integrating a reference image with a corresponding modification text. CIR requires jointly considering the explicit semantics specified in the query and the implicit semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jiyoung Lim , Heejae Yang , Jee-Hyong Lee

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Composed Image Retrieval (CIR) is a pivotal and complex task in multimodal understanding. Current CIR benchmarks typically feature limited query categories and fail to capture the diverse requirements of real-world scenarios. To bridge this…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Tingyu Song , Yanzhao Zhang , Mingxin Li , Zhuoning Guo , Dingkun Long , Pengjun Xie , Siyue Zhang , Yilun Zhao , Shu Wu

Composed image retrieval (CIR) searches a corpus with a reference image and a text describing how to modify it. Despite rapid progress from triplet-trained compositors to zero-shot and generative methods, essentially all systems share one…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Amsisan Tran , Baogh Le , Tuan Kiet Pham , Sui Yang Guang

Composed Image Retrieval (CIR) allows users to search for images by combining a reference image with a text prompt that describes desired modifications. While vision-language models like CLIP have popularized this task by embedding multiple…

Human-Computer Interaction · Computer Science 2026-02-17 Ioannis Dravilas , Ioannis Kapetangeorgis , Anastasios Latsoudis , Conor McCarthy , Gonçalo Marcelino , Marcel Worring

Composed Image Retrieval (CIR) aims to retrieve target images based on a hybrid query comprising a reference image and a modification text. Early dual-tower Vision-Language Models (VLMs) struggle with cross-modality compositional reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tianyu Yang , Chenwei He , Xiangzhao Hao , Tianyue Wang , Jiarui Guo , Haiyun Guo , Leigang Qu , Jinqiao Wang , Tat-Seng Chua

The composed image retrieval (CIR) task aims to retrieve the desired target image for a given multimodal query, i.e., a reference image with its corresponding modification text. The key limitations encountered by existing efforts are two…

Multimedia · Computer Science 2024-12-02 Haokun Wen , Xuemeng Song , Jianhua Yin , Jianlong Wu , Weili Guan , Liqiang Nie

Composed Image Retrieval (CIR) uses a reference image plus a natural-language edit to retrieve images that apply the requested change while preserving other relevant visual content. Classic fusion pipelines typically rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guoyizhe Wei , Yang Jiao , Nan Xi , Zhishen Huang , Jingjing Meng , Rama Chellappa , Yan Gao

Composed Image Retrieval (CIR) is a task that retrieves images similar to a query, based on a provided textual modification. Current techniques rely on supervised learning for CIR models using labeled triplets of the reference image, text,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Young Kyun Jang , Donghyun Kim , Zihang Meng , Dat Huynh , Ser-Nam Lim

Universal Multimodal Retrieval (UMR) seeks any-to-any search across text and vision, yet modern embedding models remain brittle when queries require latent reasoning (e.g., resolving underspecified references or matching compositional…

Information Retrieval · Computer Science 2026-02-10 Jianrui Zhang , Anirudh Sundara Rajan , Brandon Han , Soochahn Lee , Sukanta Ganguly , Yong Jae Lee

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images given a multimodal query (comprising a reference image and a modification text), without training on annotated triplets. Existing methods typically convert the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Tianyue Wang , Leigang Qu , Tianyu Yang , Xiangzhao Hao , Yifan Xu , Haiyun Guo , Jinqiao Wang

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve a target image given a reference image and a relative text, without relying on costly triplet annotations. Existing CLIP-based methods face two core challenges: (1) union-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuqi Xiao , Yingying Zhu