English
Related papers

Related papers: From Mapping to Composing: A Two-Stage Framework f…

200 papers

Composed image retrieval searches for a target image based on a multi-modal user query comprised of a reference image and modification text describing the desired changes. Existing approaches to solving this challenging task learn a mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zheyuan Liu , Weixuan Sun , Yicong Hong , Damien Teney , Stephen Gould

Composed image retrieval (CIR) is a vision language task that retrieves a target image using a reference image and modification text, enabling intuitive specification of desired changes. While effectively fusing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Young-Eun Kim , Seong-Whan Lee

Composed Image Retrieval (CIR) aims to find a target image that aligns with user intent, expressed through a reference image and a modification text. While Zero-shot CIR (ZS-CIR) methods sidestep the need for labeled training data by…

Information Retrieval · Computer Science 2025-12-25 Youjin Jung , Seongwoo Cho , Hyun-seok Min , Sungchul Choi

Composed Image Retrieval (CIR) represents a novel retrieval paradigm that is capable of expressing users' intricate retrieval requirements flexibly. It enables the user to give a multimodal query, comprising a reference image and a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Xuemeng Song , Liqiang Nie

Composed Image Retrieval (CIR) presents a significant challenge as it requires jointly understanding a reference image and a modified textual instruction to find relevant target images. Some existing methods attempt to use a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jun Li , Hongjian Dou , Zhenyu Zhang , Kai Li , Shaoguo Liu , Tingting Gao

Composed image retrieval (CIR) enables users to search images using a reference image combined with textual modifications. Recent advances in vision-language models have improved CIR, but dataset limitations remain a barrier. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Pranavi Kolouju , Eric Xing , Robert Pless , Nathan Jacobs , Abby Stylianou

Composed Image Retrieval (CIR) enables users to search for target images using both a reference image and manipulation text, offering substantial advantages over single-modality retrieval systems. However, existing CIR methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhipeng Qian , Zihan Liang , Yufei Ma , Ben Chen , Huangyu Dai , Yiwei Ma , Jiayi Ji , Chenyi Lei , Han Li , Xiaoshuai Sun

Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xintong Jiang , Yaxiong Wang , Mengjian Li , Yujiao Wu , Bingwen Hu , Xueming Qian

Composed image retrieval (CIR) aims to retrieve a target image that depicts a reference image modified by a textual description. While recent vision-language models (VLMs) achieve promising CIR performance by embedding images and text into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 François Gardères , Camille-Sovanneary Gauthier , Jean Ponce , Shizhe Chen

Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent across domain, scene, object, and attribute. The key challenge for ZS-CIR tasks is to modify a reference image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gang Xiong , Gaopeng Gou , Qi Wu

This paper proposes a novel diffusion-based model, CompoDiff, for solving zero-shot Composed Image Retrieval (ZS-CIR) with latent diffusion. This paper also introduces a new synthetic dataset, named SynthTriplets18M, with 18.8 million…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Geonmo Gu , Sanghyuk Chun , Wonjae Kim , HeeJae Jun , Yoohoon Kang , Sangdoo Yun

Composed Image Retrieval (CIR) aims to retrieve target images based on a reference image and modified texts. However, existing methods often struggle to extract the correct semantic cues from the reference image that best reflect the user's…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xuri Ge , Chunhao Wang , Xindi Wang , Zheyun Qin , Zhumin Chen , Xin Xin

Composed Image Retrieval (CIR) uses a reference image and a modification text as a query to retrieve a target image satisfying the requirement of ``modifying the reference image according to the text instructions''. However, existing CIR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Guozhi Qiu , Zhiwei Chen , Zixu Li , Qinlei Huang , Zhiheng Fu , Xuemeng Song , Yupeng Hu

Composed image retrieval (CIR) searches a corpus with a reference image and a text describing how to modify it. Despite rapid progress from triplet-trained compositors to zero-shot and generative methods, essentially all systems share one…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Amsisan Tran , Baogh Le , Tuan Kiet Pham , Sui Yang Guang

Retrieval is being redefined by agentic AI, demanding multimodal reasoning beyond conventional similarity-based paradigms. Composed Image Retrieval (CIR) exemplifies this shift as each query combines a reference image with textual…

Information Retrieval · Computer Science 2026-03-02 Zhongyu Yang , Wei Pang , Yingfang Yuan

Composed Image Retrieval (CIR) seeks to find a target image using a multi-modal query, which combines an image with modification text to pinpoint the target. While recent CIR methods have shown promise, they mainly focus on exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Peng Gao , Yujian Lee , Zailong Chen , Hui zhang , Xubo Liu , Yiyang Hu , Guquang Jing

Training-free zero-shot composed image retrieval models are recently gaining increasing research interest due to their generalizability and flexibility in unseen multimodal retrieval. Recent LLM-based advances focus on generating the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Miaoge Li , Dongsheng Wang , Zening Sun , Jinsen Zhang , Wenhan Luo , Jingcai Guo

Composed Image Retrieval (CIR) facilitates image retrieval through a multimodal query consisting of a reference image and modification text. The reference image defines the retrieval context, while the modification text specifies desired…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Zixu Li , Zhiheng Fu , Yupeng Hu , Zhiwei Chen , Haokun Wen , Liqiang Nie

Recently, Zero-shot Sketch-based Image Retrieval (ZS-SBIR) has attracted the attention of the computer vision community due to it's real-world applications, and the more realistic and challenging setting than found in SBIR. ZS-SBIR inherits…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Osman Tursun , Simon Denman , Sridha Sridharan , Ethan Goan , Clinton Fookes

Composed Image Retrieval (CoIR) has recently gained popularity as a task that considers both text and image queries together, to search for relevant images in a database. Most CoIR approaches require manually annotated datasets, comprising…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lucas Ventura , Antoine Yang , Cordelia Schmid , Gül Varol