English
Related papers

Related papers: ConText-CIR: Learning from Concepts in Text for Co…

200 papers

This work addresses composed image retrieval in the context of domain conversion, where the content of a query image is retrieved in the domain specified by the query text. We show that a strong vision-language model provides sufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Nikos Efthymiadis , Bill Psomas , Zakaria Laskar , Konstantinos Karantzalos , Yannis Avrithis , Ondřej Chum , Giorgos Tolias

Given an image and a target modification (e.g an image of the Eiffel tower and the text "without people and at night-time"), Compositional Image Retrieval (CIR) aims to retrieve the relevant target image in a database. While supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Composed Image Retrieval (CIR) is a task that retrieves images similar to a query, based on a provided textual modification. Current techniques rely on supervised learning for CIR models using labeled triplets of the reference image, text,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Young Kyun Jang , Donghyun Kim , Zihang Meng , Dat Huynh , Ser-Nam Lim

Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xintong Jiang , Yaxiong Wang , Mengjian Li , Yujiao Wu , Bingwen Hu , Xueming Qian

Zero-shot composed image retrieval (ZS-CIR), which takes a textual modification and a reference image as a query to retrieve a target image without triplet labeling, has gained more and more attention in data mining. Current ZS-CIR research…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Junyang Chen , Hanjiang Lai

Retrieval is being redefined by agentic AI, demanding multimodal reasoning beyond conventional similarity-based paradigms. Composed Image Retrieval (CIR) exemplifies this shift as each query combines a reference image with textual…

Information Retrieval · Computer Science 2026-03-02 Zhongyu Yang , Wei Pang , Yingfang Yuan

Composed Image Retrieval (CIR) is a pivotal and complex task in multimodal understanding. Current CIR benchmarks typically feature limited query categories and fail to capture the diverse requirements of real-world scenarios. To bridge this…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Tingyu Song , Yanzhao Zhang , Mingxin Li , Zhuoning Guo , Dingkun Long , Pengjun Xie , Siyue Zhang , Yilun Zhao , Shu Wu

Composed Image Retrieval (CIR) aims to retrieve target images by integrating a reference image with a corresponding modification text. CIR requires jointly considering the explicit semantics specified in the query and the implicit semantics…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Jiyoung Lim , Heejae Yang , Jee-Hyong Lee

We extend the task of composed image retrieval, where an input query consists of an image and short textual description of how to modify the image. Existing methods have only been applied to non-complex images within narrow domains, such as…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Zheyuan Liu , Cristian Rodriguez-Opazo , Damien Teney , Stephen Gould

In this paper, we study the compositional learning of images and texts for image retrieval. The query is given in the form of an image and text that describes the desired modifications to the image; the goal is to retrieve the target image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Minchul Shin , Yoonjae Cho , Byungsoo Ko , Geonmo Gu

Composed Image Retrieval (CIR) is a complex task that retrieves images using a query, which is configured with an image and a caption that describes desired modifications to that image. Supervised CIR approaches have shown strong…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Young Kyun Jang , Dat Huynh , Ashish Shah , Wen-Kai Chen , Ser-Nam Lim

Composed image retrieval (CIR) is a vision language task that retrieves a target image using a reference image and modification text, enabling intuitive specification of desired changes. While effectively fusing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Young-Eun Kim , Seong-Whan Lee

Composed Image Retrieval (CIR) enables users to search for target images using both a reference image and manipulation text, offering substantial advantages over single-modality retrieval systems. However, existing CIR methods suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Zhipeng Qian , Zihan Liang , Yufei Ma , Ben Chen , Huangyu Dai , Yiwei Ma , Jiayi Ji , Chenyi Lei , Han Li , Xiaoshuai Sun

Albeit progress has been made in Composed Image Retrieval (CIR), we empirically find that a certain percentage of failure retrieval results are not consistent with their relative captions. To address this issue, this work provides a Visual…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Chun-Mei Feng , Yang Bai , Tao Luo , Zhen Li , Salman Khan , Wangmeng Zuo , Xinxing Xu , Rick Siow Mong Goh , Yong Liu

Composed image retrieval (CIR) aims to retrieve the target image based on a multimodal query, i.e., a reference image paired with corresponding modification text. Recent CIR studies leverage vision-language pre-trained (VLP) methods as the…

Multimedia · Computer Science 2024-04-25 Haokun Wen , Xuemeng Song , Xiaolin Chen , Yinwei Wei , Liqiang Nie , Tat-Seng Chua

Composed Image Retrieval (CIR) retrieves relevant images based on a reference image and accompanying text describing desired modifications. However, existing CIR methods only focus on retrieving the target image and disregard the relevance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Jaehyun Kwak , Ramahdani Muhammad Izaaz Inhar , Se-Young Yun , Sung-Ju Lee

The explosive increase and ubiquitous accessibility of visual data on the Web have led to the prosperity of research activity in image search or retrieval. With the ignorance of visual content as a ranking clue, methods with text search…

Multimedia · Computer Science 2017-09-05 Wengang Zhou , Houqiang Li , Qi Tian

Retrieving fine-grained visual content based on user intent remains a challenge in multi-modal systems. Although current Composed Image Retrieval (CIR) methods combine reference images with retrieval texts, they are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tong Wang , Guanyu Yang , Nian Liu , Zongyan Han , Jinxing Zhou , Salman Khan , Fahad Shahbaz Khan

Content Based Image Retrieval(CBIR) is one of the important subfield in the field of Information Retrieval. The goal of a CBIR algorithm is to retrieve semantically similar images in response to a query image submitted by the end user. CBIR…

Information Retrieval · Computer Science 2014-09-03 Vikas Verma