English
Related papers

Related papers: Zero-shot Composed Image Retrieval Considering Que…

200 papers

Composed Image Retrieval (CIR) is a complex task that aims to retrieve images based on a multimodal query. Typical training data consists of triplets containing a reference image, a textual description of desired modifications, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chuong Huynh , Jinyu Yang , Ashish Tawari , Mubarak Shah , Son Tran , Raffay Hamid , Trishul Chilimbi , Abhinav Shrivastava

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata

Composed image retrieval (CIR) aims to retrieve a target image that depicts a reference image modified by a textual description. While recent vision-language models (VLMs) achieve promising CIR performance by embedding images and text into…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 François Gardères , Camille-Sovanneary Gauthier , Jean Ponce , Shizhe Chen

Composed image retrieval (CIR) addresses the task of retrieving a target image by jointly interpreting a reference image and a modification text that specifies the intended change. Most existing methods are still built upon contrastive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Geon Park , Ji-Hoon Park , Seong-Whan Lee

Image-Guided Retrieval with Optional Text (IGROT) is a general retrieval setting where a query consists of an anchor image, with or without accompanying text, aiming to retrieve semantically relevant target images. This formulation unifies…

Information Retrieval · Computer Science 2025-12-01 Hoang-Bao Le , Allie Tran , Binh T. Nguyen , Liting Zhou , Cathal Gurrin

Composed Image Retrieval (CIR) is a multimodal retrieval task where a query consists of a reference image and a textual modification, and the goal is to retrieve a target image satisfying both. In principle, strong performance on CIR…

The composed image retrieval (CIR) task aims to retrieve the desired target image for a given multimodal query, i.e., a reference image with its corresponding modification text. The key limitations encountered by existing efforts are two…

Multimedia · Computer Science 2024-12-02 Haokun Wen , Xuemeng Song , Jianhua Yin , Jianlong Wu , Weili Guan , Liqiang Nie

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images by integrating information from a composed query (reference image and modification text) without training samples. Existing methods primarily combine caption models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zelong Sun , Dong Jing , Zhiwu Lu

Composed Image Retrieval (CIR) enables fine-grained visual search by combining a reference image with a textual modification. While supervised CIR methods achieve high accuracy, their reliance on costly triplet annotations motivates…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Xin Wang , Haipeng Zhang , Mang Li , Zhaohui Xia , Yueguo Chen , Yu Zhang , Chunyu Wei

Composed Image Retrieval (CIR) uses a reference image plus a natural-language edit to retrieve images that apply the requested change while preserving other relevant visual content. Classic fusion pipelines typically rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guoyizhe Wei , Yang Jiao , Nan Xi , Zhishen Huang , Jingjing Meng , Rama Chellappa , Yan Gao

Sketch-based image retrieval (SBIR) is the task of retrieving images from a natural image database that correspond to a given hand-drawn sketch. Ideally, an SBIR model should learn to associate components in the sketch (say, feet, tail,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Sasi Kiran Yelamarthi , Shiva Krishna Reddy , Ashish Mishra , Anurag Mittal

Composed Image Retrieval (CIR) retrieves relevant images based on a reference image and accompanying text describing desired modifications. However, existing CIR methods only focus on retrieving the target image and disregard the relevance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Jaehyun Kwak , Ramahdani Muhammad Izaaz Inhar , Se-Young Yun , Sung-Ju Lee

Training-free zero-shot composed image retrieval models are recently gaining increasing research interest due to their generalizability and flexibility in unseen multimodal retrieval. Recent LLM-based advances focus on generating the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Miaoge Li , Dongsheng Wang , Zening Sun , Jinsen Zhang , Wenhan Luo , Jingcai Guo

Contrastive language-image pre-training (CLIP) has demonstrated remarkable zero-shot classification ability, namely image classification using novel text labels. Existing works have attempted to enhance CLIP by fine-tuning on downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Seongha Eom , Namgyu Ho , Jaehoon Oh , Se-Young Yun

Composed Image Retrieval (CIR), which aims to find a target image from a reference image and a modification text, presents the core challenge of performing unified reasoning across visual and semantic modalities. While current approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Weihuang Lin , Yiwei Ma , Jiayi Ji , Xiaoshuai Sun , Rongrong Ji

Most of the research in content-based image retrieval (CBIR) focus on developing robust feature representations that can effectively retrieve instances from a database of images that are visually similar to a query. However, the retrieved…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Aishwarya Venkataramanan , Martin Laviale , Cédric Pradalier

Composed Image Retrieval (CIR) seeks to find a target image using a multi-modal query, which combines an image with modification text to pinpoint the target. While recent CIR methods have shown promise, they mainly focus on exploring…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Peng Gao , Yujian Lee , Zailong Chen , Hui zhang , Xubo Liu , Yiyang Hu , Guquang Jing

The explosive increase and ubiquitous accessibility of visual data on the Web have led to the prosperity of research activity in image search or retrieval. With the ignorance of visual content as a ranking clue, methods with text search…

Multimedia · Computer Science 2017-09-05 Wengang Zhou , Houqiang Li , Qi Tian

Image-based retrieval in large Earth observation archives is challenging because one needs to navigate across thousands of candidate matches only with the query image as a guide. By using text as information supporting the visual query, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Li Mi , Xianjie Dai , Javiera Castillo-Navarro , Devis Tuia

Recent text-to-image matching models apply contrastive learning to large corpora of uncurated pairs of images and sentences. While such models can provide a powerful score for matching and subsequent zero-shot tasks, they are not capable of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yoad Tewel , Yoav Shalev , Idan Schwartz , Lior Wolf