English
Related papers

Related papers: Zero-shot Composed Text-Image Retrieval

200 papers

Composed Image Retrieval (CIR) retrieves relevant images based on a reference image and accompanying text describing desired modifications. However, existing CIR methods only focus on retrieving the target image and disregard the relevance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Jaehyun Kwak , Ramahdani Muhammad Izaaz Inhar , Se-Young Yun , Sung-Ju Lee

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fengyin Lin , Mingkang Li , Da Li , Timothy Hospedales , Yi-Zhe Song , Yonggang Qi

Most of the research in content-based image retrieval (CBIR) focus on developing robust feature representations that can effectively retrieve instances from a database of images that are visually similar to a query. However, the retrieved…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Aishwarya Venkataramanan , Martin Laviale , Cédric Pradalier

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm that enables to retrieve target images based on multimodal queries consisting of reference images and modification texts. Although substantial progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Zhiwei Chen , Yupeng Hu , Zhiheng Fu , Zixu Li , Jiale Huang , Qinlei Huang , Yinwei Wei

Image and text retrieval is one of the foundational tasks in the vision and language domain with multiple real-world applications. State-of-the-art approaches, e.g. CLIP, ALIGN, represent images and texts as dense embeddings and calculate…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Chen Chen , Bowen Zhang , Liangliang Cao , Jiguang Shen , Tom Gunter , Albin Madappally Jose , Alexander Toshev , Jonathon Shlens , Ruoming Pang , Yinfei Yang

Contrastive Language-Image Pretraining (CLIP) has demonstrated great zero-shot performance for matching images and text. However, it is still challenging to adapt vision-lanaguage pretrained models like CLIP to compositional image and text…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Kenan Jiang , Xuehai He , Ruize Xu , Xin Eric Wang

Image restoration aims to recover degraded images. However, existing diffusion-based restoration methods, despite great success in natural image restoration, often struggle to faithfully reconstruct textual regions in degraded images. Those…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Jaewon Min , Jin Hyeon Kim , Paul Hyunbin Cho , Jaeeun Lee , Jihye Park , Minkyu Park , Sangpil Kim , Hyunhee Park , Seungryong Kim

How humans can effectively and efficiently acquire images has always been a perennial question. A classic solution is text-to-image retrieval from an existing database; however, the limited database typically lacks creativity. By contrast,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Leigang Qu , Haochuan Li , Tan Wang , Wenjie Wang , Yongqi Li , Liqiang Nie , Tat-Seng Chua

Recent text-to-image matching models apply contrastive learning to large corpora of uncurated pairs of images and sentences. While such models can provide a powerful score for matching and subsequent zero-shot tasks, they are not capable of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Yoad Tewel , Yoav Shalev , Idan Schwartz , Lior Wolf

Given a query and a document corpus, the information retrieval (IR) task is to output a ranked list of relevant documents. Combining large language models (LLMs) with embedding-based retrieval models, recent work shows promising results on…

Computation and Language · Computer Science 2023-11-01 Daman Arora , Anush Kini , Sayak Ray Chowdhury , Nagarajan Natarajan , Gaurav Sinha , Amit Sharma

The scalability, as well as the effectiveness, of the different Content-based Image Retrieval (CBIR) approaches proposed in literature, is today an important research issue. Given the wealth of images on the Web, CBIR systems must in fact…

Visible and near-infrared(NIR) band sensors provide images that capture complementary spectral radiations from a scene. And the fusion of the visible and NIR image aims at utilizing their spectrum properties to enhance image quality.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Zhuo Li , Bo Li

Image-based retrieval in large Earth observation archives is challenging because one needs to navigate across thousands of candidate matches only with the query image as a guide. By using text as information supporting the visual query, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Li Mi , Xianjie Dai , Javiera Castillo-Navarro , Devis Tuia

Content Based Image Retrieval(CBIR) is one of the important subfield in the field of Information Retrieval. The goal of a CBIR algorithm is to retrieve semantically similar images in response to a query image submitted by the end user. CBIR…

Information Retrieval · Computer Science 2014-09-03 Vikas Verma

Despite previous image restoration (IR) methods have often concentrated on isolated degradations, recent research has increasingly focused on addressing composite degradations involving a complex combination of multiple isolated…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Jin Cao , Deyu Meng , Xiangyong Cao

Composed Image Retrieval (CoIR) has recently gained popularity as a task that considers both text and image queries together, to search for relevant images in a database. Most CoIR approaches require manually annotated datasets, comprising…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Lucas Ventura , Antoine Yang , Cordelia Schmid , Gül Varol

Content-based image retrieval (CBIR) systems have emerged as crucial tools in the field of computer vision, allowing for image search based on visual content rather than relying solely on metadata. This survey paper presents a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Hamed Qazanfari , Mohammad M. AlyanNezhadi , Zohreh Nozari Khoshdaregi

Composed Image Retrieval (CIR) aims to retrieve target images based on a hybrid query comprising a reference image and a modification text. Early dual-tower Vision-Language Models (VLMs) struggle with cross-modality compositional reasoning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tianyu Yang , Chenwei He , Xiangzhao Hao , Tianyue Wang , Jiarui Guo , Haiyun Guo , Leigang Qu , Jinqiao Wang , Tat-Seng Chua

The computer vision community has developed numerous techniques for digitally restoring true scene information from single-view degraded photographs, an important yet extremely ill-posed task. In this work, we tackle image restoration from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yucheng Mao , Boyang Wang , Nilesh Kulkarni , Jeong Joon Park

The explosive increase and ubiquitous accessibility of visual data on the Web have led to the prosperity of research activity in image search or retrieval. With the ignorance of visual content as a ranking clue, methods with text search…

Multimedia · Computer Science 2017-09-05 Wengang Zhou , Houqiang Li , Qi Tian