English
Related papers

Related papers: Imagine and Seek: Improving Composed Image Retriev…

200 papers

Query images presented to content-based image retrieval systems often have various different interpretations, making it difficult to identify the search objective pursued by the user. We propose a technique for overcoming this ambiguity,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-06 Björn Barz , Joachim Denzler

Existing Multi-Turn Composed Image Retrieval (MTCIR) datasets lack dialogue-history consistency and are restricted to the fashion domain. To address these limitations, we construct CIRCLED by extending FashionIQ, CIRR, and CIRCO. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Tomohisa Takeda , Yu-Chieh Lin , Yuji Nozawa , Youyang Ng , Osamu Torii , Yusuke Matsui

Zero-shot Image Captioning (ZIC) increasingly utilizes synthetic datasets generated by text-to-image (T2I) models to mitigate the need for costly manual annotation. However, these T2I models often produce images that exhibit semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Si-Woo Kim , MinJu Jeon , Ye-Chan Kim , Soeun Lee , Taewhan Kim , Dong-Jin Kim

Composed Image Retrieval (CIR) uses a reference image and a modification text as a query to retrieve a target image satisfying the requirement of ``modifying the reference image according to the text instructions''. However, existing CIR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Guozhi Qiu , Zhiwei Chen , Zixu Li , Qinlei Huang , Zhiheng Fu , Xuemeng Song , Yupeng Hu

Composed Image Retrieval (CIR) is a flexible image retrieval paradigm that enables users to accurately locate the target image through a multimodal query composed of a reference image and modification text. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Zixu Li , Yupeng Hu , Zhiwei Chen , Shiqi Zhang , Qinlei Huang , Zhiheng Fu , Yinwei Wei

Composed Image Retrieval (CIR) requires both preserving the visual continuity of the reference image and faithfully executing the semantic variables specified in the modification text, which constitute the core challenge of the task.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Xingtian Pei , Yukun Song , Changwei Wang , Shunpeng Chen , Rongtao Xu , Shengpeng Xu , Shibiao Xu

Given a query and a document corpus, the information retrieval (IR) task is to output a ranked list of relevant documents. Combining large language models (LLMs) with embedding-based retrieval models, recent work shows promising results on…

Computation and Language · Computer Science 2023-11-01 Daman Arora , Anush Kini , Sayak Ray Chowdhury , Nagarajan Natarajan , Gaurav Sinha , Amit Sharma

The explosive increase and ubiquitous accessibility of visual data on the Web have led to the prosperity of research activity in image search or retrieval. With the ignorance of visual content as a ranking clue, methods with text search…

Multimedia · Computer Science 2017-09-05 Wengang Zhou , Houqiang Li , Qi Tian

Composed Image Retrieval (CIR) aims to retrieve target images based on a reference image and modified texts. However, existing methods often struggle to extract the correct semantic cues from the reference image that best reflect the user's…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Xuri Ge , Chunhao Wang , Xindi Wang , Zheyun Qin , Zhumin Chen , Xin Xin

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Anjan Dutta , Zeynep Akata

In this paper, we propose a novel framework for speech-image retrieval. We utilize speech-image contrastive (SIC) learning tasks to align speech and image representations at a coarse level and speech-image matching (SIM) learning tasks to…

Computation and Language · Computer Science 2024-09-12 Lifeng Zhou , Yuke Li

Basic group of visual techniques such as color, shape, texture are used in Content Based Image Retrievals (CBIR) to retrieve query image or subregion of image to find similar images in image database. To improve query result, relevance…

Computer Vision and Pattern Recognition · Computer Science 2015-08-28 Mohini P. Sardey , G. K. Kharate

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a challenging cross-modal retrieval task. In prior arts, the retrieval is conducted by sorting the distance between the query sketch and each image in the gallery. However, the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuchen Wu , Kun Song , Fangzheng Zhao , Jiansheng Chen , Huimin Ma

Content-based image retrieval (CBIR) is a task of retrieving images from their contents. Since retrieval process is a time-consuming task in large image databases, acceleration methods can be very useful. This paper presents a novel method…

Image and Video Processing · Electrical Eng. & Systems 2019-12-24 Sadegh Fadaei , Abdolreza Rashno , Elyas Rashno

Deep learning has demonstrated its power in image rectification by leveraging the representation capacity of deep neural networks via supervised training based on a large-scale synthetic dataset. However, the model may overfit the synthetic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jinlong Fan , Jing Zhang , Dacheng Tao

Retrieving fine-grained visual content based on user intent remains a challenge in multi-modal systems. Although current Composed Image Retrieval (CIR) methods combine reference images with retrieval texts, they are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tong Wang , Guanyu Yang , Nian Liu , Zongyan Han , Jinxing Zhou , Salman Khan , Fahad Shahbaz Khan

Lossy image coding standards such as JPEG and MPEG have successfully achieved high compression rates for human consumption of multimedia data. However, with the increasing prevalence of IoT devices, drones, and self-driving cars, machines…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Chen-Hsiu Huang , Ja-Ling Wu

Composed image retrieval aims to find an image that best matches a given multi-modal user query consisting of a reference image and text pair. Existing methods commonly pre-compute image embeddings over the entire corpus and compare these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zheyuan Liu , Weixuan Sun , Damien Teney , Stephen Gould

Composed video retrieval (CoVR) is a challenging problem in computer vision which has recently highlighted the integration of modification text with visual queries for more sophisticated video search in large databases. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omkar Thawakar , Muzammal Naseer , Rao Muhammad Anwer , Salman Khan , Michael Felsberg , Mubarak Shah , Fahad Shahbaz Khan

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm that enables to retrieve target images based on multimodal queries consisting of reference images and modification texts. Although substantial progress has been made…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Zhiwei Chen , Yupeng Hu , Zhiheng Fu , Zixu Li , Jiale Huang , Qinlei Huang , Yinwei Wei