English
Related papers

Related papers: Resolving Ambiguity in Composed Image Retrieval vi…

200 papers

Composed Image Retrieval (CIR) represents a novel retrieval paradigm that is capable of expressing users' intricate retrieval requirements flexibly. It enables the user to give a multimodal query, comprising a reference image and a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Xuemeng Song , Liqiang Nie

Composed Image Retrieval (CIR) is a complex task that aims to retrieve images based on a multimodal query. Typical training data consists of triplets containing a reference image, a textual description of desired modifications, and the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Chuong Huynh , Jinyu Yang , Ashish Tawari , Mubarak Shah , Son Tran , Raffay Hamid , Trishul Chilimbi , Abhinav Shrivastava

Personalized conversational information retrieval (CIR) systems aim to satisfy users' complex information needs through multi-turn interactions by considering user profiles. However, not all search queries require personalization. The…

Information Retrieval · Computer Science 2025-08-13 Fengran Mo , Yuchen Hui , Yuxing Tian , Zhaoxuan Tan , Chuan Meng , Zhan Su , Kaiyu Huang , Jian-Yun Nie

Chats emerge as an effective user-friendly approach for information retrieval, and are successfully employed in many domains, such as customer service, healthcare, and finance. However, existing image retrieval approaches typically address…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Matan Levy , Rami Ben-Ari , Nir Darshan , Dani Lischinski

Composed image retrieval (CIR), which formulates the query as a combination of a reference image and modified text, has emerged as a new form of image search due to its enhanced ability to capture user intent. However, training a CIR model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ren-Di Wu , Yu-Yen Lin , Huei-Fang Yang

Composed Image Retrieval (CIR) has attracted significant attention due to its flexible multimodal query method, yet its development is severely constrained by the Noisy Triplet Correspondence (NTC) problem. Most existing robust learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Zhiheng Fu , Yupeng Hu , Qianyun Yang , Shiqi Zhang , Zhiwei Chen , Zixu Li

Despite recent progress on conversational systems, they still do not perform smoothly and coherently when faced with ambiguous requests. When questions are unclear, conversational systems should have the ability to ask clarifying questions,…

Information Retrieval · Computer Science 2022-08-10 Negar Arabzadeh , Mahsa Seifikar , Charles L. A. Clarke

Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent across domain, scene, object, and attribute. The key challenge for ZS-CIR tasks is to modify a reference image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gang Xiong , Gaopeng Gou , Qi Wu

Composed image retrieval (CIR) is a vision language task that retrieves a target image using a reference image and modification text, enabling intuitive specification of desired changes. While effectively fusing visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Young-Eun Kim , Seong-Whan Lee

The composed image retrieval (CIR) task aims to retrieve the desired target image for a given multimodal query, i.e., a reference image with its corresponding modification text. The key limitations encountered by existing efforts are two…

Multimedia · Computer Science 2024-12-02 Haokun Wen , Xuemeng Song , Jianhua Yin , Jianlong Wu , Weili Guan , Liqiang Nie

Composed Image Retrieval (CIR) uses a reference image and a modification text as a query to retrieve a target image satisfying the requirement of ``modifying the reference image according to the text instructions''. However, existing CIR…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Guozhi Qiu , Zhiwei Chen , Zixu Li , Qinlei Huang , Zhiheng Fu , Xuemeng Song , Yupeng Hu

Composed Image Retrieval (CIR) is the task of retrieving a target image from a gallery using a composed query consisting of a reference image and a modification text. Among various CIR approaches, training-free zero-shot methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Seong-Whan Lee

Retrieving user-specified objects from complex scenes remains a challenging task, especially when queries are ambiguous or involve multiple similar objects. Existing open-vocabulary detectors operate in a one-shot manner, lacking the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Pourya Shamsolmoali , Masoumeh Zareapoor , Eric Granger , Yue Lu

Composed Image Retrieval (CIR) aims to retrieve images based on a query image with text. Current Zero-Shot CIR (ZS-CIR) methods try to solve CIR tasks without using expensive triplet-labeled training datasets. However, the gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yingying Jiang , Hanchao Jia , Xiaobing Wang , Peng Hao

The task of composed image retrieval (CIR) aims to retrieve images based on the query image and the text describing the users' intent. Existing methods have made great progress with the advanced large vision-language (VL) model in CIR task,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yongchao Du , Min Wang , Wengang Zhou , Shuping Hui , Houqiang Li

Composed image retrieval extends content-based image retrieval systems by enabling users to search using reference images and captions that describe their intention. Despite great progress in developing image-text compositors to extract…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xu Zhang , Zhedong Zheng , Linchao Zhu , Yi Yang

Content Based Image Retrieval(CBIR) is one of the important subfield in the field of Information Retrieval. The goal of a CBIR algorithm is to retrieve semantically similar images in response to a query image submitted by the end user. CBIR…

Information Retrieval · Computer Science 2014-09-03 Vikas Verma

We investigate composed image retrieval with text feedback. Users gradually look for the target of interest by moving from coarse to fine-grained feedback. However, existing methods merely focus on the latter, i.e., fine-grained search, by…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Yiyang Chen , Zhedong Zheng , Wei Ji , Leigang Qu , Tat-Seng Chua

The task of Composed Image Retrieval (CoIR) involves queries that combine image and text modalities, allowing users to express their intent more effectively. However, current CoIR datasets are orders of magnitude smaller compared to other…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Matan Levy , Rami Ben-Ari , Nir Darshan , Dani Lischinski

Using natural language to query visual information is a fundamental need in real-world applications. Text-Image Retrieval (TIR) retrieves a target image from a gallery based on an image-level description, while Referring Expression…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Xiangzhao Hao , Kuan Zhu , Hongyu Guo , Haiyun Guo , Ning Jiang , Quan Lu , Ming Tang , Jinqiao Wang