English
Related papers

Related papers: Simple but Effective Raw-Data Level Multimodal Fus…

200 papers

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images given a compositional query, consisting of a reference image and a modifying text-without relying on annotated training data. Existing approaches often generate a…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Rong-Cheng Tu , Wenhao Sun , Hanzhe You , Yingjie Wang , Jiaxing Huang , Li Shen , Dacheng Tao

Composed Image Retrieval (CIR) retrieves relevant images based on a reference image and accompanying text describing desired modifications. However, existing CIR methods only focus on retrieving the target image and disregard the relevance…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Jaehyun Kwak , Ramahdani Muhammad Izaaz Inhar , Se-Young Yun , Sung-Ju Lee

In tissue characterization and cancer diagnostics, multimodal imaging has emerged as a powerful technique. Thanks to computational advances, large datasets can be exploited to discover patterns in pathologies and improve diagnosis. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Eva Breznik , Elisabeth Wetzer , Joakim Lindblad , Nataša Sladoje

Composed Image Retrieval (CIR) presents a significant challenge as it requires jointly understanding a reference image and a modified textual instruction to find relevant target images. Some existing methods attempt to use a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jun Li , Hongjian Dou , Zhenyu Zhang , Kai Li , Shaoguo Liu , Tingting Gao

Composed Image Retrieval (CIR) aims to retrieve a target image from a query composed of a reference image and modification text. Recent training-free zero-shot methods often employ Multimodal Large Language Models (MLLMs) with…

Information Retrieval · Computer Science 2026-02-06 Yi Sun , Jinyu Xu , Qing Xie , Jiachen Li , Yanchun Ma , Yongjian Liu

This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image and a query text.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Huaying Zhang , Rintaro Yanagi , Ren Togo , Takahiro Ogawa , Miki Haseyama

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Retrieving fine-grained visual content based on user intent remains a challenge in multi-modal systems. Although current Composed Image Retrieval (CIR) methods combine reference images with retrieval texts, they are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tong Wang , Guanyu Yang , Nian Liu , Zongyan Han , Jinxing Zhou , Salman Khan , Fahad Shahbaz Khan

Composed Image Retrieval (CIR) represents a novel retrieval paradigm that is capable of expressing users' intricate retrieval requirements flexibly. It enables the user to give a multimodal query, comprising a reference image and a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Xuemeng Song , Liqiang Nie

Composed Image Retrieval (CIR) allows users to search target images with a multimodal query, comprising a reference image and a modification text that describes the user's modification demand over the reference image. Nevertheless, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Haoqiang Lin , Haokun Wen , Xuemeng Song , Meng Liu , Yupeng Hu , Liqiang Nie

Despite significant progress in Vision-Language Pre-training (VLP), current approaches predominantly emphasize feature extraction and cross-modal comprehension, with limited attention to generating or transforming visual content. This gap…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ziyang Zhang , Yang Yu , Yucheng Chen , Xulei Yang , Si Yong Yeo

Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as…

Artificial Intelligence · Computer Science 2022-07-12 Wenqiao Zhang , Jiannan Guo , Mengze Li , Haochen Shi , Shengyu Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

Text-to-image retrieval aims to find the relevant images based on a text query, which is important in various use-cases, such as digital libraries, e-commerce, and multimedia databases. Although Multimodal Large Language Models (MLLMs)…

Information Retrieval · Computer Science 2024-04-04 Zijun Long , Xuri Ge , Richard Mccreadie , Joemon Jose

Composed Image Retrieval (CIR) task aims to retrieve target images based on reference images and modification texts. Current CIR methods primarily rely on fine-tuning vision-language pre-trained models. However, we find that these…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Yizhuo Xu , Chaojian Yu , Yuanjie Shao , Tongliang Liu , Qinmu Peng , Xinge You

Composed image retrieval aims to find an image that best matches a given multi-modal user query consisting of a reference image and text pair. Existing methods commonly pre-compute image embeddings over the entire corpus and compare these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zheyuan Liu , Weixuan Sun , Damien Teney , Stephen Gould

Given an image and a target modification (e.g an image of the Eiffel tower and the text "without people and at night-time"), Compositional Image Retrieval (CIR) aims to retrieve the relevant target image in a database. While supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shyamgopal Karthik , Karsten Roth , Massimiliano Mancini , Zeynep Akata

Composed video retrieval (CoVR) is a challenging problem in computer vision which has recently highlighted the integration of modification text with visual queries for more sophisticated video search in large databases. Existing works…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Omkar Thawakar , Muzammal Naseer , Rao Muhammad Anwer , Salman Khan , Michael Felsberg , Mubarak Shah , Fahad Shahbaz Khan

Content Based Image Retrieval(CBIR) is one of the important subfield in the field of Information Retrieval. The goal of a CBIR algorithm is to retrieve semantically similar images in response to a query image submitted by the end user. CBIR…

Information Retrieval · Computer Science 2014-09-03 Vikas Verma

While weakly supervised multi-view face reconstruction (MVR) is garnering increased attention, one critical issue still remains open: how to effectively interact and fuse multiple image information to reconstruct high-precision 3D models.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Weiguang Zhao , Chaolong Yang , Jianan Ye , Rui Zhang , Yuyao Yan , Xi Yang , Bin Dong , Amir Hussain , Kaizhu Huang

This work introduces composed image retrieval to remote sensing. It allows to query a large image archive by image examples alternated by a textual description, enriching the descriptive power over unimodal queries, either visual or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bill Psomas , Ioannis Kakogeorgiou , Nikos Efthymiadis , Giorgos Tolias , Ondrej Chum , Yannis Avrithis , Konstantinos Karantzalos