English
Related papers

Related papers: HINT: Composed Image Retrieval with Dual-path Comp…

200 papers

Zero-shot composed image retrieval (ZS-CIR) is a rapidly growing area with significant practical applications, allowing users to retrieve a target image by providing a reference image and a relative caption describing the desired…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yongcong Ye , Kai Zhang , Yanghai Zhang , Enhong Chen , Longfei Li , Jun Zhou

Composed Image Retrieval (CIR) presents a significant challenge as it requires jointly understanding a reference image and a modified textual instruction to find relevant target images. Some existing methods attempt to use a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Jun Li , Hongjian Dou , Zhenyu Zhang , Kai Li , Shaoguo Liu , Tingting Gao

In Composed Image Retrieval (CIR), a user combines a query image with text to describe their intended target. Existing methods rely on supervised learning of CIR models using labeled triplets consisting of the query image, text…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Kuniaki Saito , Kihyuk Sohn , Xiang Zhang , Chun-Liang Li , Chen-Yu Lee , Kate Saenko , Tomas Pfister

Composed image retrieval searches for a target image based on a multi-modal user query comprised of a reference image and modification text describing the desired changes. Existing approaches to solving this challenging task learn a mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zheyuan Liu , Weixuan Sun , Yicong Hong , Damien Teney , Stephen Gould

This paper proposes a novel zero-shot composed image retrieval (CIR) method considering the query-target relationship by masked image-text pairs. The objective of CIR is to retrieve the target image using a query image and a query text.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Huaying Zhang , Rintaro Yanagi , Ren Togo , Takahiro Ogawa , Miki Haseyama

Composed Image Retrieval (CIR) enables image retrieval by combining multiple query modalities, but existing benchmarks predominantly focus on general-domain imagery and rely on reference images with short textual modifications. As a result,…

Information Retrieval · Computer Science 2026-04-21 Jinyu Xu , Yi Sun , Jiangling Zhang , Qing Xie , Daomin Ji , Zhifeng Bao , Jiachen Li , Yanchun Ma , Yongjian Liu

In the early days, content-based image retrieval (CBIR) was studied with global features. Since 2003, image retrieval based on local descriptors (de facto SIFT) has been extensively studied for over a decade due to the advantage of SIFT in…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Liang Zheng , Yi Yang , Qi Tian

In analyzing vast amounts of digitally stored historical image data, existing content-based retrieval methods often overlook significant non-semantic information, limiting their effectiveness for flexible exploration across varied themes.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Tingyu Lin , Robert Sablatnig

This work introduces composed image retrieval to remote sensing. It allows to query a large image archive by image examples alternated by a textual description, enriching the descriptive power over unimodal queries, either visual or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bill Psomas , Ioannis Kakogeorgiou , Nikos Efthymiadis , Giorgos Tolias , Ondrej Chum , Yannis Avrithis , Konstantinos Karantzalos

Remote sensing composed image retrieval (RSCIR) enables search in large satellite image archives using composed queries that combine a reference image with a textual modifier. Although RSCIR offers a flexible interface for expressing…

Different from Composed Image Retrieval task that requires expensive labels for training task-specific models, Zero-Shot Composed Image Retrieval (ZS-CIR) involves diverse tasks with a broad range of visual content manipulation intent that…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yuanmin Tang , Jing Yu , Keke Gai , Jiamin Zhuang , Gang Xiong , Yue Hu , Qi Wu

The task of Composed Image Retrieval (CoIR) involves queries that combine image and text modalities, allowing users to express their intent more effectively. However, current CoIR datasets are orders of magnitude smaller compared to other…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Matan Levy , Rami Ben-Ari , Nir Darshan , Dani Lischinski

Image retrieval with hybrid-modality queries, also known as composing text and image for image retrieval (CTI-IR), is a retrieval task where the search intention is expressed in a more complex query format, involving both vision and text…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yida Zhao , Yuqing Song , Qin Jin

The objective of Content-Based Image Retrieval (CBIR) methods is essentially to extract, from large (image) databases, a specified number of images similar in visual and semantic content to a so-called query image. To bridge the semantic…

Information Retrieval · Computer Science 2015-02-12 Smarajit Bose , Amita Pal , Jhimli Mallick , Sunil Kumar , Pratyaydipta Rudra

Composed Image Retrieval (CIR) has made significant progress, yet current benchmarks are limited to single ground-truth answers and lack the annotations needed to evaluate false positive avoidance, robustness and multi-image reasoning. We…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Rohan Mahadev , Joyce Yuan , Patrick Poirson , David Xue , Hao-Yu Wu , Dmitry Kislyuk

Given a query consisting of a reference image and a relative caption, Composed Image Retrieval (CIR) aims to retrieve target images visually similar to the reference one while incorporating the changes specified in the relative caption. The…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Lorenzo Agnolucci , Alberto Baldrati , Alberto Del Bimbo , Marco Bertini

The Zero-shot Composed Image Retrieval (ZSCIR) requires retrieving images that match the query image and the relative captions. Current methods focus on projecting the query image into the text feature space, subsequently combining them…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 You Li , Fan Ma , Yi Yang

Cross-Domain Image Retrieval (CDIR) is a challenging task in computer vision, aiming to match images across different visual domains such as sketches, paintings, and photographs. Existing CDIR methods rely either on supervised learning with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Lucas Iijima , Nikolaos Giakoumoglou , Tania Stathaki

Retrieving fine-grained visual content based on user intent remains a challenge in multi-modal systems. Although current Composed Image Retrieval (CIR) methods combine reference images with retrieval texts, they are constrained to…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Tong Wang , Guanyu Yang , Nian Liu , Zongyan Han , Jinxing Zhou , Salman Khan , Fahad Shahbaz Khan

Composed Image Retrieval (CIR) is a complex task that retrieves images using a query, which is configured with an image and a caption that describes desired modifications to that image. Supervised CIR approaches have shown strong…

Computer Vision and Pattern Recognition · Computer Science 2024-05-02 Young Kyun Jang , Dat Huynh , Ashish Shah , Wen-Kai Chen , Ser-Nam Lim