English
Related papers

Related papers: Bi-directional Training for Composed Image Retriev…

200 papers

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Composed image retrieval aims to find an image that best matches a given multi-modal user query consisting of a reference image and text pair. Existing methods commonly pre-compute image embeddings over the entire corpus and compare these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zheyuan Liu , Weixuan Sun , Damien Teney , Stephen Gould

Composed image retrieval (CIR) is the task of retrieving a target image specified by a query image and a relative text that describes a semantic modification to the query image. Existing methods in CIR struggle to accurately represent the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Eric Xing , Pranavi Kolouju , Robert Pless , Abby Stylianou , Nathan Jacobs

Composed image retrieval (CIR) is a new and flexible image retrieval paradigm, which can retrieve the target image for a multimodal query, including a reference image and its corresponding modification text. Although existing efforts have…

Multimedia · Computer Science 2023-09-06 Haokun Wen , Xian Zhang , Xuemeng Song , Yinwei Wei , Liqiang Nie

Composed image retrieval, a task involving the search for a target image using a reference image and a complementary text as the query, has witnessed significant advancements owing to the progress made in cross-modal modeling. Unlike the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Xintong Jiang , Yaxiong Wang , Yujiao Wu , Meng Wang , Xueming Qian

Composed Image Retrieval (CIR) involves retrieving a target image based on a composed query of an image paired with text that specifies modifications or changes to the visual reference. CIR is inherently an instruction-following task, as…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Wenliang Zhong , Weizhi An , Feng Jiang , Hehuan Ma , Yuzhi Guo , Junzhou Huang

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Composed Image Retrieval (CIR) retrieves target images using a multi-modal query that combines a reference image with text describing desired modifications. The primary challenge is effectively fusing this visual and textual information.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Chaoyang Wang , Zeyu Zhang , Long Teng , Zijun Li , Shichao Kan

Composed Image Retrieval (CIR) is a multimodal retrieval task where a query consists of a reference image and a textual modification, and the goal is to retrieve a target image satisfying both. In principle, strong performance on CIR…

This work addresses composed image retrieval in the context of domain conversion, where the content of a query image is retrieved in the domain specified by the query text. We show that a strong vision-language model provides sufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Nikos Efthymiadis , Bill Psomas , Zakaria Laskar , Konstantinos Karantzalos , Yannis Avrithis , Ondřej Chum , Giorgos Tolias

In this paper, we study the compositional learning of images and texts for image retrieval. The query is given in the form of an image and text that describes the desired modifications to the image; the goal is to retrieve the target image…

Computer Vision and Pattern Recognition · Computer Science 2021-10-27 Minchul Shin , Yoonjae Cho , Byungsoo Ko , Geonmo Gu

Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as…

Artificial Intelligence · Computer Science 2022-07-12 Wenqiao Zhang , Jiannan Guo , Mengze Li , Haochen Shi , Shengyu Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

The composed image retrieval (CIR) task aims to retrieve the desired target image for a given multimodal query, i.e., a reference image with its corresponding modification text. The key limitations encountered by existing efforts are two…

Multimedia · Computer Science 2024-12-02 Haokun Wen , Xuemeng Song , Jianhua Yin , Jianlong Wu , Weili Guan , Liqiang Nie

Composed Image Retrieval (CIR) is a challenging multimodal task that retrieves a target image based on a reference image and accompanying modification text. Due to the high cost of annotating CIR triplet datasets, zero-shot (ZS) CIR has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yabing Wang , Zhuotao Tian , Qingpei Guo , Zheng Qin , Sanping Zhou , Ming Yang , Le Wang

Image retrieval with hybrid-modality queries, also known as composing text and image for image retrieval (CTI-IR), is a retrieval task where the search intention is expressed in a more complex query format, involving both vision and text…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yida Zhao , Yuqing Song , Qin Jin

In this paper, we investigate the problem of retrieving images from a database based on a multi-modal (image-text) query. Specifically, the query text prompts some modification in the query image and the task is to retrieve images with the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Muhammad Umer Anwaar , Egor Labintcev , Martin Kleinsteuber

Image-based single-modality compression learning approaches have demonstrated exceptionally powerful encoding and decoding capabilities in the past few years , but suffer from blur and severe semantics loss at extremely low bitrates. To…

Image and Video Processing · Electrical Eng. & Systems 2023-04-27 Xuhao Jiang , Weimin Tan , Tian Tan , Bo Yan , Liquan Shen

In Composed Image Retrieval (CIR), a user combines a query image with text to describe their intended target. Existing methods rely on supervised learning of CIR models using labeled triplets consisting of the query image, text…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Kuniaki Saito , Kihyuk Sohn , Xiang Zhang , Chun-Liang Li , Chen-Yu Lee , Kate Saenko , Tomas Pfister

The goal of Text-to-Image Person Retrieval (TIPR) is to retrieve specific person images according to the given textual descriptions. A primary challenge in this task is bridging the substantial representational gap between visual and…

Computation and Language · Computer Science 2025-01-20 Delong Liu , Haiwen Li , Zhicheng Zhao , Yuan Dong

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chong Liu , Yuqi Zhang , Hongsong Wang , Weihua Chen , Fan Wang , Yan Huang , Yi-Dong Shen , Liang Wang
‹ Prev 1 2 3 10 Next ›