English
Related papers

Related papers: Dual Relation Alignment for Composed Image Retriev…

200 papers

Composed Image Retrieval (CIR) involves searching for target images based on an image-text pair query. While current methods treat this as a query-target matching problem, we argue that CIR triplets contain additional associations beyond…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Xintong Jiang , Yaxiong Wang , Mengjian Li , Yujiao Wu , Bingwen Hu , Xueming Qian

Composed image retrieval searches for a target image based on a multi-modal user query comprised of a reference image and modification text describing the desired changes. Existing approaches to solving this challenging task learn a mapping…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zheyuan Liu , Weixuan Sun , Yicong Hong , Damien Teney , Stephen Gould

Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption. Given that recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Alberto Baldrati , Marco Bertini , Tiberio Uricchio , Alberto del Bimbo

Composed image retrieval which combines a reference image and a text modifier to identify the desired target image is a challenging task, and requires the model to comprehend both vision and language modalities and their interactions.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Shu Zhao , Huijuan Xu

Composed image retrieval aims to find an image that best matches a given multi-modal user query consisting of a reference image and text pair. Existing methods commonly pre-compute image embeddings over the entire corpus and compare these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Zheyuan Liu , Weixuan Sun , Damien Teney , Stephen Gould

Common image-text joint understanding techniques presume that images and the associated text can universally be characterized by a single implicit model. However, co-occurring images and text can be related in qualitatively different ways,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Malihe Alikhani , Fangda Han , Hareesh Ravi , Mubbasir Kapadia , Vladimir Pavlovic , Matthew Stone

Text-to-image person retrieval aims to identify the target person based on a given textual description query. The primary challenge is to learn the mapping of visual and textual modalities into a common latent space. Prior works have…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Ding Jiang , Mang Ye

Composed image retrieval (CIR) is a new and flexible image retrieval paradigm, which can retrieve the target image for a multimodal query, including a reference image and its corresponding modification text. Although existing efforts have…

Multimedia · Computer Science 2023-09-06 Haokun Wen , Xian Zhang , Xuemeng Song , Yinwei Wei , Liqiang Nie

Image-text matching is a key multimodal task that aims to model the semantic association between images and text as a matching relationship. With the advent of the multimedia information age, image, and text data show explosive growth, and…

Machine Learning · Computer Science 2024-06-24 Jinyin Wang , Haijing Zhang , Yihao Zhong , Yingbin Liang , Rongwei Ji , Yiru Cang

We investigate composed image retrieval with text feedback. Users gradually look for the target of interest by moving from coarse to fine-grained feedback. However, existing methods merely focus on the latter, i.e., fine-grained search, by…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Yiyang Chen , Zhedong Zheng , Wei Ji , Leigang Qu , Tat-Seng Chua

Composed Image Retrieval (CIR) is a challenging image retrieval paradigm. It aims to retrieve target images from large-scale image databases that are consistent with the modification semantics, based on a multimodal query composed of a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Mingyu Zhang , Zixu Li , Zhiwei Chen , Zhiheng Fu , Xiaowei Zhu , Jiajia Nie , Yinwei Wei , Yupeng Hu

Image to image translation aims to learn a mapping that transforms an image from one visual domain to another. Recent works assume that images descriptors can be disentangled into a domain-invariant content representation and a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Raul Gomez , Yahui Liu , Marco De Nadai , Dimosthenis Karatzas , Bruno Lepri , Nicu Sebe

Text-guided image retrieval is to incorporate conditional text to better capture users' intent. Traditionally, the existing methods focus on minimizing the embedding distances between the source inputs and the targeted image, using the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Junyang Chen , Hanjiang Lai

An intuitive way to search for images is to use queries composed of an example image and a complementary text. While the first provides rich and implicit context for the search, the latter explicitly calls for new traits, or specifies how…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Ginger Delmas , Rafael Sampaio de Rezende , Gabriela Csurka , Diane Larlus

Image-text retrieval is a central problem for understanding the semantic relationship between vision and language, and serves as the basis for various visual and language tasks. Most previous works either simply learn coarse-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chong Liu , Yuqi Zhang , Hongsong Wang , Weihua Chen , Fan Wang , Yan Huang , Yi-Dong Shen , Liang Wang

Composed Image Retrieval (CIR) retrieves target images using a multi-modal query that combines a reference image with text describing desired modifications. The primary challenge is effectively fusing this visual and textual information.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Chaoyang Wang , Zeyu Zhang , Long Teng , Zijun Li , Shichao Kan

Cross-modal retrieval between visual data and natural language description remains a long-standing challenge in multimedia. While recent image-text retrieval methods offer great promise by learning deep representations aligned across…

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

Image-Text Matching is one major task in cross-modal information processing. The main challenge is to learn the unified visual and textual representations. Previous methods that perform well on this task primarily focus on not only the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-23 Keyu Wen , Xiaodong Gu , Qingrong Cheng

This work introduces composed image retrieval to remote sensing. It allows to query a large image archive by image examples alternated by a textual description, enriching the descriptive power over unimodal queries, either visual or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Bill Psomas , Ioannis Kakogeorgiou , Nikos Efthymiadis , Giorgos Tolias , Ondrej Chum , Yannis Avrithis , Konstantinos Karantzalos
‹ Prev 1 2 3 10 Next ›