English
Related papers

Related papers: InfoCIR: Multimedia Analysis for Composed Image Re…

200 papers

Controllable Image Captioning (CIC) -- generating natural language descriptions about images under the guidance of given control signals -- is one of the most promising directions towards next-generation captioning systems. Till now,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Zhen Wang , Jun Xiao , Yueting Zhuang , Fei Gao , Jian Shao , Long Chen

The composed image retrieval (CIR) task aims to retrieve the desired target image for a given multimodal query, i.e., a reference image with its corresponding modification text. The key limitations encountered by existing efforts are two…

Multimedia · Computer Science 2024-12-02 Haokun Wen , Xuemeng Song , Jianhua Yin , Jianlong Wu , Weili Guan , Liqiang Nie

Vision-language models like CLIP have demonstrated remarkable zero-shot capabilities in classification and retrieval. However, these models often struggle with compositional reasoning - the ability to understand the relationships between…

Machine Learning · Computer Science 2025-10-29 Amit Peleg , Naman Deep Singh , Matthias Hein

Chats emerge as an effective user-friendly approach for information retrieval, and are successfully employed in many domains, such as customer service, healthcare, and finance. However, existing image retrieval approaches typically address…

Computer Vision and Pattern Recognition · Computer Science 2023-10-06 Matan Levy , Rami Ben-Ari , Nir Darshan , Dani Lischinski

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

How well can Multimodal Large Language Models (MLLMs) understand composite images? Composite images (CIs) are synthetic visuals created by merging multiple visual elements, such as charts, posters, or screenshots, rather than being captured…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Xiaohui Chen , Satya Narayan Shukla , Mahmoud Azab , Aashu Singh , Qifan Wang , David Yang , ShengYun Peng , Hanchao Yu , Shen Yan , Xuewen Zhang , Baosheng He

Composed Image Retrieval (CIR) represents a novel retrieval paradigm that is capable of expressing users' intricate retrieval requirements flexibly. It enables the user to give a multimodal query, comprising a reference image and a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhiwei Chen , Yupeng Hu , Zixu Li , Zhiheng Fu , Xuemeng Song , Liqiang Nie

Composed Image Retrieval (CIR) aims to search an image of interest using a combination of a reference image and modification text as the query. Despite recent advancements, this task remains challenging due to limited training data and…

Information Retrieval · Computer Science 2025-04-09 Yinan Zhou , Yaxiong Wang , Haokun Lin , Chen Ma , Li Zhu , Zhedong Zheng

As a challenging vision-language (VL) task, Composed Image Retrieval (CIR) aims to retrieve target images using multimodal (image+text) queries. Although many existing CIR methods have attained promising performance, their reliance on…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haiwen Li , Delong Liu , Zhaohui Hou , Zhicheng Zhao , Fei Su

Composed Image Retrieval (CIR) allows users to search target images with a multimodal query, comprising a reference image and a modification text that describes the user's modification demand over the reference image. Nevertheless, due to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Haoqiang Lin , Haokun Wen , Xuemeng Song , Meng Liu , Yupeng Hu , Liqiang Nie

Composed Image Retrieval (CIR) aims to retrieve target images that closely resemble a reference image while integrating user-specified textual modifications, thereby capturing user intent more precisely. Existing training-free zero-shot CIR…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Yuanmin Tang , Xiaoting Qin , Jue Zhang , Jing Yu , Gaopeng Gou , Gang Xiong , Qingwei Ling , Saravan Rajmohan , Dongmei Zhang , Qi Wu

Content-Based Image Retrieval (CIR) aims to search for a target image by concurrently comprehending the composition of an example image and a complementary text, which potentially impacts a wide variety of real-world applications, such as…

Artificial Intelligence · Computer Science 2022-07-12 Wenqiao Zhang , Jiannan Guo , Mengze Li , Haochen Shi , Shengyu Zhang , Juncheng Li , Siliang Tang , Yueting Zhuang

The goal of Text-to-Image Person Retrieval (TIPR) is to retrieve specific person images according to the given textual descriptions. A primary challenge in this task is bridging the substantial representational gap between visual and…

Computation and Language · Computer Science 2025-01-20 Delong Liu , Haiwen Li , Zhicheng Zhao , Yuan Dong

Composed Image Retrieval (CIR) is a challenging multimodal task that retrieves a target image based on a reference image and accompanying modification text. Due to the high cost of annotating CIR triplet datasets, zero-shot (ZS) CIR has…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Yabing Wang , Zhuotao Tian , Qingpei Guo , Zheng Qin , Sanping Zhou , Ming Yang , Le Wang

Contrastive Language-Image Pretraining (CLIP) has demonstrated great zero-shot performance for matching images and text. However, it is still challenging to adapt vision-lanaguage pretrained models like CLIP to compositional image and text…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Kenan Jiang , Xuehai He , Ruize Xu , Xin Eric Wang

Image restoration, which aims to retrieve and enhance degraded images, is fundamental across a wide range of applications. While conventional deep learning approaches have notably improved the image quality across various tasks, they still…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Zilong Li , Yiming Lei , Chenglong Ma , Junping Zhang , Hongming Shan

Composed Image Retrieval (CIR) aims to retrieve images based on a query image with text. Current Zero-Shot CIR (ZS-CIR) methods try to solve CIR tasks without using expensive triplet-labeled training datasets. However, the gap between…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yingying Jiang , Hanchao Jia , Xiaobing Wang , Peng Hao

Composed Image Retrieval (CIR) is the task of retrieving a target image from a database using a multimodal query, which consists of a reference image and a modification text. The text specifies how to alter the reference image to form a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Tong Wang , Yunhan Zhao , Shu Kong

Composed Image Retrieval (CIR) aims to retrieve a target image from a query composed of a reference image and modification text. Recent training-free zero-shot methods often employ Multimodal Large Language Models (MLLMs) with…

Information Retrieval · Computer Science 2026-02-06 Yi Sun , Jinyu Xu , Qing Xie , Jiachen Li , Yanchun Ma , Yongjian Liu

Image enhancement is a significant research area in the fields of computer vision and image processing. In recent years, many learning-based methods for image enhancement have been developed, where the Look-up-table (LUT) has proven to be…

Computer Vision and Pattern Recognition · Computer Science 2023-11-23 Weiwen Chen , Qiuhong Ke , Zinuo Li