English
Related papers

Related papers: Decoupling Endpoint and Semantic Transition Learni…

200 papers

Composed Image Retrieval (CIR) is an emerging yet challenging task that allows users to search for target images using a multimodal query, comprising a reference image and a modification text specifying the user's desired changes to the…

Multimedia · Computer Science 2025-03-05 Xuemeng Song , Haoqiang Lin , Haokun Wen , Bohan Hou , Mingzhu Xu , Liqiang Nie

Zero-Shot Composed Image Retrieval (ZS-CIR) aims to retrieve target images by integrating information from a composed query (reference image and modification text) without training samples. Existing methods primarily combine caption models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Zelong Sun , Dong Jing , Zhiwu Lu

This paper studies the problem of zero-shot sketch-based image retrieval (ZS-SBIR), which aims to use sketches from unseen categories as queries to match the images of the same category. Due to the large cross-modality discrepancy, ZS-SBIR…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Decheng Liu , Xu Luo , Chunlei Peng , Nannan Wang , Ruimin Hu , Xinbo Gao

Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for searching natural images given free-hand sketches under the zero-shot scenario. Most existing methods solve this problem by simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Xinxun Xu , Muli Yang , Yanhua Yang , Hao Wang

Zero-shot sketch-based image retrieval (ZS-SBIR) is a task of cross-domain image retrieval from a natural image gallery with free-hand sketch under a zero-shot scenario. Previous works mostly focus on a generative approach that takes a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Hao Wang , Cheng Deng , Xinxu Xu , Wei Liu , Xinbo Gao , Dacheng Tao

Composed image retrieval (CIR) is a new and flexible image retrieval paradigm, which can retrieve the target image for a multimodal query, including a reference image and its corresponding modification text. Although existing efforts have…

Multimedia · Computer Science 2023-09-06 Haokun Wen , Xian Zhang , Xuemeng Song , Yinwei Wei , Liqiang Nie

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fengyin Lin , Mingkang Li , Da Li , Timothy Hospedales , Yi-Zhe Song , Yonggang Qi

Compositional image retrieval (CIR) is a multimodal learning task where a model combines a query image with a user-provided text modification to retrieve a target image. CIR finds applications in a variety of domains including product…

Recently, Zero-shot Sketch-based Image Retrieval (ZS-SBIR) has attracted the attention of the computer vision community due to it's real-world applications, and the more realistic and challenging setting than found in SBIR. ZS-SBIR inherits…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Osman Tursun , Simon Denman , Sridha Sridharan , Ethan Goan , Clinton Fookes

Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for retrieving natural images with free-hand sketches under zero-shot scenario. Previous works mostly focus on modeling the correspondence between…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Xinxun Xu , Hao Wang , Leida Li , Cheng Deng

Composed Image Retrieval (CIR) aims to find a target image that aligns with user intent, expressed through a reference image and a modification text. While Zero-shot CIR (ZS-CIR) methods sidestep the need for labeled training data by…

Information Retrieval · Computer Science 2025-12-25 Youjin Jung , Seongwoo Cho , Hyun-seok Min , Sungchul Choi

Existing Zero-Shot Composed Image Retrieval (ZS-CIR) methods typically train adapters that convert reference images into pseudo-text tokens, which are concatenated with the modifying text and processed by frozen text encoders in pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Rong-Cheng Tu , Zhao Jin , Jingyi Liao , Xiao Luo , Yingjie Wang , Li Shen , Dacheng Tao

The Zero-shot Composed Image Retrieval (ZSCIR) requires retrieving images that match the query image and the relative captions. Current methods focus on projecting the query image into the text feature space, subsequently combining them…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 You Li , Fan Ma , Yi Yang

Composed Image Retrieval (CIR) uses a reference image plus a natural-language edit to retrieve images that apply the requested change while preserving other relevant visual content. Classic fusion pipelines typically rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Guoyizhe Wei , Yang Jiao , Nan Xi , Zhishen Huang , Jingjing Meng , Rama Chellappa , Yan Gao

Composed image retrieval (CIR) is the task of retrieving specific images by using a query that involves both a reference image and a relative caption. Most existing CIR models adopt the late-fusion strategy to combine visual and language…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Yang Bai , Xinxing Xu , Yong Liu , Salman Khan , Fahad Khan , Wangmeng Zuo , Rick Siow Mong Goh , Chun-Mei Feng

Composed Image Retrieval (CIR) is the task of retrieving a target image from a gallery using a composed query consisting of a reference image and a modification text. Among various CIR approaches, training-free zero-shot methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Jeong-Woo Park , Seong-Whan Lee

Composed Image Retrieval (CIR) retrieves target images using a multi-modal query that combines a reference image with text describing desired modifications. The primary challenge is effectively fusing this visual and textual information.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Chaoyang Wang , Zeyu Zhang , Long Teng , Zijun Li , Shichao Kan

In zero-shot image retrieval (ZSIR) task, embedding learning becomes more attractive, however, many methods follow the traditional metric learning idea and omit the problems behind zero-shot settings. In this paper, we first emphasize the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Binghui Chen , Weihong Deng

Zero-shot learning offers an efficient solution for a machine learning model to treat unseen categories, avoiding exhaustive data collection. Zero-shot Sketch-based Image Retrieval (ZS-SBIR) simulates real-world scenarios where it is hard…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Eunyi Lyou , Doyeon Lee , Jooeun Kim , Joonseok Lee

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata