English
Related papers

Related papers: Semantic Adversarial Network for Zero-Shot Sketch-…

200 papers

Sketch-based image retrieval (SBIR) is a challenging task due to the large cross-domain gap between sketches and natural images. How to align abstract sketches and natural images into a common high-level semantic space remains a key problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Jianjun Lei , Yuxin Song , Bo Peng , Zhanyu Ma , Ling Shao , Yi-Zhe Song

In this paper, we delve into the intricate dynamics of Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) by addressing a critical yet overlooked aspect -- the choice of viewpoint during sketch creation. Unlike photo systems that…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Aneeshan Sain , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch. Its widespread applicability is however hindered by the fact that drawing a sketch takes time,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Ayan Kumar Bhunia , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve the target image based on a reference image and a text description without requiring in-distribution triplets for training. One prevalent approach follows the vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zining Chen , Zhicheng Zhao , Fei Su , Xiaoqin Zhang , Shijian Lu

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims at finding a specific image from a large gallery given a query sketch. Despite the widespread applicability of FG-SBIR in many critical domains (e.g., crime activity tracking),…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Dingrong Wang , Hitesh Sapkota , Xumin Liu , Qi Yu

We introduce a novel problem of scene sketch zero-shot learning (SSZSL), which is a challenging task, since (i) different from photo, the gap between common semantic domain (e.g., word vector) and sketch is too huge to exploit common…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yao Xie , Peng Xu , Zhanyu Ma

We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yucheng Suo , Fan Ma , Linchao Zhu , Yi Yang

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Zero-shot composed image retrieval (ZS-CIR) retrieves a target image from a reference image and a text modification without human-annotated CIR triplets. Projection-based ZS-CIR methods are attractive because they do not rely on LLMs at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Mingyu Liu , Sihan Huang , Yijia Fan , Yinlin Yan , Quan Zhang , Jian-Fang Hu , Jianhuang Lai

The recent focus on Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) has shifted towards generalising a model to new categories without any training data from them. In real-world applications, however, a trained FG-SBIR model is often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Ayan Kumar Bhunia , Aneeshan Sain , Parth Shah , Animesh Gupta , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Composed Image Retrieval (CIR) aims to retrieve a target image from a query composed of a reference image and modification text. Recent training-free zero-shot methods often employ Multimodal Large Language Models (MLLMs) with…

Information Retrieval · Computer Science 2026-02-06 Yi Sun , Jinyu Xu , Qing Xie , Jiachen Li , Yanchun Ma , Yongjian Liu

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

The goal of Scene-level Sketch-Based Image Retrieval is to retrieve natural images matching the overall semantics and spatial layout of a free-hand sketch. Unlike prior work focused on architectural augmentations of retrieval models, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Emil Demić , Luka Čehovin Zajc

Zero-Shot Learning (ZSL) is an emerging research that aims to solve the classification problems with very few training data. The present works on ZSL mainly focus on the mapping of learning semantic space to visual space. It encounters many…

Computer Vision and Pattern Recognition · Computer Science 2021-03-01 Zeng Ting , Xiang Hongxin , Xie Cheng , Yang Yun , Liu Qing

Sketch-Based Image Retrieval (SBIR) is a crucial task in multimedia retrieval, where the goal is to retrieve a set of images that match a given sketch query. Researchers have already proposed several well-performing solutions for this task,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Omar Seddati , Nathan Hubens , Stéphane Dupont , Thierry Dutoit

Fine-grained image retrieval via hand-drawn sketches or textual descriptions remains a critical challenge due to inherent modality gaps. While hand-drawn sketches capture complex structural contours, they lack color and texture, which text…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Siyuan Wang , Hanchen Gao , Guangming Zhu , Jiang Lu , Yiyue Ma , Tianci Wu , Jincai Huang , Liang Zhang

Zero-shot composed image retrieval (ZS-CIR) is a rapidly growing area with significant practical applications, allowing users to retrieve a target image by providing a reference image and a relative caption describing the desired…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yongcong Ye , Kai Zhang , Yanghai Zhang , Enhong Chen , Longfei Li , Jun Zhou

Recently, many zero-shot learning (ZSL) methods focused on learning discriminative object features in an embedding feature space, however, the distributions of the unseen-class features learned by these methods are prone to be partly…

Computer Vision and Pattern Recognition · Computer Science 2020-09-01 Bo Liu , Qiulei Dong , Zhanyi Hu

Effectively and efficiently retrieving images from remote sensing databases is a critical challenge in the realm of remote sensing big data. Utilizing hand-drawn sketches as retrieval inputs offers intuitive and user-friendly advantages,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Bo Yang , Chen Wang , Xiaoshuang Ma , Beiping Song , Zhuang Liu , Fangde Sun

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space. However, scalability is hindered by the growing complexity of solutions, mainly due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jianan Jiang , Hao Tang , Zhilin Jiang , Weiren Yu , Di Wu