English
Related papers

Related papers: Three-Stream Joint Network for Zero-Shot Sketch-Ba…

200 papers

The problem of zero-shot sketch-based image retrieval (ZS-SBIR) has achieved increasing attention due to its wide applications, e.g. e-commerce. Despite progress made in this field, previous works suffer from using imbalanced samples of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanwen Su , Ge Song , Jiyan Wang , Yuanbo Zhu

Zero-shot learning offers an efficient solution for a machine learning model to treat unseen categories, avoiding exhaustive data collection. Zero-shot Sketch-based Image Retrieval (ZS-SBIR) simulates real-world scenarios where it is hard…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Eunyi Lyou , Doyeon Lee , Jooeun Kim , Joonseok Lee

Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Vaishnav Potlapalli , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Sketch-based image retrieval (SBIR) is challenging due to the inherent domain-gap between sketch and photo. Compared with pixel-perfect depictions of photos, sketches are iconic renderings of the real world with highly abstract. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Peng Xu , Qiyue Yin , Yongye Huang , Yi-Zhe Song , Zhanyu Ma , Liang Wang , Tao Xiang , W. Bastiaan Kleijn , Jun Guo

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata

Conventional approaches to Sketch-Based Image Retrieval (SBIR) assume that the data of all the classes are available during training. The assumption may not always be practical since the data of a few classes may be unavailable, or the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Anubha Pandey , Ashish Mishra , Vinay Kumar Verma , Anurag Mittal , Hema A. Murthy

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We are largely inspired by recent advances on foundation models and the unparalleled generalisation ability they seem to offer, but for the first time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed with natural images. Work in this area mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Li Liu , Fumin Shen , Yuming Shen , Xianglong Liu , Ling Shao

We present a probabilistic model for Sketch-Based Image Retrieval (SBIR) where, at retrieval time, we are given sketches from novel classes, that were not present at training time. Existing SBIR methods, most of which rely on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Vinay Kumar Verma , Aakansha Mishra , Ashish Mishra , Piyush Rai

This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to-image diffusion models to seamlessly bridge the gap…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Anjan Dutta , Zeynep Akata

The practical value of existing supervised sketch-based image retrieval (SBIR) algorithms is largely limited by the requirement for intensive data collection and labeling. In this paper, we present the first attempt at unsupervised SBIR to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Conghui Hu , Yongxin Yang , Yunpeng Li , Timothy M. Hospedales , Yi-Zhe Song

We introduce a novel problem of scene sketch zero-shot learning (SSZSL), which is a challenging task, since (i) different from photo, the gap between common semantic domain (e.g., word vector) and sketch is too huge to exploit common…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Yao Xie , Peng Xu , Zhanyu Ma

This paper proposes a novel approach for Sketch-Based Image Retrieval (SBIR), for which the key is to bridge the gap between sketches and photos in terms of the data representation. Inspired by channel-wise attention explored in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Peng Lu , Gao Huang , Hangyu Lin , Wenming Yang , Guodong Guo , Yanwei Fu

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a challenging cross-modal retrieval task. In prior arts, the retrieval is conducted by sorting the distance between the query sketch and each image in the gallery. However, the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuchen Wu , Kun Song , Fangzheng Zhao , Jiansheng Chen , Huimin Ma

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

Sketch-based image retrieval (SBIR) is widely recognized as an important vision problem which implies a wide range of real-world applications. Recently, research interests arise in solving this problem under the more realistic and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Qing Liu , Lingxi Xie , Huiyu Wang , Alan Yuille

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee