English
Related papers

Related papers: Doodle to Search: Practical Zero-Shot Sketch-based…

200 papers

Rising concerns about privacy and anonymity preservation of deep learning models have facilitated research in data-free learning (DFL). For the first time, we identify that for data-scarce tasks like Sketch-Based Image Retrieval (SBIR),…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Abhra Chaudhuri , Ayan Kumar Bhunia , Yi-Zhe Song , Anjan Dutta

In this paper, we study the problem of zero-shot sketch-based image retrieval (ZS-SBIR). The prior methods tackle the problem in a two-modality setting with only category labels or even no textual information involved. However, the growing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Hanwen Su , Ge Song , Kai Huang , Jiyan Wang , Ming Yang

Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed with natural images. Work in this area mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Li Liu , Fumin Shen , Yuming Shen , Xianglong Liu , Ling Shao

We propose a novel framework for cross-modal zero-shot learning (ZSL) in the context of sketch-based image retrieval (SBIR). Conventionally, the SBIR schema mainly considers simultaneous mappings among the two image views and the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Ushasi Chaudhuri , Biplab Banerjee , Avik Bhattacharya , Mihai Datcu

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch. Its widespread applicability is however hindered by the fact that drawing a sketch takes time,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Ayan Kumar Bhunia , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to-image diffusion models to seamlessly bridge the gap…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

We present a probabilistic model for Sketch-Based Image Retrieval (SBIR) where, at retrieval time, we are given sketches from novel classes, that were not present at training time. Existing SBIR methods, most of which rely on learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Vinay Kumar Verma , Aakansha Mishra , Ashish Mishra , Piyush Rai

The problem of zero-shot sketch-based image retrieval (ZS-SBIR) has achieved increasing attention due to its wide applications, e.g. e-commerce. Despite progress made in this field, previous works suffer from using imbalanced samples of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanwen Su , Ge Song , Jiyan Wang , Yuanbo Zhu

Sketch-based image retrieval (SBIR) is widely recognized as an important vision problem which implies a wide range of real-world applications. Recently, research interests arise in solving this problem under the more realistic and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Qing Liu , Lingxi Xie , Huiyu Wang , Alan Yuille

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Zero-shot sketch-based image retrieval (ZSSBIR), as a popular studied branch of computer vision, attracts wide attention recently. Unlike sketch-based image retrieval (SBIR), the main aim of ZSSBIR is to retrieve natural images given free…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Guanglong Xu , Zhensheng Hu , Jia Cai

Conventional approaches to Sketch-Based Image Retrieval (SBIR) assume that the data of all the classes are available during training. The assumption may not always be practical since the data of a few classes may be unavailable, or the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Anubha Pandey , Ashish Mishra , Vinay Kumar Verma , Anurag Mittal , Hema A. Murthy

The practical value of existing supervised sketch-based image retrieval (SBIR) algorithms is largely limited by the requirement for intensive data collection and labeling. In this paper, we present the first attempt at unsupervised SBIR to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Conghui Hu , Yongxin Yang , Yunpeng Li , Timothy M. Hospedales , Yi-Zhe Song

Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Vaishnav Potlapalli , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata

The ability to retrieve a photo by mere free-hand sketching highlights the immense potential of Fine-grained sketch-based image retrieval (FG-SBIR). However, its rapid practical adoption, as well as scalability, is limited by the expense of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Himanshu Thakur , Soumitri Chattopadhyay

Sketch-based image retrieval (SBIR) is a cross-modal matching problem which is typically solved by learning a joint embedding space where the semantic content shared between photo and sketch modalities are preserved. However, a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Aneeshan Sain , Ayan Kumar Bhunia , Yongxin Yang , Tao Xiang , Yi-Zhe Song

In this paper, we delve into the intricate dynamics of Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) by addressing a critical yet overlooked aspect -- the choice of viewpoint during sketch creation. Unlike photo systems that…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Aneeshan Sain , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song