English
Related papers

Related papers: Generative Model for Zero-Shot Sketch-Based Image …

200 papers

Fine-grained image retrieval via hand-drawn sketches or textual descriptions remains a critical challenge due to inherent modality gaps. While hand-drawn sketches capture complex structural contours, they lack color and texture, which text…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Siyuan Wang , Hanchen Gao , Guangming Zhu , Jiang Lu , Yiyue Ma , Tianci Wu , Jincai Huang , Liang Zhang

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Haoxiang Zhang , He Jiang , Ziqiang Wang , Deqiang Cheng

The problem of zero-shot sketch-based image retrieval (ZS-SBIR) has achieved increasing attention due to its wide applications, e.g. e-commerce. Despite progress made in this field, previous works suffer from using imbalanced samples of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanwen Su , Ge Song , Jiyan Wang , Yuanbo Zhu

In this paper, we study the problem of zero-shot sketch-based image retrieval (ZS-SBIR). The prior methods tackle the problem in a two-modality setting with only category labels or even no textual information involved. However, the growing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Hanwen Su , Ge Song , Kai Huang , Jiyan Wang , Ming Yang

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo in a given query sketch. However, its widespread applicability is limited by the fact that it is difficult to draw a complete sketch…

Computer Vision and Pattern Recognition · Computer Science 2022-01-14 Dawei Dai , Xiaoyu Tang , Shuyin Xia , Yingge Liu , Guoyin Wang , Zizhong Chen

This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to-image diffusion models to seamlessly bridge the gap…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

We present an algorithm for searching image collections using free-hand sketches that describe the appearance and relative positions of multiple objects. Sketch based image retrieval (SBIR) methods predominantly match queries containing a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Alexander Black , Tu Bui , Long Mai , Hailin Jin , John Collomosse

The efficacy of zero-shot sketch-based image retrieval (ZS-SBIR) models is governed by two challenges. The immense distributions-gap between the sketches and the images requires a proper domain alignment. Moreover, the fine-grained nature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ushasi Chaudhuri , Ruchika Chavan , Biplab Banerjee , Anjan Dutta , Zeynep Akata

In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We are largely inspired by recent advances on foundation models and the unparalleled generalisation ability they seem to offer, but for the first time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

The study of neural generative models of human sketches is a fascinating contemporary modeling problem due to the links between sketch image generation and the human drawing process. The landmark SketchRNN provided breakthrough by…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Ayan Das , Yongxin Yang , Timothy Hospedales , Tao Xiang , Yi-Zhe Song

In this paper, we propose a novel abstraction-aware sketch-based image retrieval framework capable of handling sketch abstraction at varied levels. Prior works had mainly focused on tackling sub-factors such as drawing style and order, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Sketch-based image retrieval (SBIR) is a challenging task due to the large cross-domain gap between sketches and natural images. How to align abstract sketches and natural images into a common high-level semantic space remains a key problem…

Computer Vision and Pattern Recognition · Computer Science 2019-11-13 Jianjun Lei , Yuxin Song , Bo Peng , Zhanyu Ma , Ling Shao , Yi-Zhe Song

The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline{SBIR}). The zero-shot sketch-based image retrieval (\underline{ZS-SBIR}) is more…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hao Ren , Ziqiang Zheng , Yang Wu , Hong Lu , Yang Yang , Ying Shan , Sai-Kit Yeung

Zero-shot sketch-based image retrieval (ZSSBIR), as a popular studied branch of computer vision, attracts wide attention recently. Unlike sketch-based image retrieval (SBIR), the main aim of ZSSBIR is to retrieve natural images given free…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Guanglong Xu , Zhensheng Hu , Jia Cai

We propose and evaluate several triplet CNN architectures for measuring the similarity between sketches and photographs, within the context of the sketch based image retrieval (SBIR) task. In contrast to recent fine-grained SBIR work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Tu Bui , Leonardo Ribeiro , Moacir Ponti , John Collomosse

Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for searching natural images given free-hand sketches under the zero-shot scenario. Most existing methods solve this problem by simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Xinxun Xu , Muli Yang , Yanhua Yang , Hao Wang

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space. However, scalability is hindered by the growing complexity of solutions, mainly due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jianan Jiang , Hao Tang , Zhilin Jiang , Weiren Yu , Di Wu

This paper studies the problem of generalized zero-shot learning which requires the model to train on image-label pairs from some seen classes and test on the task of classifying new images from both seen and unseen classes. Most previous…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 He Huang , Changhu Wang , Philip S. Yu , Chang-Dong Wang

Deep generative models have shown great promise when it comes to synthesising novel images. While they can generate images that look convincing on a higher-level, generating fine-grained details is still a challenge. In order to foster…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Andrin Jenal , Nikolay Savinov , Torsten Sattler , Gaurav Chaurasia