English
Related papers

Related papers: Transformers and CNNs both Beat Humans on SBIR

200 papers

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fengyin Lin , Mingkang Li , Da Li , Timothy Hospedales , Yi-Zhe Song , Yonggang Qi

Sketch-based image retrieval (SBIR) relies on free-hand sketches to retrieve natural photos within the same class. However, its practical application is limited by its inability to retrieve classes absent from the training set. To address…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yang Liu , Jiale Du , Xinbo Gao , Jungong Han

In some specific scenarios, face sketch was used to identify a person. However, drawing a complete face sketch often needs skills and takes time, which hinder its widespread applicability in the practice. In this study, we proposed a new…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Dawei Dai , Yutang Li , Liang Wang , Shiyu Fu , Shuyin Xia , Guoyin Wang

Conventional approaches to Sketch-Based Image Retrieval (SBIR) assume that the data of all the classes are available during training. The assumption may not always be practical since the data of a few classes may be unavailable, or the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Anubha Pandey , Ashish Mishra , Vinay Kumar Verma , Anurag Mittal , Hema A. Murthy

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims at finding a specific image from a large gallery given a query sketch. Despite the widespread applicability of FG-SBIR in many critical domains (e.g., crime activity tracking),…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Dingrong Wang , Hitesh Sapkota , Xumin Liu , Qi Yu

The ability to retrieve a photo by mere free-hand sketching highlights the immense potential of Fine-grained sketch-based image retrieval (FG-SBIR). However, its rapid practical adoption, as well as scalability, is limited by the expense of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Himanshu Thakur , Soumitri Chattopadhyay

As sketch research has collectively matured over time, its adaptation for at-mass commercialisation emerges on the immediate horizon. Despite an already mature research endeavour for photos, there is no research on the efficient inference…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Aneeshan Sain , Subhajit Maity , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

In specific scenarios, face sketch can be used to identify a person. However, drawing a face sketch often requires exceptional skill and is time-consuming, limiting its widespread applications in actual scenarios. The new framework of…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Liang Wang , Dawei Dai , Shiyu Fu , Guoyin Wang

Zero-shot sketch-based image retrieval (ZS-SBIR) is a task of cross-domain image retrieval from a natural image gallery with free-hand sketch under a zero-shot scenario. Previous works mostly focus on a generative approach that takes a…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Hao Wang , Cheng Deng , Xinxu Xu , Wei Liu , Xinbo Gao , Dacheng Tao

Architectures based on siamese networks with triplet loss have shown outstanding performance on the image-based similarity search problem. This approach attempts to discriminate between positive (relevant) and negative (irrelevant) items.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Anibal Fuentes , Jose M. Saavedra

Sketchformer is a novel transformer-based representation for encoding free-hand sketches input in a vector form, i.e. as a sequence of strokes. Sketchformer effectively addresses multiple tasks: sketch classification, sketch based image…

Computer Vision and Pattern Recognition · Computer Science 2020-02-25 Leo Sampaio Ferraz Ribeiro , Tu Bui , John Collomosse , Moacir Ponti

Retrieving 3D models from 2D human sketches has received considerable attention in the areas of graphics, image retrieval, and computer vision. Almost always in state of the art approaches a large amount of "best views" are computed for 3D…

Computer Vision and Pattern Recognition · Computer Science 2015-04-15 Fang Wang , Le Kang , Yi Li

Zero-shot sketch-based image retrieval (ZS-SBIR) is challenging due to the cross-domain nature of sketches and photos, as well as the semantic gap between seen and unseen image distributions. Previous methods fine-tune pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Shiyin Dong , Mingrui Zhu , Nannan Wang , Xinbo Gao

In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We are largely inspired by recent advances on foundation models and the unparalleled generalisation ability they seem to offer, but for the first time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Recent studies show that large-scale sketch-based image retrieval (SBIR) can be efficiently tackled by cross-modal binary representation learning methods, where Hamming distance matching significantly speeds up the process of similarity…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Yuming Shen , Li Liu , Fumin Shen , Ling Shao

In this paper, we investigate the problem of zero-shot sketch-based image retrieval (ZS-SBIR), where human sketches are used as queries to conduct retrieval of photos from unseen categories. We importantly advance prior arts by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Sounak Dey , Pau Riba , Anjan Dutta , Josep Llados , Yi-Zhe Song

The efficacy of zero-shot sketch-based image retrieval (ZS-SBIR) models is governed by two challenges. The immense distributions-gap between the sketches and the images requires a proper domain alignment. Moreover, the fine-grained nature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ushasi Chaudhuri , Ruchika Chavan , Biplab Banerjee , Anjan Dutta , Zeynep Akata

This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by putting forward a strong baseline that overshoots prior state-of-the-arts by ~11%. This is not via complicated design though, but by addressing two…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Aneeshan Sain , Ayan Kumar Bhunia , Subhadeep Koley , Pinaki Nath Chowdhury , Soumitri Chattopadhyay , Tao Xiang , Yi-Zhe Song