English
Related papers

Related papers: Semi-Heterogeneous Three-Way Joint Embedding Netwo…

200 papers

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

The ability to retrieve a photo by mere free-hand sketching highlights the immense potential of Fine-grained sketch-based image retrieval (FG-SBIR). However, its rapid practical adoption, as well as scalability, is limited by the expense of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Himanshu Thakur , Soumitri Chattopadhyay

A fundamental challenge faced by existing Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) models is the data scarcity -- model performances are largely bottlenecked by the lack of sketch-photo pairs. Whilst the number of photos can be…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Yongxin Yang , Tao Xiang , Yi-Zhe Song

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch. Its widespread applicability is however hindered by the fact that drawing a sketch takes time,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Ayan Kumar Bhunia , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

In some specific scenarios, face sketch was used to identify a person. However, drawing a complete face sketch often needs skills and takes time, which hinder its widespread applicability in the practice. In this study, we proposed a new…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Dawei Dai , Yutang Li , Liang Wang , Shiyu Fu , Shuyin Xia , Guoyin Wang

In this paper, we investigate the problem of zero-shot sketch-based image retrieval (ZS-SBIR), where human sketches are used as queries to conduct retrieval of photos from unseen categories. We importantly advance prior arts by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Sounak Dey , Pau Riba , Anjan Dutta , Josep Llados , Yi-Zhe Song

In this paper, we study the problem of zero-shot sketch-based image retrieval (ZS-SBIR). The prior methods tackle the problem in a two-modality setting with only category labels or even no textual information involved. However, the growing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Hanwen Su , Ge Song , Kai Huang , Jiyan Wang , Ming Yang

Sketch as an image search query is an ideal alternative to text in capturing the fine-grained visual details. Prior successes on fine-grained sketch-based image retrieval (FG-SBIR) have demonstrated the importance of tackling the unique…

Computer Vision and Pattern Recognition · Computer Science 2020-08-12 Aneeshan Sain , Ayan Kumar Bhunia , Yongxin Yang , Tao Xiang , Yi-Zhe Song

Retrieving 3D models from 2D human sketches has received considerable attention in the areas of graphics, image retrieval, and computer vision. Almost always in state of the art approaches a large amount of "best views" are computed for 3D…

Computer Vision and Pattern Recognition · Computer Science 2015-04-15 Fang Wang , Le Kang , Yi Li

Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for searching natural images given free-hand sketches under the zero-shot scenario. Most existing methods solve this problem by simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Xinxun Xu , Muli Yang , Yanhua Yang , Hao Wang

In this paper, we delve into the intricate dynamics of Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) by addressing a critical yet overlooked aspect -- the choice of viewpoint during sketch creation. Unlike photo systems that…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Aneeshan Sain , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

Sketch-based image retrieval (SBIR) is the task of retrieving natural images (photos) that match the semantics and the spatial configuration of hand-drawn sketch queries. The universality of sketches extends the scope of possible…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Omar Seddati , Stéphane Dupont , Saïd Mahmoudi , Thierry Dutoit

With the widespread use of touch-screen devices, it is more and more convenient for people to draw sketches on screen. This results in the demand for automatically understanding the sketches. Thus, the sketch recognition task becomes more…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Lei Wang , Shihui Zhang , Huan He , Xiaoxiao Zhang , Yu Sang

Translating freehand sketches into photorealistic images remains a fundamental challenge in image synthesis, particularly due to the abstract, sparse, and stylistically diverse nature of sketches. Existing approaches, including GAN-based…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Ali Zia , Muhammad Umer Ramzan , Usman Ali , Muhammad Faheem , Abdelwahed Khamis , Shahnawaz Qureshi

In this paper we address the problem of learning robust cross-domain representations for sketch-based image retrieval (SBIR). While most SBIR approaches focus on extracting low- and mid-level descriptors for direct feature matching, recent…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Dan Xu , Xavier Alameda-Pineda , Jingkuan Song , Elisa Ricci , Nicu Sebe

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

This paper proposes a content based image retrieval (CBIR) system using the local colour and texture features of selected image sub-blocks and global colour and shape features of the image. The image sub-blocks are roughly identified by…

Information Retrieval · Computer Science 2013-07-08 E. R. Vimina , K. Poulose Jacob

Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Vaishnav Potlapalli , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by putting forward a strong baseline that overshoots prior state-of-the-arts by ~11%. This is not via complicated design though, but by addressing two…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Aneeshan Sain , Ayan Kumar Bhunia , Subhadeep Koley , Pinaki Nath Chowdhury , Soumitri Chattopadhyay , Tao Xiang , Yi-Zhe Song