English
Related papers

Related papers: Domain-Smoothing Network for Zero-Shot Sketch-Base…

200 papers

Sketch-based image retrieval (SBIR) is widely recognized as an important vision problem which implies a wide range of real-world applications. Recently, research interests arise in solving this problem under the more realistic and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Qing Liu , Lingxi Xie , Huiyu Wang , Alan Yuille

In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We are largely inspired by recent advances on foundation models and the unparalleled generalisation ability they seem to offer, but for the first time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

Sketch-Based Image Retrieval (SBIR) is a crucial task in multimedia retrieval, where the goal is to retrieve a set of images that match a given sketch query. Researchers have already proposed several well-performing solutions for this task,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Omar Seddati , Nathan Hubens , Stéphane Dupont , Thierry Dutoit

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Anjan Dutta , Zeynep Akata

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space. However, scalability is hindered by the growing complexity of solutions, mainly due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jianan Jiang , Hao Tang , Zhilin Jiang , Weiren Yu , Di Wu

The goal of Scene-level Sketch-Based Image Retrieval is to retrieve natural images matching the overall semantics and spatial layout of a free-hand sketch. Unlike prior work focused on architectural augmentations of retrieval models, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Emil Demić , Luka Čehovin Zajc

In this paper, we delve into the intricate dynamics of Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) by addressing a critical yet overlooked aspect -- the choice of viewpoint during sketch creation. Unlike photo systems that…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Aneeshan Sain , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

Effectively and efficiently retrieving images from remote sensing databases is a critical challenge in the realm of remote sensing big data. Utilizing hand-drawn sketches as retrieval inputs offers intuitive and user-friendly advantages,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Bo Yang , Chen Wang , Xiaoshuang Ma , Beiping Song , Zhuang Liu , Fangde Sun

Fine-grained image retrieval via hand-drawn sketches or textual descriptions remains a critical challenge due to inherent modality gaps. While hand-drawn sketches capture complex structural contours, they lack color and texture, which text…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Siyuan Wang , Hanchen Gao , Guangming Zhu , Jiang Lu , Yiyue Ma , Tianci Wu , Jincai Huang , Liang Zhang

We propose and evaluate several triplet CNN architectures for measuring the similarity between sketches and photographs, within the context of the sketch based image retrieval (SBIR) task. In contrast to recent fine-grained SBIR work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-07-30 Tu Bui , Leonardo Ribeiro , Moacir Ponti , John Collomosse

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch. Its widespread applicability is however hindered by the fact that drawing a sketch takes time,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Ayan Kumar Bhunia , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

In this paper, we propose a novel abstraction-aware sketch-based image retrieval framework capable of handling sketch abstraction at varied levels. Prior works had mainly focused on tackling sub-factors such as drawing style and order, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Sketch-based 3D shape retrieval is a challenging task due to the large domain discrepancy between sketches and 3D shapes. Since existing methods are trained and evaluated on the same categories, they cannot effectively recognize the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Rui Xu , Zongyan Han , Le Hui , Jianjun Qian , Jin Xie

In this paper, we study learning semantic representations for million-scale free-hand sketches. This is highly challenging due to the domain-unique traits of sketches, e.g., diverse, sparse, abstract, noisy. We propose a dual-branch CNNRNN…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Peng Xu , Yongye Huang , Tongtong Yuan , Tao Xiang , Timothy M. Hospedales , Yi-Zhe Song , Liang Wang

The recent focus on Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) has shifted towards generalising a model to new categories without any training data from them. In real-world applications, however, a trained FG-SBIR model is often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Ayan Kumar Bhunia , Aneeshan Sain , Parth Shah , Animesh Gupta , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve the target image based on a reference image and a text description without requiring in-distribution triplets for training. One prevalent approach follows the vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zining Chen , Zhicheng Zhao , Fei Su , Xiaoqin Zhang , Shijian Lu

Conventional existing retrieval methods in remote sensing (RS) are often based on a uni-modal data retrieval framework. In this work, we propose a novel inter-modal triplet-based zero-shot retrieval scheme utilizing a sketch-based…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Ushasi Chaudhuri , Biplab Banerjee , Avik Bhattacharya , Mihai Datcu

In some specific scenarios, face sketch was used to identify a person. However, drawing a complete face sketch often needs skills and takes time, which hinder its widespread applicability in the practice. In this study, we proposed a new…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Dawei Dai , Yutang Li , Liang Wang , Shiyu Fu , Shuyin Xia , Guoyin Wang

Resolution of the complex problem of image retrieval for diagram images has yet to be reached. Deep learning methods continue to excel in the fields of object detection and image classification applied to natural imagery. However, the…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Manish Bhattarai , Diane Oyen , Juan Castorena , Liping Yang , Brendt Wohlberg