English
Related papers

Related papers: Modality-Aware Triplet Hard Mining for Zero-shot S…

200 papers

In this paper, we investigate the problem of zero-shot sketch-based image retrieval (ZS-SBIR), where human sketches are used as queries to conduct retrieval of photos from unseen categories. We importantly advance prior arts by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Sounak Dey , Pau Riba , Anjan Dutta , Josep Llados , Yi-Zhe Song

As a challenging vision-language task, Zero-Shot Composed Image Retrieval (ZS-CIR) is designed to retrieve target images using bi-modal (image+text) queries. Typical ZS-CIR methods employ an inversion network to generate pseudo-word tokens…

Computer Vision and Pattern Recognition · Computer Science 2025-08-07 Haiwen Li , Fei Su , Zhicheng Zhao

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

Conventional approaches to Sketch-Based Image Retrieval (SBIR) assume that the data of all the classes are available during training. The assumption may not always be practical since the data of a few classes may be unavailable, or the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Anubha Pandey , Ashish Mishra , Vinay Kumar Verma , Anurag Mittal , Hema A. Murthy

The performance of a zero-shot sketch-based image retrieval (ZS-SBIR) task is primarily affected by two challenges. The substantial domain gap between image and sketch features needs to be bridged, while at the same time the side…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sumrit Gupta , Ushasi Chaudhuri , Biplab Banerjee

Zero-shot sketch-based image retrieval typically asks for a trained model to be applied as is to unseen categories. In this paper, we question to argue that this setup by definition is not compatible with the inherent abstract and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Vaishnav Potlapalli , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

The recent focus on Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) has shifted towards generalising a model to new categories without any training data from them. In real-world applications, however, a trained FG-SBIR model is often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Ayan Kumar Bhunia , Aneeshan Sain , Parth Shah , Animesh Gupta , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

Zero-Shot learning has been shown to be an efficient strategy for domain adaptation. In this context, this paper builds on the recent work of Bucher et al. [1], which proposed an approach to solve Zero-Shot classification problems (ZSC) by…

Machine Learning · Computer Science 2016-08-29 Maxime Bucher , Stéphane Herbin , Frédéric Jurie

Composed image retrieval (CIR), which formulates the query as a combination of a reference image and modified text, has emerged as a new form of image search due to its enhanced ability to capture user intent. However, training a CIR model…

Computer Vision and Pattern Recognition · Computer Science 2025-04-25 Ren-Di Wu , Yu-Yen Lin , Huei-Fang Yang

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a challenging cross-modal retrieval task. In prior arts, the retrieval is conducted by sorting the distance between the query sketch and each image in the gallery. However, the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuchen Wu , Kun Song , Fangzheng Zhao , Jiansheng Chen , Huimin Ma

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline{SBIR}). The zero-shot sketch-based image retrieval (\underline{ZS-SBIR}) is more…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hao Ren , Ziqiang Zheng , Yang Wu , Hong Lu , Yang Yang , Ying Shan , Sai-Kit Yeung

Sketch-based image retrieval (SBIR) is widely recognized as an important vision problem which implies a wide range of real-world applications. Recently, research interests arise in solving this problem under the more realistic and…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Qing Liu , Lingxi Xie , Huiyu Wang , Alan Yuille

Sketch-Based Image Retrieval (SBIR) is a crucial task in multimedia retrieval, where the goal is to retrieve a set of images that match a given sketch query. Researchers have already proposed several well-performing solutions for this task,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Omar Seddati , Nathan Hubens , Stéphane Dupont , Thierry Dutoit

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Zero-shot sketch-based image retrieval (ZSSBIR), as a popular studied branch of computer vision, attracts wide attention recently. Unlike sketch-based image retrieval (SBIR), the main aim of ZSSBIR is to retrieve natural images given free…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Guanglong Xu , Zhensheng Hu , Jia Cai

Zero-shot learning (ZSL) for image classification focuses on recognizing novel categories that have no labeled data available for training. The learning is generally carried out with the help of mid-level semantic descriptors associated…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Debasmit Das , C. S. George Lee

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve a target image given a reference image and a relative text, without relying on costly triplet annotations. Existing CLIP-based methods face two core challenges: (1) union-based…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuqi Xiao , Yingying Zhu

The efficacy of zero-shot sketch-based image retrieval (ZS-SBIR) models is governed by two challenges. The immense distributions-gap between the sketches and the images requires a proper domain alignment. Moreover, the fine-grained nature…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ushasi Chaudhuri , Ruchika Chavan , Biplab Banerjee , Anjan Dutta , Zeynep Akata

This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by putting forward a strong baseline that overshoots prior state-of-the-arts by ~11%. This is not via complicated design though, but by addressing two…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Aneeshan Sain , Ayan Kumar Bhunia , Subhadeep Koley , Pinaki Nath Chowdhury , Soumitri Chattopadhyay , Tao Xiang , Yi-Zhe Song