English
Related papers

Related papers: Cross-Modal Attention Alignment Network with Auxil…

200 papers

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

The performance of a zero-shot sketch-based image retrieval (ZS-SBIR) task is primarily affected by two challenges. The substantial domain gap between image and sketch features needs to be bridged, while at the same time the side…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sumrit Gupta , Ushasi Chaudhuri , Biplab Banerjee

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a challenging cross-modal retrieval task. In prior arts, the retrieval is conducted by sorting the distance between the query sketch and each image in the gallery. However, the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuchen Wu , Kun Song , Fangzheng Zhao , Jiansheng Chen , Huimin Ma

Sketch-based image retrieval (SBIR) is challenging due to the inherent domain-gap between sketch and photo. Compared with pixel-perfect depictions of photos, sketches are iconic renderings of the real world with highly abstract. Therefore,…

Computer Vision and Pattern Recognition · Computer Science 2017-05-30 Peng Xu , Qiyue Yin , Yongye Huang , Yi-Zhe Song , Zhanyu Ma , Liang Wang , Tao Xiang , W. Bastiaan Kleijn , Jun Guo

Sketch-based image retrieval (SBIR) is the task of retrieving images from a natural image database that correspond to a given hand-drawn sketch. Ideally, an SBIR model should learn to associate components in the sketch (say, feet, tail,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Sasi Kiran Yelamarthi , Shiva Krishna Reddy , Ashish Mishra , Anurag Mittal

The goal of Sketch-Based Image Retrieval (SBIR) is using free-hand sketches to retrieve images of the same category from a natural image gallery. However, SBIR requires all test categories to be seen during training, which cannot be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Jiangtong Li , Zhixin Ling , Li Niu , Liqing Zhang

Zero-shot Composed Image Retrieval (ZS-CIR) aims to retrieve the target image based on a reference image and a text description without requiring in-distribution triplets for training. One prevalent approach follows the vision-language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Zining Chen , Zhicheng Zhao , Fei Su , Xiaoqin Zhang , Shijian Lu

Zero-shot sketch-based image retrieval (ZSSBIR), as a popular studied branch of computer vision, attracts wide attention recently. Unlike sketch-based image retrieval (SBIR), the main aim of ZSSBIR is to retrieve natural images given free…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Guanglong Xu , Zhensheng Hu , Jia Cai

Conventional approaches to Sketch-Based Image Retrieval (SBIR) assume that the data of all the classes are available during training. The assumption may not always be practical since the data of a few classes may be unavailable, or the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-22 Anubha Pandey , Ashish Mishra , Vinay Kumar Verma , Anurag Mittal , Hema A. Murthy

We address the challenges inherent in sketch-based image retrieval (SBIR) across various settings, including zero-shot SBIR, generalized zero-shot SBIR, and fine-grained zero-shot SBIR, by leveraging the vision-language foundation model…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Mainak Singha , Ankit Jha , Divyam Gupta , Pranav Singla , Biplab Banerjee

In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We are largely inspired by recent advances on foundation models and the unparalleled generalisation ability they seem to offer, but for the first time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

Composed Image Retrieval (CIR) aims to retrieve a target image from a query composed of a reference image and modification text. Recent training-free zero-shot methods often employ Multimodal Large Language Models (MLLMs) with…

Information Retrieval · Computer Science 2026-02-06 Yi Sun , Jinyu Xu , Qing Xie , Jiachen Li , Yanchun Ma , Yongjian Liu

The practical value of existing supervised sketch-based image retrieval (SBIR) algorithms is largely limited by the requirement for intensive data collection and labeling. In this paper, we present the first attempt at unsupervised SBIR to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Conghui Hu , Yongxin Yang , Yunpeng Li , Timothy M. Hospedales , Yi-Zhe Song

Zero-shot composed image retrieval (ZS-CIR) retrieves a target image from a reference image and a text modification without human-annotated CIR triplets. Projection-based ZS-CIR methods are attractive because they do not rely on LLMs at…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Mingyu Liu , Sihan Huang , Yijia Fan , Yinlin Yan , Quan Zhang , Jian-Fang Hu , Jianhuang Lai

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata

Effectively and efficiently retrieving images from remote sensing databases is a critical challenge in the realm of remote sensing big data. Utilizing hand-drawn sketches as retrieval inputs offers intuitive and user-friendly advantages,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Bo Yang , Chen Wang , Xiaoshuang Ma , Beiping Song , Zhuang Liu , Fangde Sun

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Haoxiang Zhang , He Jiang , Ziqiang Wang , Deqiang Cheng

Zero-Shot Hashing aims at learning a hashing model that is trained only by instances from seen categories but can generate well to those of unseen categories. Typically, it is achieved by utilizing a semantic embedding space to transfer…

Computer Vision and Pattern Recognition · Computer Science 2018-02-07 Zhong Ji , Yuxin Sun , Yunlong Yu , Yanwei Pang , Jungong Han

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng