English
Related papers

Related papers: Semantic-Aware Knowledge Preservation for Zero-Sho…

200 papers

Sketch-based image retrieval (SBIR) has undergone an increasing interest in the community of computer vision bringing high impact in real applications. For instance, SBIR brings an increased benefit to eCommerce search engines because it…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Pablo Torres , Jose M. Saavedra

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

This paper proposes a novel approach for Sketch-Based Image Retrieval (SBIR), for which the key is to bridge the gap between sketches and photos in terms of the data representation. Inspired by channel-wise attention explored in recent…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Peng Lu , Gao Huang , Hangyu Lin , Wenming Yang , Guodong Guo , Yanwei Fu

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims at finding a specific image from a large gallery given a query sketch. Despite the widespread applicability of FG-SBIR in many critical domains (e.g., crime activity tracking),…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Dingrong Wang , Hitesh Sapkota , Xumin Liu , Qi Yu

The goal of Scene-level Sketch-Based Image Retrieval is to retrieve natural images matching the overall semantics and spatial layout of a free-hand sketch. Unlike prior work focused on architectural augmentations of retrieval models, we…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Emil Demić , Luka Čehovin Zajc

Visual-semantic embedding is an interesting research topic because it is useful for various tasks, such as visual question answering (VQA), image-text retrieval, image captioning, and scene graph generation. In this paper, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-09-29 Kazuya Ueki

Fine-grained sketch-based image retrieval (FG-SBIR) addresses the problem of retrieving a particular photo instance given a user's query sketch. Its widespread applicability is however hindered by the fact that drawing a sketch takes time,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-13 Ayan Kumar Bhunia , Yongxin Yang , Timothy M. Hospedales , Tao Xiang , Yi-Zhe Song

In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We are largely inspired by recent advances on foundation models and the unparalleled generalisation ability they seem to offer, but for the first time…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Aneeshan Sain , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) aims to minimize the distance between sketches and corresponding images in the embedding space. However, scalability is hindered by the growing complexity of solutions, mainly due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jianan Jiang , Hao Tang , Zhilin Jiang , Weiren Yu , Di Wu

The problem of zero-shot sketch-based image retrieval (ZS-SBIR) has achieved increasing attention due to its wide applications, e.g. e-commerce. Despite progress made in this field, previous works suffer from using imbalanced samples of…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Hanwen Su , Ge Song , Jiyan Wang , Yuanbo Zhu

Zero-shot sketch-based image retrieval (ZSSBIR), as a popular studied branch of computer vision, attracts wide attention recently. Unlike sketch-based image retrieval (SBIR), the main aim of ZSSBIR is to retrieve natural images given free…

Computer Vision and Pattern Recognition · Computer Science 2022-02-14 Guanglong Xu , Zhensheng Hu , Jia Cai

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Haoxiang Zhang , He Jiang , Ziqiang Wang , Deqiang Cheng

We propose a novel approach to improve a visual-semantic embedding model by incorporating concept representations captured from an external structured knowledge base. We investigate its performance on image classification under both…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Mirantha Jayathilaka , Tingting Mu , Uli Sattler

We study the zero-shot Composed Image Retrieval (ZS-CIR) task, which is to retrieve the target image given a reference image and a description without training on the triplet datasets. Previous works generate pseudo-word tokens by…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Yucheng Suo , Fan Ma , Linchao Zhu , Yi Yang

Semantic Embeddings are a popular way to represent knowledge in the field of zero-shot learning. We observe their interpretability and discuss their potential utility in a safety-critical context. Concretely, we propose to use them to add…

Machine Learning · Statistics 2019-05-21 Thomas Brunner , Frederik Diehl , Michael Truong Le , Alois Knoll

A fundamental challenge faced by existing Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) models is the data scarcity -- model performances are largely bottlenecked by the lack of sketch-photo pairs. Whilst the number of photos can be…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Yongxin Yang , Tao Xiang , Yi-Zhe Song

Recently, AI-generated image detection has gained increasing attention, as the rapid advancement of image generation technologies has raised serious concerns about their potential misuse. While existing detection methods have achieved…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Ju Yeon Kang , Jaehong Park , Semin Kim , Ji Won Yoon , Nam Soo Kim

Sketch has been employed as an effective communicative tool to express the abstract and intuitive meanings of object. Recognizing the free-hand sketch drawing is extremely useful in many real-world applications. While content-based sketch…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Peng Lu , Hangyu Lin , Yanwei Fu , Shaogang Gong , Yu-Gang Jiang , Xiangyang Xue

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by putting forward a strong baseline that overshoots prior state-of-the-arts by ~11%. This is not via complicated design though, but by addressing two…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Aneeshan Sain , Ayan Kumar Bhunia , Subhadeep Koley , Pinaki Nath Chowdhury , Soumitri Chattopadhyay , Tao Xiang , Yi-Zhe Song