English
Related papers

Related papers: Sketch and Text Synergy: Fusing Structural Contour…

200 papers

Content Based Image Retrieval(CBIR) is one of the important subfield in the field of Information Retrieval. The goal of a CBIR algorithm is to retrieve semantically similar images in response to a query image submitted by the end user. CBIR…

Information Retrieval · Computer Science 2014-09-03 Vikas Verma

The Zero-Shot Sketch-based Image Retrieval (ZS-SBIR) is a challenging task because of the large domain gap between sketches and natural images as well as the semantic inconsistency between seen and unseen categories. Previous literature…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Yu-Wei Zhan , Xin Luo , Yongxin Wang , Zhen-Duo Chen , Xin-Shun Xu

The performance of a zero-shot sketch-based image retrieval (ZS-SBIR) task is primarily affected by two challenges. The substantial domain gap between image and sketch features needs to be bridged, while at the same time the side…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Sumrit Gupta , Ushasi Chaudhuri , Biplab Banerjee

Sketch-based image retrieval (SBIR) is the task of retrieving natural images (photos) that match the semantics and the spatial configuration of hand-drawn sketch queries. The universality of sketches extends the scope of possible…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Omar Seddati , Stéphane Dupont , Saïd Mahmoudi , Thierry Dutoit

In this paper, we investigate the problem of zero-shot sketch-based image retrieval (ZS-SBIR), where human sketches are used as queries to conduct retrieval of photos from unseen categories. We importantly advance prior arts by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Sounak Dey , Pau Riba , Anjan Dutta , Josep Llados , Yi-Zhe Song

This paper proposes a content based image retrieval (CBIR) system using the local colour and texture features of selected image sub-blocks and global colour and shape features of the image. The image sub-blocks are roughly identified by…

Information Retrieval · Computer Science 2013-07-08 E. R. Vimina , K. Poulose Jacob

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a novel cross-modal retrieval task, where abstract sketches are used as queries to retrieve natural images under zero-shot scenario. Most existing methods regard ZS-SBIR as a traditional…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Zhipeng Wang , Hao Wang , Jiexi Yan , Aming Wu , Cheng Deng

Despite the dominance of convolutional and transformer-based architectures in image-to-image retrieval, these models are prone to biases arising from low-level visual features, such as color. Recognizing the lack of semantic understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-05-23 Nikolaos Chaidos , Angeliki Dimitriou , Maria Lymperaiou , Giorgos Stamou

We address the problem of retrieving images with both a sketch and a text query. We present TASK-former (Text And SKetch transformer), an end-to-end trainable model for image retrieval using a text description and a sketch as input. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Patsorn Sangkloy , Wittawat Jitkrittum , Diyi Yang , James Hays

In this paper, we propose a new framework for improving Content Based Image Retrieval (CBIR) for texture images. This is achieved by using a new image representation based on the RCT-Plus transform which is a novel variant of the Redundant…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Asal Rouhafzay , Nadia Baaziz , Mohand Said Allili

Sketch-an-Anchor is a novel method to train state-of-the-art Zero-shot Sketch-based Image Retrieval (ZSSBIR) models in under an epoch. Most studies break down the problem of ZSSBIR into two parts: domain alignment between images and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

Scene text image super-resolution (STISR) has been regarded as an important pre-processing task for text recognition from low-resolution scene text images. Most recent approaches use the recognizer's feedback as clues to guide…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Minyi Zhao , Miao Wang , Fan Bai , Bingjia Li , Jie Wang , Shuigeng Zhou

We present an algorithm for searching image collections using free-hand sketches that describe the appearance and relative positions of multiple objects. Sketch based image retrieval (SBIR) methods predominantly match queries containing a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Alexander Black , Tu Bui , Long Mai , Hailin Jin , John Collomosse

Zero-shot sketch-based image retrieval (SBIR) is an emerging task in computer vision, allowing to retrieve natural images relevant to sketch queries that might not been seen in the training phase. Existing works either require aligned…

Computer Vision and Pattern Recognition · Computer Science 2019-03-11 Anjan Dutta , Zeynep Akata

This paper presents the first exploration of text-to-image diffusion models for zero-shot sketch-based 3D shape retrieval (ZS-SBSR). Existing sketch-based 3D shape retrieval methods struggle in zero-shot settings due to the absence of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Hang Cheng , Fanhe Dong , Long Zeng

In this paper, we study the problem of zero-shot sketch-based image retrieval (ZS-SBIR). The prior methods tackle the problem in a two-modality setting with only category labels or even no textual information involved. However, the growing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Hanwen Su , Ge Song , Kai Huang , Jiyan Wang , Ming Yang

Modelling human free-hand sketches has become topical recently, driven by practical applications such as fine-grained sketch based image retrieval (FG-SBIR). Sketches are clearly related to photo edge-maps, but a human free-hand sketch of a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Kaiyue Pang , Da Li , Jifei Song , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Fengyin Lin , Mingkang Li , Da Li , Timothy Hospedales , Yi-Zhe Song , Yonggang Qi

The goal of Text-to-Image Person Retrieval (TIPR) is to retrieve specific person images according to the given textual descriptions. A primary challenge in this task is bridging the substantial representational gap between visual and…

Computation and Language · Computer Science 2025-01-20 Delong Liu , Haiwen Li , Zhicheng Zhao , Yuan Dong

Image and text retrieval is one of the foundational tasks in the vision and language domain with multiple real-world applications. State-of-the-art approaches, e.g. CLIP, ALIGN, represent images and texts as dense embeddings and calculate…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Chen Chen , Bowen Zhang , Liangliang Cao , Jiguang Shen , Tom Gunter , Albin Madappally Jose , Alexander Toshev , Jonathon Shlens , Ruoming Pang , Yinfei Yang