English
Related papers

Related papers: Transformers and CNNs both Beat Humans on SBIR

200 papers

In the early days, content-based image retrieval (CBIR) was studied with global features. Since 2003, image retrieval based on local descriptors (de facto SIFT) has been extensively studied for over a decade due to the advantage of SIFT in…

Computer Vision and Pattern Recognition · Computer Science 2017-05-24 Liang Zheng , Yi Yang , Qi Tian

The recent focus on Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) has shifted towards generalising a model to new categories without any training data from them. In real-world applications, however, a trained FG-SBIR model is often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-22 Ayan Kumar Bhunia , Aneeshan Sain , Parth Shah , Animesh Gupta , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

The Zero-Shot Sketch-based Image Retrieval (ZS-SBIR) is a challenging task because of the large domain gap between sketches and natural images as well as the semantic inconsistency between seen and unseen categories. Previous literature…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Yu-Wei Zhan , Xin Luo , Yongxin Wang , Zhen-Duo Chen , Xin-Shun Xu

We propose SketchINR, to advance the representation of vector sketches with implicit neural models. A variable length vector sketch is compressed into a latent space of fixed dimension that implicitly encodes the underlying shape as a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hmrishav Bandyopadhyay , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Tao Xiang , Timothy Hospedales , Yi-Zhe Song

To see is to sketch -- free-hand sketching naturally builds ties between human and machine vision. In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process. This is an…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Jifei Song , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy Hospedales

Sketch-based 3D shape retrieval (SBSR) is an important yet challenging task, which has drawn more and more attention in recent years. Existing approaches address the problem in a restricted setting, without appropriately simulating real…

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Sketch is an important media for human to communicate ideas, which reflects the superiority of human intelligence. Studies on sketch can be roughly summarized into recognition and generation. Existing models on image recognition failed to…

Computer Vision and Pattern Recognition · Computer Science 2017-09-14 Yajing Chen , Shikui Tu , Yuqi Yi , Lei Xu

The amount of medical images stored in hospitals is increasing faster than ever; however, utilizing the accumulated medical images has been limited. This is because existing content-based medical image retrieval (CBMIR) systems usually…

Image restoration is a long-standing low-level vision problem that aims to restore high-quality images from low-quality images (e.g., downscaled, noisy and compressed images). While state-of-the-art image restoration methods are based on…

Image and Video Processing · Electrical Eng. & Systems 2021-08-24 Jingyun Liang , Jiezhang Cao , Guolei Sun , Kai Zhang , Luc Van Gool , Radu Timofte

Content Based Image Retrieval(CBIR) is one of the important subfield in the field of Information Retrieval. The goal of a CBIR algorithm is to retrieve semantically similar images in response to a query image submitted by the end user. CBIR…

Information Retrieval · Computer Science 2014-09-03 Vikas Verma

In this paper we address the problem of learning robust cross-domain representations for sketch-based image retrieval (SBIR). While most SBIR approaches focus on extracting low- and mid-level descriptors for direct feature matching, recent…

Computer Vision and Pattern Recognition · Computer Science 2018-08-01 Dan Xu , Xavier Alameda-Pineda , Jingkuan Song , Elisa Ricci , Nicu Sebe

Sketches are highly expressive, inherently capturing subjective and fine-grained visual cues. The exploration of such innate properties of human sketches has, however, been limited to that of image retrieval. In this paper, for the first…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Pinaki Nath Chowdhury , Ayan Kumar Bhunia , Aneeshan Sain , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

This paper employs case-based reasoning (CBR) to capture the personal styles of individual artists and generate the human facial portraits from photos accordingly. For each human artist to be mimicked, a series of cases are firstly built-up…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Bingwen Jin , Songhua Xu , Weidong Geng

The ability of deep neural networks to continually learn and adapt to a sequence of tasks has remained challenging due to catastrophic forgetting of previously learned tasks. Humans, on the other hand, have a remarkable ability to acquire,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Kishaan Jeeveswaran , Prashant Bhat , Bahram Zonooz , Elahe Arani

Sketching is a powerful artistic technique for capturing essential visual information about real-world objects and has increasingly attracted attention in image synthesis research. However, the field lacks a unified benchmark to evaluate…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Xingyue Lin , Xingjian Hu , Shuai Peng , Jianhua Zhu , Liangcai Gao

Previous researches of sketches often considered sketches in pixel format and leveraged CNN based models in the sketch understanding. Fundamentally, a sketch is stored as a sequence of data points, a vector format representation, rather…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Hangyu Lin , Yanwei Fu , Yu-Gang Jiang , Xiangyang Xue

Non-native speakers with limited vocabulary often struggle to name specific objects despite being able to visualize them, e.g., people outside Australia searching for numbats. Further, users may want to search for such elusive objects with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Prajwal Gatti , Kshitij Parikh , Dhriti Prasanna Paul , Manish Gupta , Anand Mishra

Composed Image Retrieval (CIR) is a challenging task that aims to retrieve the target image with a multimodal query, i.e., a reference image, and its complementary modification text. As previous supervised or zero-shot learning paradigms…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Bohan Hou , Haoqiang Lin , Haokun Wen , Meng Liu , Mingzhu Xu , Xuemeng Song

We study the practical task of fine-grained 3D-VR-sketch-based 3D shape retrieval. This task is of particular interest as 2D sketches were shown to be effective queries for 2D images. However, due to the domain gap, it remains hard to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Ling Luo , Yulia Gryaditskaya , Tao Xiang , Yi-Zhe Song