English
Related papers

Related papers: What Can Human Sketches Do for Object Detection?

200 papers

In this paper, we propose a novel abstraction-aware sketch-based image retrieval framework capable of handling sketch abstraction at varied levels. Prior works had mainly focused on tackling sub-factors such as drawing style and order, we…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

We propose a novel framework for cross-modal zero-shot learning (ZSL) in the context of sketch-based image retrieval (SBIR). Conventionally, the SBIR schema mainly considers simultaneous mappings among the two image views and the semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Ushasi Chaudhuri , Biplab Banerjee , Avik Bhattacharya , Mihai Datcu

We introduce SketchYourSeg, a novel framework that establishes freehand sketches as a powerful query modality for subjective image segmentation across entire galleries through a single exemplar sketch. Unlike text prompts that struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Subhadeep Koley , Viswanatha Reddy Gajjala , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Ayan Kumar Bhunia , Yi-Zhe Song

We present a simple and efficient method based on deep learning to automatically decompose sketched objects into semantically valid parts. We train a deep neural network to transfer existing segmentations and labelings from 3D models to…

Graphics · Computer Science 2018-08-01 Lei Li , Hongbo Fu , Chiew-Lan Tai

Zero-shot sketch-based image retrieval (ZS-SBIR) is challenging due to the cross-domain nature of sketches and photos, as well as the semantic gap between seen and unseen image distributions. Previous methods fine-tune pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Shiyin Dong , Mingrui Zhu , Nannan Wang , Xinbo Gao

Sketch-based image retrieval (SBIR) is a cross-modal matching problem which is typically solved by learning a joint embedding space where the semantic content shared between photo and sketch modalities are preserved. However, a fundamental…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Aneeshan Sain , Ayan Kumar Bhunia , Yongxin Yang , Tao Xiang , Yi-Zhe Song

Sketching is a natural and effective visual communication medium commonly used in creative processes. Recent developments in deep-learning models drastically improved machines' ability in understanding and generating visual content. An…

Human-Computer Interaction · Computer Science 2021-11-22 Forrest Huang , Eldon Schoop , David Ha , Jeffrey Nichols , John Canny

The goal of Sketch-Based Image Retrieval (SBIR) is using free-hand sketches to retrieve images of the same category from a natural image gallery. However, SBIR requires all test categories to be seen during training, which cannot be…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Jiangtong Li , Zhixin Ling , Li Niu , Liqing Zhang

We propose SketchINR, to advance the representation of vector sketches with implicit neural models. A variable length vector sketch is compressed into a latent space of fixed dimension that implicitly encodes the underlying shape as a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Hmrishav Bandyopadhyay , Ayan Kumar Bhunia , Pinaki Nath Chowdhury , Aneeshan Sain , Tao Xiang , Timothy Hospedales , Yi-Zhe Song

Zero-shot sketch-based image retrieval (ZS-SBIR) is a specific cross-modal retrieval task for retrieving natural images with free-hand sketches under zero-shot scenario. Previous works mostly focus on modeling the correspondence between…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Xinxun Xu , Hao Wang , Leida Li , Cheng Deng

In this work we introduce a cross modal image retrieval system that allows both text and sketch as input modalities for the query. A cross-modal deep network architecture is formulated to jointly model the sketch and text input modalities…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Sounak Dey , Anjan Dutta , Suman K. Ghosh , Ernest Valveny , Josep Lladós , Umapada Pal

In this paper, we delve into the intricate dynamics of Fine-Grained Sketch-Based Image Retrieval (FG-SBIR) by addressing a critical yet overlooked aspect -- the choice of viewpoint during sketch creation. Unlike photo systems that…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Aneeshan Sain , Pinaki Nath Chowdhury , Subhadeep Koley , Ayan Kumar Bhunia , Yi-Zhe Song

Considering the existence of very large amount of available data repositories and reach to the very advanced system of hardware, systems meant for facial identification ave evolved enormously over the past few decades. Sketch recognition is…

Machine Learning · Computer Science 2019-11-20 Sukhada Chokkadi , Sannidhan M S , Sudeepa K B , Abhir Bhandary

Human free-hand sketches have been studied in various contexts including sketch recognition, synthesis and fine-grained sketch-based image retrieval (FG-SBIR). A fundamental challenge for sketch analysis is to deal with drastically…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Umar Riaz Muhammad , Yongxin Yang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this paper turns it into a photorealistic image - just like those shown in Fig. 1(a), all non-cherry-picked. We differ significantly from prior art in…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

While deep Embedding Learning approaches have witnessed widespread success in multiple computer vision tasks, the state-of-the-art methods for representing natural images need not necessarily perform well on images from other domains, such…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Ujjal Kr Dutta

With the involvement of artificial intelligence (AI), sketches can be automatically generated under certain topics. Even though breakthroughs have been made in previous studies in this area, a relatively high proportion of the generated…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Yunkui Pang , Zhiqing Pan , Ruiyang Sun , Shuchong Wang

Sketch-based image retrieval (SBIR) associates hand-drawn sketches with their corresponding realistic images. In this study, we aim to tackle two major challenges of this task simultaneously: i) zero-shot, dealing with unseen categories,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Liying Gao , Bingliang Jiao , Peng Wang , Shizhou Zhang , Hanwang Zhang , Yanning Zhang

Contemporary deep learning techniques have made image recognition a reasonably reliable technology. However training effective photo classifiers typically takes numerous examples which limits image recognition's scalability and…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Conghui Hu , Da Li , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales

Sketch drawings capture the salient information of visual concepts. Previous work has shown that neural networks are capable of producing sketches of natural objects drawn from a small number of classes. While earlier approaches focus on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Alexander Wang , Mengye Ren , Richard S. Zemel