English
Related papers

Related papers: Freeview Sketching: View-Aware Fine-Grained Sketch…

200 papers

This work aims to investigate the problem of 3D modeling using single free-hand sketches, which is one of the most natural ways we humans express ideas. Although sketch-based 3D modeling can drastically make the 3D modeling process more…

Multimedia · Computer Science 2023-12-08 Tianrun Chen , Chenglong Fu , Lanyun Zhu , Papa Mao , Jia Zhang , Ying Zang , Lingyun Sun

This paper tackles the Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) problem from the viewpoint of cross-modality metric learning. This task has two characteristics: 1) the zero-shot setting requires a metric space with good within-class…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Zongheng Huang , YiFan Sun , Chuchu Han , Changxin Gao , Nong Sang

The huge domain gap between sketches and photos and the highly abstract sketch representations pose challenges for sketch-based image retrieval (\underline{SBIR}). The zero-shot sketch-based image retrieval (\underline{ZS-SBIR}) is more…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hao Ren , Ziqiang Zheng , Yang Wu , Hong Lu , Yang Yang , Ying Shan , Sai-Kit Yeung

We study the underexplored but fundamental vision problem of machine understanding of abstract freehand scene sketches. We introduce a sketch encoder that results in semantically-aware feature space, which we evaluate by testing its…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Ahmed Bourouis , Judith Ellen Fan , Yulia Gryaditskaya

Representation learning for sketch-based image retrieval has mostly been tackled by learning embeddings that discard modality-specific information. As instances from different modalities can often provide complementary information…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Abhra Chaudhuri , Massimiliano Mancini , Yanbei Chen , Zeynep Akata , Anjan Dutta

Low-shot sketch-based image retrieval is an emerging task in computer vision, allowing to retrieve natural images relevant to hand-drawn sketch queries that are rarely seen during the training phase. Related prior works either require…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Anjan Dutta , Zeynep Akata

Sketches are highly expressive, inherently capturing subjective and fine-grained visual cues. The exploration of such innate properties of human sketches has, however, been limited to that of image retrieval. In this paper, for the first…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Pinaki Nath Chowdhury , Ayan Kumar Bhunia , Aneeshan Sain , Subhadeep Koley , Tao Xiang , Yi-Zhe Song

We study the practical task of fine-grained 3D-VR-sketch-based 3D shape retrieval. This task is of particular interest as 2D sketches were shown to be effective queries for 2D images. However, due to the domain gap, it remains hard to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Ling Luo , Yulia Gryaditskaya , Tao Xiang , Yi-Zhe Song

We consider feature selection for applications in machine learning where the dimensionality of the data is so large that it exceeds the working memory of the (local) computing machine. Unfortunately, current large-scale sketching algorithms…

Machine Learning · Computer Science 2021-05-27 Amirali Aghazadeh , Vipul Gupta , Alex DeWeese , O. Ozan Koyluoglu , Kannan Ramchandran

Sketch-based shape modeling aims to bridge the gap between 2D drawing and 3D modeling by providing an intuitive and accessible approach to create 3D shapes from 2D sketches. However, existing methods still suffer from limitations in…

Graphics · Computer Science 2023-09-13 Jie Zhou , Zhongjin Luo , Qian Yu , Xiaoguang Han , Hongbo Fu

This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to-image diffusion models to seamlessly bridge the gap…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Subhadeep Koley , Ayan Kumar Bhunia , Aneeshan Sain , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song

We tackle a new problem: generating geometrically consistent multi-view scenes from a single freehand sketch. Freehand sketches are the most geometrically impoverished input one could offer a multi-view generator. They convey scene intent…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Ahmed Bourouis , Savas Ozkan , Andrea Maracani , Yi-Zhe Song , Mete Ozay

In this paper, we study the problem of zero-shot sketch-based image retrieval (ZS-SBIR). The prior methods tackle the problem in a two-modality setting with only category labels or even no textual information involved. However, the growing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Hanwen Su , Ge Song , Kai Huang , Jiyan Wang , Ming Yang

Recently, encoders like ViT (vision transformer) and ResNet have been trained on vast datasets and utilized as perceptual metrics for comparing sketches and images, as well as multi-domain encoders in a zero-shot setting. However, there has…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Gianluca Berardi , Yulia Gryaditskaya

Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a challenging cross-modal retrieval task. In prior arts, the retrieval is conducted by sorting the distance between the query sketch and each image in the gallery. However, the domain gap…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yuchen Wu , Kun Song , Fangzheng Zhao , Jiansheng Chen , Huimin Ma

Fine-grained image retrieval (FGIR) is to learn visual representations that distinguish visually similar objects while maintaining generalization. Existing methods propose to generate discriminative features, but rarely consider the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Xin Jiang , Hao Tang , Rui Yan , Jinhui Tang , Zechao Li

Zero-Shot Sketch-Based Image Retrieval (ZSSBIR) is an emerging task. The pioneering work focused on the modal gap but ignored inter-class information. Although recent work has begun to consider the triplet-based or contrast-based loss to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-21 Haoxiang Zhang , He Jiang , Ziqiang Wang , Deqiang Cheng

The practical value of existing supervised sketch-based image retrieval (SBIR) algorithms is largely limited by the requirement for intensive data collection and labeling. In this paper, we present the first attempt at unsupervised SBIR to…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Conghui Hu , Yongxin Yang , Yunpeng Li , Timothy M. Hospedales , Yi-Zhe Song

Effectively and efficiently retrieving images from remote sensing databases is a critical challenge in the realm of remote sensing big data. Utilizing hand-drawn sketches as retrieval inputs offers intuitive and user-friendly advantages,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Bo Yang , Chen Wang , Xiaoshuang Ma , Beiping Song , Zhuang Liu , Fangde Sun

Keypoint detection, integral to modern machine perception, faces challenges in few-shot learning, particularly when source data from the same distribution as the query is unavailable. This gap is addressed by leveraging sketches, a popular…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Subhajit Maity , Ayan Kumar Bhunia , Subhadeep Koley , Pinaki Nath Chowdhury , Aneeshan Sain , Yi-Zhe Song