English
Related papers

Related papers: Towards 3D VR-Sketch to 3D Shape Retrieval

200 papers

The requirement for 3D content is growing as AR/VR application emerges. At the same time, 3D modelling is only available for skillful experts, because traditional methods like Computer-Aided Design (CAD) are often too labor-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Ying Zang , Yidong Han , Chaotao Ding , Jianqi Zhang , Tianrun Chen

Multiple sketch datasets have been proposed to understand how people draw 3D objects. However, such datasets are often of small scale and cover a small set of objects or categories. In addition, these datasets contain freehand sketches…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Chufeng Xiao , Wanchao Su , Jing Liao , Zhouhui Lian , Yi-Zhe Song , Hongbo Fu

Sketch-based 3D shape retrieval (SBSR) is an important yet challenging task, which has drawn more and more attention in recent years. Existing approaches address the problem in a restricted setting, without appropriately simulating real…

As 3D models become critical in today's manufacturing and product design, conventional 3D modeling approaches based on Computer-Aided Design (CAD) are labor-intensive, time-consuming, and have high demands on the creators. This work aims to…

Multimedia · Computer Science 2023-10-31 Ying Zang , Chenglong Fu , Tianrun Chen , Yuanqi Hu , Qingshan Liu , Wenjun Hu

The rapid development of AR/VR brings tremendous demands for 3D content. While the widely-used Computer-Aided Design (CAD) method requires a time-consuming and labor-intensive modeling process, sketch-based 3D modeling offers a potential…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Tianrun Chen , Chenglong Fu , Ying Zang , Lanyun Zhu , Jia Zhang , Papa Mao , Lingyun Sun

This work aims to investigate the problem of 3D modeling using single free-hand sketches, which is one of the most natural ways we humans express ideas. Although sketch-based 3D modeling can drastically make the 3D modeling process more…

Multimedia · Computer Science 2023-12-08 Tianrun Chen , Chenglong Fu , Lanyun Zhu , Papa Mao , Jia Zhang , Ying Zang , Lingyun Sun

We address the problem of retrieving images with both a sketch and a text query. We present TASK-former (Text And SKetch transformer), an end-to-end trainable model for image retrieval using a text description and a sketch as input. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Patsorn Sangkloy , Wittawat Jitkrittum , Diyi Yang , James Hays

The retrieval of 3D objects has gained significant importance in recent years due to its broad range of applications in computer vision, computer graphics, virtual reality, and augmented reality. However, the retrieval of 3D objects…

We propose VRSketch2Gaussian, a first VR sketch-guided, multi-modal, native 3D object generation framework that incorporates a 3D Gaussian Splatting representation. As part of our work, we introduce VRSS, the first large-scale paired…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Songen Gu , Haoxuan Song , Binjie Liu , Qian Yu , Sanyi Zhang , Haiyong Jiang , Jin Huang , Feng Tian

A laser scanner can easily acquire the geometric data of physical environments in the form of a point cloud. Recognizing objects from a point cloud is often required for industrial 3D reconstruction, which should include not only geometry…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Hyungki Kim , Moohyun Cha , Duhwan Mun

Recently, image-to-3D approaches have achieved significant results with a natural image as input. However, it is not always possible to access these enriched color input samples in practical applications, where only sketches are available.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Wangguandong Zheng , Haifeng Xia , Rui Chen , Ming Shao , Siyu Xia , Zhengming Ding

Reconstructing a 3D shape based on a single sketch image is challenging due to the large domain gap between a sparse, irregular sketch and a regular, dense 3D shape. Existing works try to employ the global feature extracted from sketch to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Chenjian Gao , Qian Yu , Lu Sheng , Yi-Zhe Song , Dong Xu

3D face reconstruction from a single sketch is a critical yet underexplored task with significant practical applications. The primary challenges stem from the substantial modality gap between 2D sketches and 3D facial structures, including:…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Liting Wen , Zimo Yang , Xianlin Zhang , Chi Ding , Mingdao Wang , Xueming Li

We present a novel task: text-to-3D sketch animation, which aims to bring freeform sketches to life in dynamic 3D space. Unlike prior works focused on photorealistic content generation, we target sparse, stylized, and view-consistent 3D…

Graphics · Computer Science 2025-10-30 Hao Chen , Jiaqi Wang , Yonggang Qi , Ke Li , Kaiyue Pang , Yi-Zhe Song

We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were otherwise…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Peng Xu , Yongye Huang , Tongtong Yuan , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales , Zhanyu Ma , Jun Guo

3D textured face reconstruction from sketches applicable in many scenarios such as animation, 3D avatars, artistic design, missing people search, etc., is a highly promising but underdeveloped research topic. On the one hand, the stylistic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Zidu Wang , Xiangyu Zhu , Jiang Yu , Tianshuo Zhang , Zhen Lei

Generating high-quality 3D models from 2D sketches is a challenging task due to the inherent ambiguity and sparsity of sketch data. In this paper, we present S3D, a novel framework that converts simple hand-drawn sketches into detailed 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Hail Song , Wonsik Shin , Naeun Lee , Soomin Chung , Nojun Kwak , Woontack Woo

Significant progress has recently been made in creative applications of large pre-trained models for downstream tasks in 3D vision, such as text-to-shape generation. This motivates our investigation of how these pre-trained models can be…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Aditya Sanghi , Pradeep Kumar Jayaraman , Arianna Rampini , Joseph Lambourne , Hooman Shayani , Evan Atherton , Saeid Asgari Taghanaki

Accurately drawing non-planar 3D curves in immersive Virtual Reality (VR) is indispensable for many precise 3D tasks. However, due to lack of physical support, limited depth perception, and the non-planar nature of 3D curves, it is…

Human-Computer Interaction · Computer Science 2022-10-25 Chen Chen , Matin Yarmand , Zhuoqun Xu , Varun Singh , Yang Zhang , Nadir Weibel

3D vector graphics play a crucial role in various applications including 3D shape retrieval, conceptual design, and virtual reality interactions due to their ability to capture essential structural information with minimal representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chuang Wang , Haitao Zhou , Ling Luo , Qian Yu