English
Related papers

Related papers: Retrieval-Augmented Sketch-Guided 3D Building Gene…

200 papers

With the advancement of generative AI, research on its application to 3D model generation has gained traction, particularly in automating the creation of Computer-Aided Design (CAD) files from images. GenCAD is a notable model in this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Chikaha Tsuji , Enrique Flores Medina , Harshit Gupta , Md Ferdous Alam

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

Estimating the 3D shape of an object using a single image is a difficult problem. Modern approaches achieve good results for general objects, based on real photographs, but worse results on less expressive representations such as historic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 Thomas Pöllabauer , Julius Kühn , Jiayi Li , Arjan Kuijper

Single-image 3D generation lies at the core of vision-to-graphics models in the real world. However, it remains a fundamental challenge to achieve reliable generalization across diverse semantic categories and highly variable structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Bi'an Du , Daizong Liu , Pufan Li , Wei Hu

The rise of AR/VR has led to an increased demand for 3D content. However, the traditional method of creating 3D content using Computer-Aided Design (CAD) is a labor-intensive and skill-demanding process, making it difficult to use for…

Human-Computer Interaction · Computer Science 2023-10-30 Ying Zang , Chaotao Ding , Tianrun Chen , Papa Mao , Wenjun Hu

3D shape generation is a challenging problem due to the high-dimensional output space and complex part configurations of real-world objects. As a result, existing algorithms experience difficulties in accurate generative modeling of 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-06-11 Salman H. Khan , Yulan Guo , Munawar Hayat , Nick Barnes

Drawing freehand sketches of mechanical components on multimedia devices for AI-based engineering modeling has become a new trend. However, its development is being impeded because existing works cannot produce suitable sketches for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhichao Liao , Di Huang , Heming Fang , Yue Ma , Fengyuan Piao , Xinghui Li , Long Zeng , Pingfa Feng

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

The creation of manufacturable and editable 3D shapes through Computer-Aided Design (CAD) remains a highly manual and time-consuming task, hampered by the complex topology of boundary representations of 3D solids and unintuitive design…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Md Ferdous Alam , Faez Ahmed

Sketch-based 3D reconstruction remains a challenging task due to the abstract and sparse nature of sketch inputs, which often lack sufficient semantic and geometric information. To address this, we propose Sketch2Symm, a two-stage…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Yan Zhou , Mingji Li , Xiantao Zeng , Jie Lin , Yuexia Zhou

3D meshes are a critical building block for applications ranging from industrial design and gaming to simulation and robotics. Traditionally, meshes are crafted manually by artists, a process that is time-intensive and difficult to scale.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Xiatao Sun , Chen Liang , Qian Wang , Daniel Rakita

Recent deep image-to-image translation techniques allow fast generation of face images from freehand sketches. However, existing solutions tend to overfit to sketches, thus requiring professional sketches or even edge maps as input. To…

Graphics · Computer Science 2020-06-09 Shu-Yu Chen , Wanchao Su , Lin Gao , Shihong Xia , Hongbo Fu

Traditional image-to-3D models often struggle with scenes containing multiple objects due to biases and occlusion complexities. To address this challenge, we present REPARO, a novel approach for compositional 3D asset generation from single…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Haonan Han , Rui Yang , Huan Liao , Jiankai Xing , Zunnan Xu , Xiaoming Yu , Junwei Zha , Xiu Li , Wanhua Li

We propose a method for constructing generative models of 3D objects from a single 3D mesh and improving them through unsupervised low-shot learning from 2D images. Our method produces a 3D morphable model that represents shape and albedo…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Skylar Sutherland , Bernhard Egger , Joshua Tenenbaum

The rapid development of AR/VR brings tremendous demands for 3D content. While the widely-used Computer-Aided Design (CAD) method requires a time-consuming and labor-intensive modeling process, sketch-based 3D modeling offers a potential…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Tianrun Chen , Chenglong Fu , Ying Zang , Lanyun Zhu , Jia Zhang , Papa Mao , Lingyun Sun

Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. In this paper, we extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Xuelin Qian , Yu Wang , Simian Luo , Yinda Zhang , Ying Tai , Zhenyu Zhang , Chengjie Wang , Xiangyang Xue , Bo Zhao , Tiejun Huang , Yunsheng Wu , Yanwei Fu

The recent advances in text and image synthesis show a great promise for the future of generative models in creative fields. However, a less explored area is the one of 3D model generation, with a lot of potential applications to game…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Antoine Schnepf , Flavian Vasile , Ugo Tanielian

Methods that use neural networks for synthesizing 3D shapes in the form of a part-based representation have been introduced over the last few years. These methods represent shapes as a graph or hierarchy of parts and enable a variety of…

Graphics · Computer Science 2024-09-20 Yanran Guan , Oliver van Kaick

Sketch2Prototype is an AI-based framework that transforms a hand-drawn sketch into a diverse set of 2D images and 3D prototypes through sketch-to-text, text-to-image, and image-to-3D stages. This framework, shown across various sketches,…

Human-Computer Interaction · Computer Science 2024-05-24 Kristen M. Edwards , Brandon Man , Faez Ahmed

Ongoing advancements in the fields of 3D modelling and digital archiving have led to an outburst in the amount of data stored digitally. Consequently, several retrieval systems have been developed depending on the type of data stored in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-21 Bharadwaj Manda , Shubham Dhayarkar , Sai Mitheran , V. K. Viekash , Ramanathan Muthuganapathy