English
Related papers

Related papers: Retrieval-Augmented Sketch-Guided 3D Building Gene…

200 papers

In the early stages of architectural design, shoebox models are typically used as a simplified representation of building structures but require extensive operations to transform them into detailed designs. Generative artificial…

Graphics · Computer Science 2025-03-06 Xusheng Du , Ruihan Gui , Zhengyang Wang , Ye Zhang , Haoran Xie

Creating large-scale interactive 3D environments is essential for the development of Robotics and Embodied AI research. Current methods, including manual design, procedural generation, diffusion-based scene generation, and large language…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Yian Wang , Xiaowen Qiu , Jiageng Liu , Zhehuan Chen , Jiting Cai , Yufei Wang , Tsun-Hsuan Wang , Zhou Xian , Chuang Gan

We propose conformal generative modeling, a framework for generative modeling on 2D surfaces approximated by discrete triangle meshes. Our approach leverages advances in discrete conformal geometry to develop a map from a source triangle…

Machine Learning · Computer Science 2023-03-21 Victor Dorobantu , Charlotte Borcherds , Yisong Yue

Current performance-driven building design methods are not widely adopted outside the research field for several reasons that make them difficult to integrate into a typical design process. In the early design phase, in particular, the…

Machine Learning · Computer Science 2022-04-19 Spyridon Ampanavos , Ali Malkawi

Creating and editing the shape and color of 3D objects require tremendous human effort and expertise. Compared to direct manipulation in 3D interfaces, 2D interactions such as sketches and scribbles are usually much more natural and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Zezhou Cheng , Menglei Chai , Jian Ren , Hsin-Ying Lee , Kyle Olszewski , Zeng Huang , Subhransu Maji , Sergey Tulyakov

VR sketching lets users explore and iterate on ideas directly in 3D, offering a faster and more intuitive alternative to conventional CAD tools. However, existing sketch-to-shape models ignore the temporal ordering of strokes, discarding…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Yizi Chen , Sidi Wu , Tianyi Xiao , Nina Wiedemann , Loic Landrieu

Generating sketches with specific patterns as expected, i.e., manipulating sketches in a controllable way, is a popular task. Recent studies control sketch features at stroke-level by editing values of stroke embeddings as conditions.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Sicong Zang , Shuhui Gao , Zhijun Fang

Mesh is a fundamental representation of 3D assets in various industrial applications, and is widely supported by professional softwares. However, due to its irregular structure, mesh creation and manipulation is often time-consuming and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhaoyang Lyu , Ben Fei , Jinyi Wang , Xudong Xu , Ya Zhang , Weidong Yang , Bo Dai

The reconstruction of 3D microstructures from 2D slices is considered to hold significant value in predicting the spatial structure and physical properties of materials.The dimensional extension from 2D to 3D is viewed as a highly…

Machine Learning · Computer Science 2024-02-27 Yilin Zheng , Zhigong Song

3D shape modeling is labor-intensive, time-consuming, and requires years of expertise. To facilitate 3D shape modeling, we propose a 3D shape generation network that takes a 3D VR sketch as a condition. We assume that sketches are created…

Computer Vision and Pattern Recognition · Computer Science 2024-01-11 Ling Luo , Pinaki Nath Chowdhury , Tao Xiang , Yi-Zhe Song , Yulia Gryaditskaya

The conversion of 2D freehand sketches into 3D models remains a pivotal challenge in computer vision, bridging the gap between fluent sketching and CAD. Traditional monocular depth reconstruction techniques are not suitable for line drawing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Elton Cao , Hod Lipson

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

We introduce Scan2Mesh, a novel data-driven generative approach which transforms an unstructured and potentially incomplete range scan into a structured 3D mesh representation. The main contribution of this work is a generative neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-03 Angela Dai , Matthias Nießner

Human creativity follows a perceptual process, moving from abstract ideas to finer details during creation. While 3D generative models have advanced dramatically, models specifically designed to assist human imagination in 3D creation --…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Juil Koo , Wei-Tung Lin , Chanho Park , Chanhyeok Park , Minhyuk Sung

3D vision systems are fundamentally constrained by their reliance on visual overlap: reconstruction methods require it for geometric alignment, while generative models use it to enforce multi-view consistency. This limitation is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Grzegorz Wilczynski , Mikołaj Zielinski , Bartosz Świrta , Dominik Belter , Przemysław Spurek

During the early stages of interface design, designers need to produce multiple sketches to explore a design space. Design tools often fail to support this critical stage, because they insist on specifying more details than necessary.…

Human-Computer Interaction · Computer Science 2026-03-31 Aryan Garg , Yue Jiang , Antti Oulasvirta

Generating 3D models from face sketches is an active topic of research in Computer Graphics due to its potential to tremendously facilitate the modeling of faces for both professional 3D arists and novices. Motivated by the observation that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Nancy Iskander

Reconstructing a 3D shape based on a single sketch image is challenging due to the large domain gap between a sparse, irregular sketch and a regular, dense 3D shape. Existing works try to employ the global feature extracted from sketch to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Chenjian Gao , Qian Yu , Lu Sheng , Yi-Zhe Song , Dong Xu

Sketches are the most abstract 2D representations of real-world objects. Although a sketch usually has geometrical distortion and lacks visual cues, humans can effortlessly envision a 3D object from it. This suggests that sketches encode…

Computer Vision and Pattern Recognition · Computer Science 2022-01-20 Jiayun Wang , Jierui Lin , Qian Yu , Runtao Liu , Yubei Chen , Stella X. Yu

AI-assisted development tools enable rapid prototyping of services but often lack awareness of architectural constraints, infrastructure dependencies, and organizational standards required in production environments. Consequently, generated…