English
Related papers

Related papers: ControlRoom3D: Room Generation using Semantic Prox…

200 papers

Speech synthesis has recently seen significant improvements in fidelity, driven by the advent of neural vocoders and neural prosody generators. However, these systems lack intuitive user controls over prosody, making them unable to rectify…

Audio and Speech Processing · Electrical Eng. & Systems 2020-08-13 Max Morrison , Zeyu Jin , Justin Salamon , Nicholas J. Bryan , Gautham J. Mysore

Recent 3D generative models produce high-quality textures for 3D mesh objects. However, they commonly rely on the heavy assumption that input 3D meshes are accompanied by manual mesh parameterization (UV mapping), a manual task that…

Graphics · Computer Science 2026-03-02 AmirHossein Zamani , Bruno Roy , Arianna Rampini

Despite recent advancements in 3D generation methods, achieving controllability still remains a challenging issue. Current approaches utilizing score-distillation sampling are hindered by laborious procedures that consume a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Hongbin Xu , Weitao Chen , Zhipeng Zhou , Feng Xiao , Baigui Sun , Mike Zheng Shou , Wenxiong Kang

Text-to-3D scene generation from natural language is highly desirable for digital content creation. However, existing methods are largely domain-restricted or reliant on predefined spatial relationships, limiting their capacity for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Jun Luo , Jiaxiang Tang , Ruijie Lu , Gang Zeng

Existing 3D reconstruction methods utilize guidances such as 2D images, 3D point clouds, shape contours and single semantics to recover the 3D surface, which limits the creative exploration of 3D modeling. In this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Liangchen Li , Caoliwen Wang , Yuqi Zhou , Bailin Deng , Juyong Zhang

3D indoor scene generation conditioned on short textual descriptions provides a promising avenue for interactive 3D environment construction without the need for labor-intensive layout specification. Despite recent progress in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Jie Feng , Jiawei Shen , Junjia Huang , Junpeng Zhang , Mingtao Feng , Weisheng Dong , Guanbin Li

Mixed reality (MR) environments offer embodied spatial interaction, providing intuitive 3D manipulation capabilities that enhance the conceptual design process. Parametric modeling, a powerful and advanced architectural design method,…

Human-Computer Interaction · Computer Science 2025-06-09 Ruochen Ji , Lyu Tiangang

Controllable scene synthesis aims to create interactive environments for various industrial use cases. Scene graphs provide a highly suitable interface to facilitate these applications by abstracting the scene context in a compact manner.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Guangyao Zhai , Evin Pınar Örnek , Shun-Cheng Wu , Yan Di , Federico Tombari , Nassir Navab , Benjamin Busam

Automating immersive VR scene creation remains a primary research challenge. Existing methods typically rely on complex geometry with post-simplification, resulting in inefficient pipelines or limited realism. In this paper, we introduce…

Graphics · Computer Science 2026-03-25 Jinyan Yuan , Bangbang Yang , Keke Wang , Panwang Pan , Lin Ma , Xuehai Zhang , Xiao Liu , Zhaopeng Cui , Yuewen Ma

Home design is a complex task that normally requires architects to finish with their professional skills and tools. It will be fascinating that if one can produce a house plan intuitively without knowing much knowledge about home design and…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qi Chen , Qi Wu , Rui Tang , Yuhan Wang , Shuai Wang , Mingkui Tan

Designing complex 3D scenes has been a tedious, manual process requiring domain expertise. Emerging text-to-3D generative models show great promise for making this task more intuitive, but existing approaches are limited to object-level…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Ryan Po , Gordon Wetzstein

We present MS2Mesh-XR, a novel multi-modal sketch-to-mesh generation pipeline that enables users to create realistic 3D objects in extended reality (XR) environments using hand-drawn sketches assisted by voice inputs. In specific, users can…

Computer Vision and Pattern Recognition · Computer Science 2024-12-13 Yuqi Tong , Yue Qiu , Ruiyang Li , Shi Qiu , Pheng-Ann Heng

Generative models have achieved success in producing semantically plausible 2D images, but it remains challenging in 3D generation due to the absence of spatial geometry constraints. Typically, existing methods utilize geometric features as…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Haonan Wang , Hanyu Zhou , Haoyue Liu , Tao Gu , Luxin Yan

Despite the remarkable progress of 3D generation, achieving controllability, i.e., ensuring consistency between generated 3D content and input conditions like edge and depth, remains a significant challenge. Existing methods often struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Hongbin Xu , Chaohui Yu , Feng Xiao , Jiazheng Xing , Hai Ci , Weitao Chen , Fan Wang , Ming Li

Recent advancements in 2D/3D generative techniques have facilitated the generation of dynamic 3D objects from monocular videos. Previous methods mainly rely on the implicit neural radiance fields (NeRF) or explicit Gaussian Splatting as the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Zhiqi Li , Yiming Chen , Peidong Liu

In this work, we introduce Unique3D, a novel image-to-3D framework for efficiently generating high-quality 3D meshes from single-view images, featuring state-of-the-art generation fidelity and strong generalizability. Previous methods based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Kailu Wu , Fangfu Liu , Zhihan Cai , Runjie Yan , Hanyang Wang , Yating Hu , Yueqi Duan , Kaisheng Ma

The recent developments in neural fields have brought phenomenal capabilities to the field of shape generation, but they lack crucial properties, such as incremental control - a fundamental requirement for artistic work. Triangular meshes,…

Graphics · Computer Science 2024-10-11 Amir Barda , Vladimir G. Kim , Noam Aigerman , Amit H. Bermano , Thibault Groueix

We present a technique for zero-shot generation of a 3D model using only a target text prompt. Without any 3D supervision our method deforms the control shape of a limit subdivided surface along with its texture map and normal map to obtain…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Nasir Mohammad Khalid , Tianhao Xie , Eugene Belilovsky , Tiberiu Popa

Interactive 3D assets used in games and simulation are typically decomposed into specific semantic parts to support animation, physics, and scripted behaviors, yet most generative 3D models produce either monolithic meshes or arbitrary part…

The entertainment industry relies on 3D visual content to create immersive experiences, but traditional methods for creating textured 3D models can be time-consuming and subjective. Generative networks such as StyleGAN have advanced image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Yi-Ting Pan , Chai-Rong Lee , Shu-Ho Fan , Jheng-Wei Su , Jia-Bin Huang , Yung-Yu Chuang , Hung-Kuo Chu