English
Related papers

Related papers: Layout-your-3D: Controllable and Precise 3D Genera…

200 papers

3D object generation has undergone significant advancements, yielding high-quality results. However, fall short of achieving precise user control, often yielding results that do not align with user expectations, thus limiting their…

Graphics · Computer Science 2024-04-26 Shaocong Dong , Lihe Ding , Zhanpeng Huang , Zibin Wang , Tianfan Xue , Dan Xu

Generating artistic and coherent 3D scene layouts is crucial in digital content creation. Traditional optimization-based methods are often constrained by cumbersome manual rules, while deep generative models face challenges in producing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-20 Xiaoming Zhu , Xu Huang , Qinghongbing Xie , Zhi Deng , Junsheng Yu , Yirui Guan , Zhongyuan Liu , Lin Zhu , Qijun Zhao , Ligang Liu , Long Zeng

The controllability of 3D object generation methods is achieved through input text. Existing text-to-3D object generation methods primarily focus on generating a single object based on a single object description. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Shaorong Sun , Shuchao Pang , Yazhou Yao , Xiaoshui Huang

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

Generating 3D models has traditionally been a complex task requiring specialized expertise. While recent advances in generative AI have sought to automate this process, existing methods produce non-editable representation, such as meshes or…

Graphics · Computer Science 2026-01-21 Fadlullah Raji , Stefano Petrangeli , Matheus Gadelha , Yu Shen , Uttaran Bhattacharya , Gang Wu

Generative methods for 3D assets have recently achieved remarkable progress, yet providing intuitive and precise control over the object geometry remains a key challenge. Existing approaches predominantly rely on text or image prompts,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Elisabetta Fedele , Francis Engelmann , Ian Huang , Or Litany , Marc Pollefeys , Leonidas Guibas

3D generation guided by text-to-image diffusion models enables the creation of visually compelling assets. However previous methods explore generation based on image or text. The boundaries of creativity are limited by what can be expressed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Sandeep Mishra , Oindrila Saha , Alan C. Bovik

We propose a diffusion-based approach for Text-to-Image (T2I) generation with interactive 3D layout control. Layout control has been widely studied to alleviate the shortcomings of T2I diffusion models in understanding objects' placement…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Abdelrahman Eldesokey , Peter Wonka

Text-to-3D generation is to craft a 3D object according to a natural language description. This can significantly reduce the workload for manually designing 3D models and provide a more natural way of interaction for users. However, this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Han Yi , Zhedong Zheng , Xiangyu Xu , Tat-seng Chua

Recent text-to-scene generation approaches largely reduced the manual efforts required to create 3D scenes. However, their focus is either to generate a scene layout or to generate objects, and few generate both. The generated scene layout…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zhenggang Tang , Yuehao Wang , Yuchen Fan , Jun-Kun Chen , Yu-Ying Yeh , Kihyuk Sohn , Zhangyang Wang , Qixing Huang , Alexander Schwing , Rakesh Ranjan , Dilin Wang , Zhicheng Yan

Automated laboratories hold the promise of accelerating scientific discovery, yet their deployment is bottlenecked by the difficulty of designing safe and executable environments. While simulator-based design offers scalability, existing 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Jianbao Cao , Zhangrui Zhao , Bohan Feng , Zixuan Hu , Rui Li , Haiyuan Wan , Chenxi Li , Jingyuan Li , Wenzhe Cai , Lei Bai , Wanli Ouyang , Lingyu Duan , Di Huang , Minting Pan , Sha Zhang , Xinzhu Ma , Shixiang Tang , Dongzhan Zhou

Text-to-3D generation automates 3D content creation from textual descriptions, which offers transformative potential across various fields. However, existing methods often struggle to align generated content with human preferences, limiting…

Computation and Language · Computer Science 2025-02-10 Zhenglin Zhou , Xiaobo Xia , Fan Ma , Hehe Fan , Yi Yang , Tat-Seng Chua

Recent advancements in object-centric text-to-3D generation have shown impressive results. However, generating complex 3D scenes remains an open challenge due to the intricate relations between objects. Moreover, existing methods are…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Yu-Hsiang Huang , Wei Wang , Sheng-Yu Huang , Yu-Chiang Frank Wang

3D content creation plays a vital role in various applications, such as gaming, robotics simulation, and virtual reality. However, the process is labor-intensive and time-consuming, requiring skilled designers to invest considerable effort…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Chenhan Jiang

In recent years, 3D generation has made great strides in both academia and industry. However, generating 3D scenes from a single RGB image remains a significant challenge, as current approaches often struggle to ensure both object…

Graphics · Computer Science 2026-02-18 Xiang Tang , Ruotong Li , Xiaopeng Fan

Recent text-to-3D generation approaches produce impressive 3D results but require time-consuming optimization that can take up to an hour per prompt. Amortized methods like ATT3D optimize multiple prompts simultaneously to improve…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Kevin Xie , Jonathan Lorraine , Tianshi Cao , Jun Gao , James Lucas , Antonio Torralba , Sanja Fidler , Xiaohui Zeng

Current text-to-3D methods excel at generating single objects but falter on compositional prompts. We argue this failure is fundamental to their optimization schedules, as simultaneous or iterative heuristics predictably collapse under a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Utkarsh Nath , Rajeev Goel , Rahul Khurana , Kyle Min , Mark Ollila , Pavan Turaga , Varun Jampani , Tejaswi Gowda

Urban modeling is essential for city planning, scene synthesis, and gaming. Existing image-based methods generate diverse layouts but often lack geometric continuity and scalability, while graph-based methods capture structural relations…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mengyuan Niu , Xinxin Zhuo , Ruizhe Wang , Yuyue Huang , Junyan Yang , Qiao Wang

Text-to-3D generation has attracted much attention from the computer vision community. Existing methods mainly optimize a neural field from scratch for each text prompt, relying on heavy and repetitive training cost which impedes their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Ming Li , Pan Zhou , Jia-Wei Liu , Jussi Keppo , Min Lin , Shuicheng Yan , Xiangyu Xu

The current advances in generative AI for learning large neural network models with the capability to produce essays, images, music and even 3D assets from text prompts create opportunities for a manifold of disciplines. In the present…

Computation and Language · Computer Science 2023-07-06 Thiago Rios , Stefan Menzel , Bernhard Sendhoff