English
Related papers

Related papers: Layout-your-3D: Controllable and Precise 3D Genera…

200 papers

Text-to-3D (T23D) generation has transformed digital content creation, yet remains bottlenecked by blind trial-and-error prompting processes that yield unpredictable results. While visual prompt engineering has advanced in text-to-image…

Graphics · Computer Science 2025-08-04 Nan Xiang , Tianyi Liang , Haiwen Huang , Shiqi Jiang , Hao Huang , Yifei Huang , Liangyu Chen , Changbo Wang , Chenhui Li

While conditional generation models can now generate natural language well enough to create fluent text, it is still difficult to control the generation process, leading to irrelevant, repetitive, and hallucinated content. Recent work shows…

Generating realistic and diverse LiDAR point clouds is crucial for autonomous driving simulation. Although previous methods achieve LiDAR point cloud generation from user inputs, they struggle to attain high-quality results while enabling…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Haiyun Wei , Fan Lu , Yunwei Zhu , Zehan Zheng , Weiyi Xue , Lin Shao , Xudong Zhang , Ya Wu , Rong Fu , Guang Chen

Recent advances in 3D AIGC have shown promise in directly creating 3D objects from text and images, offering significant cost savings in animation and product design. However, detailed edit and customization of 3D assets remains a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Zhangyang Qi , Yunhan Yang , Mengchen Zhang , Long Xing , Xiaoyang Wu , Tong Wu , Dahua Lin , Xihui Liu , Jiaqi Wang , Hengshuang Zhao

Recent advances in text-to-3D scene generation have demonstrated significant potential to transform content creation across multiple industries. Although the research community has made impressive progress in addressing the challenges of…

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

In the realm of digital creativity, our potential to craft intricate 3D worlds from imagination is often hampered by the limitations of existing digital tools, which demand extensive expertise and efforts. To narrow this disparity, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Longwen Zhang , Ziyu Wang , Qixuan Zhang , Qiwei Qiu , Anqi Pang , Haoran Jiang , Wei Yang , Lan Xu , Jingyi Yu

Generating realistic building layouts for automatic building design has been studied in both the computer vision and architecture domains. Traditional approaches from the architecture domain, which are based on optimization techniques or…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Jiachen Liu , Yuan Xue , Haomiao Ni , Rui Yu , Zihan Zhou , Sharon X. Huang

Traditional image-to-3D models often struggle with scenes containing multiple objects due to biases and occlusion complexities. To address this challenge, we present REPARO, a novel approach for compositional 3D asset generation from single…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Haonan Han , Rui Yang , Huan Liao , Jiankai Xing , Zunnan Xu , Xiaoming Yu , Junwei Zha , Xiu Li , Wanhua Li

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Weiwei Cai , Shuangkang Fang , Weicai Ye , Xin Dong , Yunhan Yang , Xuanyang Zhang , Wei Cheng , Yanpei Cao , Gang Yu , Tao Chen

Synthesizing 3D scenes from open-vocabulary text descriptions is a challenging, important, and recently-popular application. One of its critical subproblems is layout generation: given a set of objects, lay them out to produce a scene…

Recent advances in 3D representations, such as Neural Radiance Fields and 3D Gaussian Splatting, have greatly improved realistic scene modeling and novel-view synthesis. However, achieving controllable and consistent editing in dynamic 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Kai He , Chin-Hsuan Wu , Igor Gilitschenski

The generation of 3D scenes from user-specified conditions offers a promising avenue for alleviating the production burden in 3D applications. Previous studies required significant effort to realize the desired scene, owing to limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Takayuki Hara , Tatsuya Harada

We present I2V3D, a novel framework for animating static images into dynamic videos with precise 3D control, leveraging the strengths of both 3D geometry guidance and advanced generative models. Our approach combines the precision of a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhiyuan Zhang , Dongdong Chen , Jing Liao

Recent advances in 3D generation have been remarkable, with methods such as DreamFusion leveraging large-scale text-to-image diffusion-based models to guide 3D object generation. These methods enable the synthesis of detailed and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Bohan Zeng , Shanglin Li , Yutang Feng , Ling Yang , Hong Li , Sicheng Gao , Jiaming Liu , Conghui He , Wentao Zhang , Jianzhuang Liu , Baochang Zhang , Shuicheng Yan

Text-to-3D generation represents an exciting field that has seen rapid advancements, facilitating the transformation of textual descriptions into detailed 3D models. However, current progress often neglects the intricate high-order…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Donglin Di , Jiahui Yang , Chaofan Luo , Zhou Xue , Wei Chen , Xun Yang , Yue Gao

Graphic layout generation is a growing research area focusing on generating aesthetically pleasing layouts ranging from poster designs to documents. While recent research has explored ways to incorporate user constraints to guide the layout…

Generating 3D faces from textual descriptions has a multitude of applications, such as gaming, movie, and robotics. Recent progresses have demonstrated the success of unconditional 3D face generation and text-to-3D shape generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Cuican Yu , Guansong Lu , Yihan Zeng , Jian Sun , Xiaodan Liang , Huibin Li , Zongben Xu , Songcen Xu , Wei Zhang , Hang Xu

Recent CLIP-guided 3D optimization methods, such as DreamFields and PureCLIPNeRF, have achieved impressive results in zero-shot text-to-3D synthesis. However, due to scratch training and random initialization without prior knowledge, these…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jiale Xu , Xintao Wang , Weihao Cheng , Yan-Pei Cao , Ying Shan , Xiaohu Qie , Shenghua Gao