English
Related papers

Related papers: BrightDreamer: Generic 3D Gaussian Generative Fram…

200 papers

While text-to-3D and image-to-3D generation tasks have received considerable attention, one important but under-explored field between them is controllable text-to-3D generation, which we mainly focus on in this work. To address this task,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Zhiqi Li , Yiming Chen , Lingzhe Zhao , Peidong Liu

Recent breakthroughs in text-to-image generation has shown encouraging results via large generative models. Due to the scarcity of 3D assets, it is hardly to transfer the success of text-to-image generation to that of text-to-3D generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yiming Chen , Zhiqi Li , Peidong Liu

As pretrained text-to-image diffusion models become increasingly powerful, recent efforts have been made to distill knowledge from these text-to-image pretrained models for optimizing a text-guided 3D model. Most of the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Gege Gao , Weiyang Liu , Anpei Chen , Andreas Geiger , Bernhard Schölkopf

With the widespread usage of VR devices and contents, demands for 3D scene generation techniques become more popular. Existing 3D scene generation models, however, limit the target scene to specific domain, primarily due to their training…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jaeyoung Chung , Suyoung Lee , Hyeongjin Nam , Jaerin Lee , Kyoung Mu Lee

We present GALA3D, generative 3D GAussians with LAyout-guided control, for effective compositional text-to-3D generation. We first utilize large language models (LLMs) to generate the initial layout and introduce a layout-guided 3D Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Xiaoyu Zhou , Xingjian Ran , Yajiao Xiong , Jinlin He , Zhiwei Lin , Yongtao Wang , Deqing Sun , Ming-Hsuan Yang

Text-driven 3D scene generation has seen significant advancements recently. However, most existing methods generate single-view images using generative models and then stitch them together in 3D space. This independent generation for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Wenrui Li , Fucheng Cai , Yapeng Mi , Zhe Yang , Wangmeng Zuo , Xingtao Wang , Xiaopeng Fan

The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360$^{\circ}$ scene generation pipeline that facilitates the creation of comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shijie Zhou , Zhiwen Fan , Dejia Xu , Haoran Chang , Pradyumna Chari , Tejas Bharadwaj , Suya You , Zhangyang Wang , Achuta Kadambi

Text-guided diffusion models have revolutionized image and video generation and have also been successfully used for optimization-based 3D object synthesis. Here, we instead focus on the underexplored text-to-4D setting and synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Huan Ling , Seung Wook Kim , Antonio Torralba , Sanja Fidler , Karsten Kreis

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

Recent advancements in Generalizable Gaussian Splatting have enabled robust 3D reconstruction from sparse input views by utilizing feed-forward Gaussian Splatting models, achieving superior cross-scene generalization. However, while many…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 Zhicong Wu , Hongbin Xu , Gang Xu , Ping Nie , Zhixin Yan , Jinkai Zheng , Liangqiong Qu , Ming Li , Liqiang Nie

The rapid progress of large, pretrained models for both visual content generation and 3D reconstruction opens up new possibilities for text-to-3D generation. Intuitively, one could obtain a formidable 3D scene generator if one were able to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Hyojun Go , Dominik Narnhofer , Goutam Bhat , Prune Truong , Federico Tombari , Konrad Schindler

We introduce Text2Immersion, an elegant method for producing high-quality 3D immersive scenes from text prompts. Our proposed pipeline initiates by progressively generating a Gaussian cloud using pre-trained 2D diffusion and depth…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Hao Ouyang , Kathryn Heal , Stephen Lombardi , Tiancheng Sun

Recently, the surge of efficient and automated 3D AI-generated content (AIGC) methods has increasingly illuminated the path of transforming human imagination into complex 3D structures. However, the automated generation of 3D content is…

Graphics · Computer Science 2024-12-20 Pei Chen , Fudong Wang , Yixuan Tong , Jingdong Chen , Ming Yang , Minghui Yang

The recent advancements in text-to-3D generation mark a significant milestone in generative models, unlocking new possibilities for creating imaginative 3D assets across various real-world scenarios. While recent advancements in text-to-3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yixun Liang , Xin Yang , Jiantao Lin , Haodong Li , Xiaogang Xu , Yingcong Chen

3D object generation from a single image involves estimating the full 3D geometry and texture of unseen views from an unposed RGB image captured in the wild. Accurately reconstructing an object's complete 3D structure and texture has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Hritam Basak , Hadi Tabatabaee , Shreekant Gayaka , Ming-Feng Li , Xin Yang , Cheng-Hao Kuo , Arnie Sen , Min Sun , Zhaozheng Yin

Automatically generating a complete 3D scene from a text description, a reference image, or both has significant applications in fields like virtual reality and gaming. However, current methods often generate low-quality textures and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhexiao Xiong , Zhang Chen , Zhong Li , Yi Xu , Nathan Jacobs

Recently, text-to-image generation has exhibited remarkable advancements, with the ability to produce visually impressive results. In contrast, text-to-3D generation has not yet reached a comparable level of quality. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Text-to-3D generation by distilling pretrained large-scale text-to-image diffusion models has shown great promise but still suffers from inconsistent 3D geometric structures (Janus problems) and severe artifacts. The aforementioned problems…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Baorui Ma , Haoge Deng , Junsheng Zhou , Yu-Shen Liu , Tiejun Huang , Xinlong Wang

We train a feed-forward text-to-3D diffusion generator for human characters using only single-view 2D data for supervision. Existing 3D generative models cannot yet match the fidelity of image or video generative models. State-of-the-art 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Souhaib Attaiki , Paul Guerrero , Duygu Ceylan , Niloy J. Mitra , Maks Ovsjanikov

3D Gaussian Splatting (3DGS) achieves an appealing balance between rendering quality and efficiency, but relies on approximating 3D Gaussians as 2D projections--an assumption that degrades accuracy, especially under generic large…

Graphics · Computer Science 2026-03-13 Zixun Huang , Cho-Ying Wu , Yuliang Guo , Xinyu Huang , Liu Ren