English
Related papers

Related papers: DreamCraft3D++: Efficient Hierarchical 3D Generati…

200 papers

3D panorama synthesis is a promising yet challenging task that demands high-quality and diverse visual appearance and geometry of the generated omnidirectional content. Existing methods leverage rich image priors from pre-trained 2D…

Graphics · Computer Science 2025-06-23 Yukun Huang , Yanning Zhou , Jianan Wang , Kaiyi Huang , Xihui Liu

Recent advancements in open-world 3D object generation have been remarkable, with image-to-3D methods offering superior fine-grained control over their text-to-3D counterparts. However, most existing models fall short in simultaneously…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Minghua Liu , Ruoxi Shi , Linghao Chen , Zhuoyang Zhang , Chao Xu , Xinyue Wei , Hansheng Chen , Chong Zeng , Jiayuan Gu , Hao Su

3D generation methods have shown visually compelling results powered by diffusion image priors. However, they often fail to produce realistic geometric details, resulting in overly smooth surfaces or geometric details inaccurately baked in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruihan Gao , Kangle Deng , Gengshan Yang , Wenzhen Yuan , Jun-Yan Zhu

Autoregressive models have achieved remarkable success across various domains, yet their performance in 3D shape generation lags significantly behind that of diffusion models. In this paper, we introduce OctGPT, a novel multiscale…

Graphics · Computer Science 2025-04-16 Si-Tong Wei , Rui-Huan Wang , Chuan-Zhi Zhou , Baoquan Chen , Peng-Shuai Wang

Benefiting from the rapid development of 2D diffusion models, 3D content generation has witnessed significant progress. One promising solution is to finetune the pre-trained 2D diffusion models to produce multi-view images and then…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Fan Yang , Jianfeng Zhang , Yichun Shi , Bowen Chen , Chenxu Zhang , Huichao Zhang , Xiaofeng Yang , Xiu Li , Jiashi Feng , Guosheng Lin

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiaxiang Tang , Jiawei Ren , Hang Zhou , Ziwei Liu , Gang Zeng

Recent breakthroughs in text-to-image generation has shown encouraging results via large generative models. Due to the scarcity of 3D assets, it is hardly to transfer the success of text-to-image generation to that of text-to-3D generation.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Yiming Chen , Zhiqi Li , Peidong Liu

The recent availability and adaptability of text-to-image models has sparked a new era in many related domains that benefit from the learned text priors as well as high-quality and fast generation capabilities, one of which is texture…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Raphael Bensadoun , Yanir Kleiman , Idan Azuri , Omri Harosh , Andrea Vedaldi , Natalia Neverova , Oran Gafni

Recent advances in 3D generative models have shown promising results but often fall short in capturing the complexity of architectural geometries and topologies and fine geometric details at high resolutions. To tackle this, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 S. Rasoulzadeh , M. Bank , I. Kovacic , K. Schinegger , S. Rutzinger , M. Wimmer

Large-scale video generative models can synthesize diverse and realistic visual content for dynamic world creation, but they often lack element-wise controllability, hindering their use in editing scenes and training embodied AI agents. We…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sicheng Mo , Ziyang Leng , Leon Liu , Weizhen Wang , Honglin He , Bolei Zhou

The evolution of 3D generative modeling has been notably propelled by the adoption of 2D diffusion models. Despite this progress, the cumbersome optimization process per se presents a critical hurdle to efficiency. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Xingyi Yang , Xinchao Wang

Diffusion Transformer (DiT), an emerging diffusion model for visual generation, has demonstrated superior performance but suffers from substantial computational costs. Our investigations reveal that these costs primarily stem from the…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Wangbo Zhao , Yizeng Han , Jiasheng Tang , Kai Wang , Hao Luo , Yibing Song , Gao Huang , Fan Wang , Yang You

While recent 3D generative models can produce high-quality texture images, they often fail to capture human preferences or meet task-specific requirements. Moreover, a core challenge in the 3D texture generation domain is that most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 AmirHossein Zamani , Tianhao Xie , Amir G. Aghdam , Tiberiu Popa , Eugene Belilovsky

Recent CLIP-guided 3D optimization methods, such as DreamFields and PureCLIPNeRF, have achieved impressive results in zero-shot text-to-3D synthesis. However, due to scratch training and random initialization without prior knowledge, these…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Jiale Xu , Xintao Wang , Weihao Cheng , Yan-Pei Cao , Ying Shan , Xiaohu Qie , Shenghua Gao

We present a latent diffusion model for fast feed-forward 3D scene generation. Given one or more images, our model Bolt3D directly samples a 3D scene representation in less than seven seconds on a single GPU. We achieve this by leveraging…

Text-to-3D generation has achieved significant success by incorporating powerful 2D diffusion models, but insufficient 3D prior knowledge also leads to the inconsistency of 3D geometry. Recently, since large-scale multi-view datasets have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Junyoung Seo , Susung Hong , Wooseok Jang , Inès Hyeonsu Kim , Minseop Kwak , Doyup Lee , Seungryong Kim

As several industries are moving towards modeling massive 3D virtual worlds, the need for content creation tools that can scale in terms of the quantity, quality, and diversity of 3D content is becoming evident. In our work, we aim to train…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Jun Gao , Tianchang Shen , Zian Wang , Wenzheng Chen , Kangxue Yin , Daiqing Li , Or Litany , Zan Gojcic , Sanja Fidler

Although recent 3D-native generators have made great progress in synthesizing reliable geometry, they still fall short in achieving realistic appearances. A key obstacle lies in the lack of diverse and high-quality real-world 3D assets with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xinyue Liang , Zhinyuan Ma , Lingchen Sun , Yanjun Guo , Lei Zhang

We introduce Edify 3D, an advanced solution designed for high-quality 3D asset generation. Our method first synthesizes RGB and surface normal images of the described object at multiple viewpoints using a diffusion model. The multi-view…

Recent methods such as Score Distillation Sampling (SDS) and Variational Score Distillation (VSD) using 2D diffusion models for text-to-3D generation have demonstrated impressive generation quality. However, the long generation time of such…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Linqi Zhou , Andy Shih , Chenlin Meng , Stefano Ermon