English
Related papers

Related papers: Magic3D: High-Resolution Text-to-3D Content Creati…

200 papers

We introduce a novel framework for 3D human avatar generation and personalization, leveraging text prompts to enhance user engagement and customization. Central to our approach are key innovations aimed at overcoming the challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Armand Comas-Massagué , Di Qiu , Menglei Chai , Marcel Bühler , Amit Raj , Ruiqi Gao , Qiangeng Xu , Mark Matthews , Paulo Gotardo , Octavia Camps , Sergio Orts-Escolano , Thabo Beeler

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

Text-to-3D modelling has seen exciting progress by combining generative text-to-image models with image-to-3D methods like Neural Radiance Fields. DreamFusion recently achieved high-quality results but requires a lengthy, per-prompt…

Reconstructing 3D models from single-view images is a long-standing problem in computer vision. The latest advances for single-image 3D reconstruction extract a textual description from the input image and further utilize it to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Yu Liu , Ruowei Wang , Jiaqi Li , Zixiang Xu , Qijun Zhao

Previous efforts have managed to generate production-ready 3D assets from text or images. However, these methods primarily employ NeRF or 3D Gaussian representations, which are not adept at producing smooth, high-quality geometries required…

Graphics · Computer Science 2024-10-15 Rengan Xie , Wenting Zheng , Kai Huang , Yizheng Chen , Qi Wang , Qi Ye , Wei Chen , Yuchi Huo

With the introduction of Neural Radiance Fields (NeRFs), novel view synthesis has recently made a big leap forward. At the core, NeRF proposes that each 3D point can emit radiance, allowing to conduct view synthesis using differentiable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Marie-Julie Rakotosaona , Fabian Manhardt , Diego Martin Arroyo , Michael Niemeyer , Abhijit Kundu , Federico Tombari

We present a two-stage text-to-3D generation system, namely 3DTopia, which generates high-quality general 3D assets within 5 minutes using hybrid diffusion priors. The first stage samples from a 3D diffusion prior directly learned from 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Fangzhou Hong , Jiaxiang Tang , Ziang Cao , Min Shi , Tong Wu , Zhaoxi Chen , Shuai Yang , Tengfei Wang , Liang Pan , Dahua Lin , Ziwei Liu

In this work, we investigate the problem of creating high-fidelity 3D content from only a single image. This is inherently challenging: it essentially involves estimating the underlying 3D geometry while simultaneously hallucinating unseen…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Junshu Tang , Tengfei Wang , Bo Zhang , Ting Zhang , Ran Yi , Lizhuang Ma , Dong Chen

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common object generation,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Making generative models 3D-aware bridges the 2D image space and the 3D physical world yet remains challenging. Recent attempts equip a Generative Adversarial Network (GAN) with a Neural Radiance Field (NeRF), which maps 3D coordinates to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Yinghao Xu , Sida Peng , Ceyuan Yang , Yujun Shen , Bolei Zhou

Leveraging multi-view diffusion models as priors for 3D optimization have alleviated the problem of 3D consistency, e.g., the Janus face problem or the content drift problem, in zero-shot text-to-3D models. However, the 3D geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Seungwook Kim , Kejie Li , Xueqing Deng , Yichun Shi , Minsu Cho , Peng Wang

We train a feed-forward text-to-3D diffusion generator for human characters using only single-view 2D data for supervision. Existing 3D generative models cannot yet match the fidelity of image or video generative models. State-of-the-art 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Souhaib Attaiki , Paul Guerrero , Duygu Ceylan , Niloy J. Mitra , Maks Ovsjanikov

Neural Radiance Field (NeRF) is a representation for 3D reconstruction from multi-view images. Despite some recent work showing preliminary success in editing a reconstructed NeRF with diffusion prior, they remain struggling to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Chieh Hubert Lin , Changil Kim , Jia-Bin Huang , Qinbo Li , Chih-Yao Ma , Johannes Kopf , Ming-Hsuan Yang , Hung-Yu Tseng

This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Kira Prabhu , Jane Wu , Lynn Tsai , Peter Hedman , Dan B Goldman , Ben Poole , Michael Broxton

Recent methods in text-to-3D leverage powerful pretrained diffusion models to optimize NeRF. Notably, these methods are able to produce high-quality 3D scenes without training on 3D data. Due to the open-ended nature of the task, most…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Yuze He , Yushi Bai , Matthieu Lin , Wang Zhao , Yubin Hu , Jenny Sheng , Ran Yi , Juanzi Li , Yong-Jin Liu

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Neural Radiance Fields (NeRF) has been wildly applied to various tasks for its high-quality representation of 3D scenes. It takes long per-scene training time and per-image testing time. In this paper, we present EfficientNeRF as an…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Tao Hu , Shu Liu , Yilun Chen , Tiancheng Shen , Jiaya Jia

Witnessing the evolution of text-to-image diffusion models, significant strides have been made in text-to-3D generation. Currently, two primary paradigms dominate the field of text-to-3D: the feed-forward generation solutions, capable of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yonghao Yu , Shunan Zhu , Huai Qin , Haorui Li

Neural Radiance Field (NeRF) has emerged as a leading technique for novel view synthesis, owing to its impressive photorealistic reconstruction and rendering capability. Nevertheless, achieving real-time NeRF rendering in large-scale scenes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Chaojian Li , Bichen Wu , Peter Vajda , Yingyan Celine Lin

In recent times, the generation of 3D assets from text prompts has shown impressive results. Both 2D and 3D diffusion models can help generate decent 3D objects based on prompts. 3D diffusion models have good 3D consistency, but their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Taoran Yi , Jiemin Fang , Junjie Wang , Guanjun Wu , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Qi Tian , Xinggang Wang