English
Related papers

Related papers: DreamDissector: Learning Disentangled Text-to-3D G…

200 papers

Recently, text-to-3D approaches have achieved high-fidelity 3D content generation using text description. However, the generated objects are stochastic and lack fine-grained control. Sketches provide a cheap approach to introduce such…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Minglin Chen , Weihao Yuan , Yukun Wang , Zhe Sheng , Yisheng He , Zilong Dong , Liefeng Bo , Yulan Guo

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

By lifting the pre-trained 2D diffusion models into Neural Radiance Fields (NeRFs), text-to-3D generation methods have made great progress. Many state-of-the-art approaches usually apply score distillation sampling (SDS) to optimize the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Yuze He , Yushi Bai , Matthieu Lin , Jenny Sheng , Yubin Hu , Qi Wang , Yu-Hui Wen , Yong-Jin Liu

We introduce RealmDreamer, a technique for generating forward-facing 3D scenes from text descriptions. Our method optimizes a 3D Gaussian Splatting representation to match complex text prompts using pretrained diffusion models. Our key…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jaidev Shriram , Alex Trevithick , Lingjie Liu , Ravi Ramamoorthi

Recent strides in Text-to-3D techniques have been propelled by distilling knowledge from powerful large text-to-image diffusion models (LDMs). Nonetheless, existing Text-to-3D approaches often grapple with challenges such as…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Yiwen Chen , Chi Zhang , Xiaofeng Yang , Zhongang Cai , Gang Yu , Lei Yang , Guosheng Lin

The ability to generate highly realistic 2D images from mere text prompts has recently made huge progress in terms of speed and quality, thanks to the advent of image diffusion models. Naturally, the question arises if this can be also…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Christina Tsalicoglou , Fabian Manhardt , Alessio Tonioni , Michael Niemeyer , Federico Tombari

Text-to-3D generation has achieved significant success by incorporating powerful 2D diffusion models, but insufficient 3D prior knowledge also leads to the inconsistency of 3D geometry. Recently, since large-scale multi-view datasets have…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Junyoung Seo , Susung Hong , Wooseok Jang , Inès Hyeonsu Kim , Minseop Kwak , Doyup Lee , Seungryong Kim

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dave Zhenyu Chen , Yawar Siddiqui , Hsin-Ying Lee , Sergey Tulyakov , Matthias Nießner

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

Text-to-3D form plays a crucial role in creating editable 3D scenes for AR/VR. Recent advances have shown promise in merging neural radiance fields (NeRFs) with pre-trained diffusion models for text-to-3D object generation. However, one…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Haotian Bai , Yuanhuiyi Lyu , Lutao Jiang , Sijia Li , Haonan Lu , Xiaodong Lin , Lin Wang

We tackle the task of text-to-3D creation with pre-trained latent-based NeRFs (NeRFs that generate 3D objects given input latent code). Recent works such as DreamFusion and Magic3D have shown great success in generating 3D content using…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Yu-Jhe Li , Tao Xu , Ji Hou , Bichen Wu , Xiaoliang Dai , Albert Pumarola , Peizhao Zhang , Peter Vajda , Kris Kitani

Most 3D generation research focuses on up-projecting 2D foundation models into the 3D space, either by minimizing 2D Score Distillation Sampling (SDS) loss or fine-tuning on multi-view datasets. Without explicit 3D priors, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Lihe Ding , Shaocong Dong , Zhanpeng Huang , Zibin Wang , Yiyuan Zhang , Kaixiong Gong , Dan Xu , Tianfan Xue

We tackle the problem of text-driven 3D generation from a geometry alignment perspective. Given a set of text prompts, we aim to generate a collection of objects with semantically corresponding parts aligned across them. Recent methods…

This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Kira Prabhu , Jane Wu , Lynn Tsai , Peter Hedman , Dan B Goldman , Ben Poole , Michael Broxton

With the rising industrial attention to 3D virtual modeling technology, generating novel 3D content based on specified conditions (e.g. text) has become a hot issue. In this paper, we propose a new generative 3D modeling framework called…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Muheng Li , Yueqi Duan , Jie Zhou , Jiwen Lu

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

Text-driven image generation using diffusion models has recently gained significant attention. To enable more flexible image manipulation and editing, recent research has expanded from single image generation to transparent layer generation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Junjia Huang , Pengxiang Yan , Jinhang Cai , Jiyang Liu , Zhao Wang , Yitong Wang , Xinglong Wu , Guanbin Li

Style-guided texture generation aims to generate a texture that is harmonious with both the style of the reference image and the geometry of the input mesh, given a reference style image and a 3D mesh with its text description. Although…

Computer Vision and Pattern Recognition · Computer Science 2024-11-04 Zhiyu Xie , Yuqing Zhang , Xiangjun Tang , Yiqian Wu , Dehan Chen , Gongsheng Li , Xaogang Jin

We present DreamAvatar, a text-and-shape guided framework for generating high-quality 3D human avatars with controllable poses. While encouraging results have been reported by recent methods on text-guided 3D common object generation,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong