English
Related papers

Related papers: Pandora3D: A Comprehensive Framework for High-Qual…

200 papers

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Synthesizing novel 3D models that resemble the input example has long been pursued by graphics artists and machine learning researchers. In this paper, we present Sin3DM, a diffusion model that learns the internal patch distribution from a…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Rundi Wu , Ruoshi Liu , Carl Vondrick , Changxi Zheng

While recent generative models for 2D images achieve impressive visual results, they clearly lack the ability to perform 3D reasoning. This heavily restricts the degree of control over generated objects as well as the possible applications…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Dario Pavllo , Graham Spinks , Thomas Hofmann , Marie-Francine Moens , Aurelien Lucchi

We present GuidedSceneGen, a text-to-3D generation framework that produces metrically accurate, globally consistent, and semantically interpretable indoor scenes. Unlike prior text-driven methods that often suffer from geometric drift or…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Stefan Ainetter , Thomas Deixelberger , Edoardo A. Dominici , Philipp Drescher , Konstantinos Vardis , Markus Steinberger

This paper presents a novel method to generate textures for 3D models given text prompts and 3D meshes. Additional depth information is taken into account to perform the Score Distillation Sampling (SDS) process with depth conditional…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Cindy Le , Congrui Hetang , Chendi Lin , Ang Cao , Yihui He

This paper presents Paint3D, a novel coarse-to-fine generative framework that is capable of producing high-resolution, lighting-less, and diverse 2K UV texture maps for untextured 3D meshes conditioned on text or image inputs. The key…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xianfang Zeng , Xin Chen , Zhongqi Qi , Wen Liu , Zibo Zhao , Zhibin Wang , Bin Fu , Yong Liu , Gang Yu

We introduce MD-ProjTex, a method for fast and consistent text-guided texture generation for 3D shapes using pretrained text-to-image diffusion models. At the core of our approach is a multi-view consistency mechanism in UV space, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ahmet Burak Yildirim , Mustafa Utku Aydogdu , Duygu Ceylan , Aysegul Dundar

Implicit generative models have been widely employed to model 3D data and have recently proven to be successful in encoding and generating high-quality 3D shapes. This work builds upon these models and alleviates current limitations by…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Tejaswini Medi , Jawad Tayyub , Muhammad Sarmad , Frank Lindseth , Margret Keuper

We present PacTure, a novel framework for generating physically-based rendering (PBR) material textures for an untextured 3D mesh from a text description. Existing 2D generation-based texturing approaches either generate textures…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Fan Fei , Jiajun Tang , Fei-Peng Tian , Boxin Shi , Ping Tan

We present NaTex, a native texture generation framework that predicts texture color directly in 3D space. In contrast to previous approaches that rely on baking 2D multi-view images synthesized by geometry-conditioned Multi-View Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeqiang Lai , Yunfei Zhao , Zibo Zhao , Xin Yang , Xin Huang , Jingwei Huang , Xiangyu Yue , Chunchao Guo

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Ken Deng , Yuan-Chen Guo , Jingxiang Sun , Zi-Xin Zou , Yangguang Li , Xin Cai , Yan-Pei Cao , Yebin Liu , Ding Liang

This paper presents a novel latent 3D diffusion model for the generation of neural voxel fields, aiming to achieve accurate part-aware structures. Compared to existing methods, there are two key designs to ensure high-quality and accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Yuhang Huang , SHilong Zou , Xinwang Liu , Kai Xu

Generative models for 2D images has recently seen tremendous progress in quality, resolution and speed as a result of the efficiency of 2D convolutional architectures. However it is difficult to extend this progress into the 3D domain since…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hassan Abu Alhaija , Alara Dirik , André Knörig , Sanja Fidler , Maria Shugrina

3D scene generation is a core technology for gaming, film/VFX, and VR/AR. Growing demand for rapid iteration, high-fidelity detail, and accessible content creation has further increased interest in this area. Existing methods broadly follow…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Haozhi Zhu , Miaomiao Zhao , Dingyao Liu , Runze Tian , Yan Zhang , Jie Guo , Fenggen Yu

We present a new method for multimodal conditional 3D face geometry generation that allows user-friendly control over the output identity and expression via a number of different conditioning signals. Within a single model, we demonstrate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Christopher Otto , Prashanth Chandran , Sebastian Weiss , Markus Gross , Gaspard Zoss , Derek Bradley

Prevailing 3D texture generation methods, which often rely on multi-view fusion, are frequently hindered by inter-view inconsistencies and incomplete coverage of complex surfaces, limiting the fidelity and completeness of the generated…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifei Zeng , Yajie Bao , Jiachen Qian , Shuang Wu , Youtian Lin , Hao Zhu , Buyu Li , Feihu Zhang , Xun Cao , Yao Yao

Recent advancements in diffusion techniques have propelled image and video generation to unprecedented levels of quality, significantly accelerating the deployment and application of generative AI. However, 3D shape generation technology…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yangguang Li , Zi-Xin Zou , Zexiang Liu , Dehu Wang , Yuan Liang , Zhipeng Yu , Xingchao Liu , Yuan-Chen Guo , Ding Liang , Wanli Ouyang , Yan-Pei Cao

Although recent 3D-native generators have made great progress in synthesizing reliable geometry, they still fall short in achieving realistic appearances. A key obstacle lies in the lack of diverse and high-quality real-world 3D assets with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xinyue Liang , Zhinyuan Ma , Lingchen Sun , Yanjun Guo , Lei Zhang

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dave Zhenyu Chen , Yawar Siddiqui , Hsin-Ying Lee , Sergey Tulyakov , Matthias Nießner

Diffusion probabilistic models have been shown to generate state-of-the-art results on several competitive image synthesis benchmarks but lack a low-dimensional, interpretable latent space, and are slow at generation. On the other hand,…

Machine Learning · Computer Science 2022-11-30 Kushagra Pandey , Avideep Mukherjee , Piyush Rai , Abhishek Kumar