English
Related papers

Related papers: Edify 3D: Scalable High-Quality 3D Asset Generatio…

200 papers

Generating high-quality 3D assets from a given image is highly desirable in various applications such as AR/VR. Recent advances in single-image 3D generation explore feed-forward models that learn to infer the 3D model of an object without…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yongwei Chen , Tengfei Wang , Tong Wu , Xingang Pan , Kui Jia , Ziwei Liu

In this work, we present a novel framework built to simplify 3D asset generation for amateur users. To enable interactive generation, our method supports a variety of input modalities that can be easily provided by a human, including…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Yen-Chi Cheng , Hsin-Ying Lee , Sergey Tulyakov , Alexander Schwing , Liangyan Gui

High-quality 3D assets are essential for various applications in computer graphics and 3D vision but remain scarce due to significant acquisition costs. To address this shortage, we introduce Elevate3D, a novel framework that transforms…

Graphics · Computer Science 2025-07-16 Nuri Ryu , Jiyun Won , Jooeun Son , Minsu Gong , Joo-Haeng Lee , Sunghyun Cho

Recently, generating 3D assets with the control of condition images has achieved impressive quality. However, existing 3D generation methods are limited to handling a single control objective and lack the ability to utilize multiple images…

Graphics · Computer Science 2026-02-20 Xuancheng Jin , Rengan Xie , Wenting Zheng , Rui Wang , Hujun Bao , Yuchi Huo

We introduce DreamCraft3D++, an extension of DreamCraft3D that enables efficient high-quality generation of complex 3D assets. DreamCraft3D++ inherits the multi-stage generation process of DreamCraft3D, but replaces the time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jingxiang Sun , Cheng Peng , Ruizhi Shao , Yuan-Chen Guo , Xiaochen Zhao , Yangguang Li , Yanpei Cao , Bo Zhang , Yebin Liu

Diffusion models trained on large-scale text-image datasets have demonstrated a strong capability of controllable high-quality image generation from arbitrary text prompts. However, the generation quality and generalization ability of 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Ying-Tian Liu , Yuan-Chen Guo , Guan Luo , Heyi Sun , Wei Yin , Song-Hai Zhang

Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Zilong Chen , Yikai Wang , Feng Wang , Zhengyi Wang , Huaping Liu

The increasing demand for high-quality 3D assets across various industries necessitates efficient and automated 3D content creation. Despite recent advancements in 3D generative models, existing methods still face challenges with…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zhaoxi Chen , Jiaxiang Tang , Yuhao Dong , Ziang Cao , Fangzhou Hong , Yushi Lan , Tengfei Wang , Haozhe Xie , Tong Wu , Shunsuke Saito , Liang Pan , Dahua Lin , Ziwei Liu

We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Yinghao Xu , Hao Tan , Fujun Luan , Sai Bi , Peng Wang , Jiahao Li , Zifan Shi , Kalyan Sunkavalli , Gordon Wetzstein , Zexiang Xu , Kai Zhang

Modern machine learning models for scene understanding, such as depth estimation and object tracking, rely on large, high-quality datasets that mimic real-world deployment scenarios. To address data scarcity, we propose an end-to-end system…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Sonia Laguna , Alberto Garcia-Garcia , Marie-Julie Rakotosaona , Stylianos Moschoglou , Leonhard Helminger , Sergio Orts-Escolano

Driven by powerful image diffusion models, recent research has achieved the automatic creation of 3D objects from textual or visual guidance. By performing score distillation sampling (SDS) iteratively across different views, these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-05-17 Zeyu Li , Ruitong Gan , Chuanchen Luo , Yuxi Wang , Jiaheng Liu , Ziwei Zhu Man Zhang , Qing Li , Xucheng Yin , Zhaoxiang Zhang , Junran Peng

3D asset generation is getting massive amounts of attention, inspired by the recent success of text-guided 2D content creation. Existing text-to-3D methods use pretrained text-to-image diffusion models in an optimization problem or…

Computer Vision and Pattern Recognition · Computer Science 2024-07-30 Lukas Höllein , Aljaž Božič , Norman Müller , David Novotny , Hung-Yu Tseng , Christian Richardt , Michael Zollhöfer , Matthias Nießner

In this paper, we tackle a new task of 3D object synthesis, where a 3D model is composited with another object category to create a novel 3D model. However, most existing text/image/3D-to-3D methods struggle to effectively integrate…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Zeren Xiong , Zikun Chen , Zedong Zhang , Xiang Li , Ying Tai , Jian Yang , Jun Li

Despite the latest remarkable advances in generative modeling, efficient generation of high-quality 3D assets from textual prompts remains a difficult task. A key challenge lies in data scarcity: the most extensive 3D datasets encompass…

Computer Vision and Pattern Recognition · Computer Science 2024-01-17 Antoine Mercier , Ramin Nakhli , Mahesh Reddy , Rajeev Yasarla , Hong Cai , Fatih Porikli , Guillaume Berger

Recent advancements in 3D generation are predominantly propelled by improvements in 3D-aware image diffusion models. These models are pretrained on Internet-scale image data and fine-tuned on massive 3D data, offering the capability of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Zeyu Yang , Zijie Pan , Chun Gu , Li Zhang

We present SOPHY, a generative model for 3D physics-aware shape synthesis. Unlike existing 3D generative models that focus solely on static geometry or 4D models that produce physics-agnostic animations, our method jointly synthesizes…

Graphics · Computer Science 2025-08-12 Junyi Cao , Evangelos Kalogerakis

Three-dimensional content generation has progressed from producing isolated, visually plausible shapes to constructing structured assets that can be deployed in real-time interactive environments. This trajectory is driven by converging…

Graphics · Computer Science 2026-05-12 Jiafeng Wu , Zhuofan Lou , Jian Liu , Dazhao Du , Chunchao Guo , Song Guo

Despite the unprecedented progress in the field of 3D generation, current systems still often fail to produce high-quality 3D assets that are visually appealing and geometrically and semantically consistent across multiple viewpoints. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Shivam Duggal , Yushi Hu , Oscar Michel , Aniruddha Kembhavi , William T. Freeman , Noah A. Smith , Ranjay Krishna , Antonio Torralba , Ali Farhadi , Wei-Chiu Ma

While generative artificial intelligence has advanced significantly across text, image, audio, and video domains, 3D generation remains comparatively underdeveloped due to fundamental challenges such as data scarcity, algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Weiyu Li , Xuanyang Zhang , Zheng Sun , Di Qi , Hao Li , Wei Cheng , Weiwei Cai , Shihao Wu , Jiarui Liu , Zihao Wang , Xiao Chen , Feipeng Tian , Jianxiong Pan , Zeming Li , Gang Yu , Xiangyu Zhang , Daxin Jiang , Ping Tan

While 3D generative models have greatly improved artists' workflows, the existing diffusion models for 3D generation suffer from slow generation and poor generalization. To address this issue, we propose a two-stage approach named Hunyuan3D…