English
Related papers

Related papers: GraphicsDreamer: Image to 3D Generation with Physi…

200 papers

Although recent 3D-native generators have made great progress in synthesizing reliable geometry, they still fall short in achieving realistic appearances. A key obstacle lies in the lack of diverse and high-quality real-world 3D assets with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Xinyue Liang , Zhinyuan Ma , Lingchen Sun , Yanjun Guo , Lei Zhang

Controllable 3D scene generation has extensive applications in virtual reality and interior design, where the generated scenes should exhibit high levels of realism and controllability in terms of geometry. Scene graphs provide a suitable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zhifei Yang , Keyang Lu , Chao Zhang , Jiaxing Qi , Hanqi Jiang , Ruifei Ma , Shenglin Yin , Yifan Xu , Mingzhe Xing , Zhen Xiao , Jieyi Long , Guangyao Zhai

Despite the availability of large-scale 3D datasets and advancements in 3D generative models, the complexity and uneven quality of 3D geometry and texture data continue to hinder the performance of 3D generation techniques. In most existing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Xin Yang , Jiantao Lin , Yingjie Xu , Haodong Li , Yingcong Chen

We introduce a novel 3D generative method, Generative 3D Reconstruction (G3DR) in ImageNet, capable of generating diverse and high-quality 3D objects from single images, addressing the limitations of existing methods. At the heart of our…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Pradyumna Reddy , Ismail Elezi , Jiankang Deng

2D diffusion model, which often contains unwanted baked-in shading effects and results in unrealistic rendering effects in the downstream applications. Generating Physically Based Rendering (PBR) materials instead of just RGB textures would…

Recent advancements in AI-generated content have significantly improved the realism of 3D and 4D generation. However, most existing methods prioritize appearance consistency while neglecting underlying physical principles, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Siwei Meng , Yawei Luo , Ping Liu

It is inherently ambiguous to lift 2D results from pre-trained diffusion models to a 3D world for text-to-3D generation. 2D diffusion models solely learn view-agnostic priors and thus lack 3D knowledge during the lifting, leading to the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Weiyu Li , Rui Chen , Xuelin Chen , Ping Tan

Object manipulation in images aims to not only edit the object's presentation but also gift objects with motion. Previous methods encountered challenges in concurrently handling static editing and dynamic generation, while also struggling…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Ruisi Zhao , Zechuan Zhang , Zongxin Yang , Yi Yang

Text-driven 3D scene generation has seen significant advancements recently. However, most existing methods generate single-view images using generative models and then stitch them together in 3D space. This independent generation for each…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Wenrui Li , Fucheng Cai , Yapeng Mi , Zhe Yang , Wangmeng Zuo , Xingtao Wang , Xiaopeng Fan

Recently, 3D Gaussian splatting (3D-GS) has achieved great success in reconstructing and rendering real-world scenes. To transfer the high rendering quality to generation tasks, a series of research works attempt to generate 3D-Gaussian…

Computer Vision and Pattern Recognition · Computer Science 2024-06-27 Taoran Yi , Jiemin Fang , Zanwei Zhou , Junjie Wang , Guanjun Wu , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Xinggang Wang , Qi Tian

Generative AI tools are becoming more prevalent in 3D modeling, enabling users to manipulate or create new models with text or images as inputs. This makes it easier for users to rapidly customize and iterate on their 3D designs and explore…

Human-Computer Interaction · Computer Science 2024-04-18 Faraz Faruqi , Yingtao Tian , Vrushank Phadnis , Varun Jampani , Stefanie Mueller

Recently, significant advances have been made in 3D object generation. Building upon the generated geometry, current pipelines typically employ image diffusion models to generate multi-view RGB images, followed by UV texture reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Mingqi Shao , Feng Xiong , Zhaoxu Sun , Mu Xu

The recent advances in text and image synthesis show a great promise for the future of generative models in creative fields. However, a less explored area is the one of 3D model generation, with a lot of potential applications to game…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Antoine Schnepf , Flavian Vasile , Ugo Tanielian

3D Gaussian Splatting (3DGS) achieves an appealing balance between rendering quality and efficiency, but relies on approximating 3D Gaussians as 2D projections--an assumption that degrades accuracy, especially under generic large…

Graphics · Computer Science 2026-03-13 Zixun Huang , Cho-Ying Wu , Yuliang Guo , Xinyu Huang , Liu Ren

We introduce "ImageDream," an innovative image-prompt, multi-view diffusion model for 3D object generation. ImageDream stands out for its ability to produce 3D models of higher quality compared to existing state-of-the-art,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Peng Wang , Yichun Shi

This paper explores the burgeoning field of 3D content generation within the landscape of Artificial Intelligence Generated Content (AIGC) and large-scale models. It investigates innovative methods like Text-to-3D and Image-to-3D, which…

Graphics · Computer Science 2024-05-27 Ke Zhao , Andreas Larsen

3D city generation is a desirable yet challenging task, since humans are more sensitive to structural distortions in urban environments. Additionally, generating 3D cities is more complex than 3D natural scenes since buildings, as objects…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Haozhe Xie , Zhaoxi Chen , Fangzhou Hong , Ziwei Liu

3D generation methods have shown visually compelling results powered by diffusion image priors. However, they often fail to produce realistic geometric details, resulting in overly smooth surfaces or geometric details inaccurately baked in…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Ruihan Gao , Kangle Deng , Gengshan Yang , Wenzhen Yuan , Jun-Yan Zhu

We introduce a new generative approach for synthesizing 3D geometry and images from single-view collections. Most existing approaches predict volumetric density to render multi-view consistent images. By employing volumetric rendering using…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Salvatore Esposito , Qingshan Xu , Kacper Kania , Charlie Hewitt , Octave Mariotti , Lohit Petikam , Julien Valentin , Arno Onken , Oisin Mac Aodha

Recent advances in 3D content creation mostly leverage optimization-based 3D generation via score distillation sampling (SDS). Though promising results have been exhibited, these methods often suffer from slow per-sample optimization,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiaxiang Tang , Jiawei Ren , Hang Zhou , Ziwei Liu , Gang Zeng