English
Related papers

Related papers: GraphicsDreamer: Image to 3D Generation with Physi…

200 papers

3D generation has witnessed significant advancements, yet efficiently producing high-quality 3D assets from a single image remains challenging. In this paper, we present a triplane autoencoder, which encodes 3D models into a compact…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Bowen Zhang , Tianyu Yang , Yu Li , Lei Zhang , Xi Zhao

We tackle the problem of text-driven 3D generation from a geometry alignment perspective. Given a set of text prompts, we aim to generate a collection of objects with semantically corresponding parts aligned across them. Recent methods…

Despite recent advancements in neural 3D reconstruction, the dependence on dense multi-view captures restricts their broader applicability. Additionally, 3D scene generation is vital for advancing embodied AI and world models, which depend…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Yuxin Zhang , Ziyu Lu , Hongbo Duan , Keyu Fan , Pengting Luo , Peiyu Zhuang , Mengyu Yang , Houde Liu

Recent developments in 3D generative AI enable users to create bespoke 3D models from text or image prompts. However, these approaches provide limited control over spatial structure, making them ill suited for tasks requiring precise…

Human-Computer Interaction · Computer Science 2026-05-21 Faraz Faruqi , Demircan Tas , Arthur Caetano , Niccolò Meniconi , Oğuz Arslan , Misha Sra , Ruofei Du , Stefanie Mueller , Mustafa Doga Dogan

Graph diffusion models have made significant progress in learning structured graph data and have demonstrated strong potential for predictive tasks. Existing approaches typically embed node, edge, and graph-level features into a unified…

Machine Learning · Computer Science 2025-12-12 Yisen Gao , Xingcheng Fu , Qingyun Sun , Jianxin Li , Xianxian Li

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that generates both image and depth map data from a given text prompt, allowing users to generate RGBD images from text prompts. The LDM3D model is fine-tuned on a dataset…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Gabriela Ben Melech Stan , Diana Wofk , Scottie Fox , Alex Redden , Will Saxton , Jean Yu , Estelle Aflalo , Shao-Yen Tseng , Fabio Nonato , Matthias Muller , Vasudev Lal

Advancements in AI for medical imaging offer significant potential. However, their applications are constrained by the limited availability of data and the reluctance of medical centers to share it due to patient privacy concerns.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Marvin Seyfarth , Salman Ul Hassan Dar , Isabelle Ayx , Matthias Alexander Fink , Stefan O. Schoenberg , Hans-Ulrich Kauczor , Sandy Engelhardt

We introduce PartCrafter, the first structured 3D generative model that jointly synthesizes multiple semantically meaningful and geometrically distinct 3D meshes from a single RGB image. Unlike existing methods that either produce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yuchen Lin , Chenguo Lin , Panwang Pan , Honglei Yan , Yiqiang Feng , Yadong Mu , Katerina Fragkiadaki

Generation of graphs is a major challenge for real-world tasks that require understanding the complex nature of their non-Euclidean structures. Although diffusion models have achieved notable success in graph generation recently, they are…

Machine Learning · Computer Science 2024-06-04 Jaehyeong Jo , Dongki Kim , Sung Ju Hwang

Creating realistic 3D head assets for virtual characters that match a precise artistic vision remains labor-intensive. We present a novel framework that streamlines this process by providing artists with intuitive control over generated 3D…

Autonomous robots typically need to construct representations of their surroundings and adapt their motions to the geometry of their environment. Here, we tackle the problem of constructing a policy model for collision-free motion…

Robotics · Computer Science 2025-05-27 Weiming Zhi , Ziyong Ma , Tianyi Zhang , Matthew Johnson-Roberson

We present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Guocheng Qian , Jinjie Mai , Abdullah Hamdi , Jian Ren , Aliaksandr Siarohin , Bing Li , Hsin-Ying Lee , Ivan Skorokhodov , Peter Wonka , Sergey Tulyakov , Bernard Ghanem

3D vector graphics play a crucial role in various applications including 3D shape retrieval, conceptual design, and virtual reality interactions due to their ability to capture essential structural information with minimal representation.…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Chuang Wang , Haitao Zhou , Ling Luo , Qian Yu

High-fidelity 3D garment synthesis from text is desirable yet challenging for digital avatar creation. Recent diffusion-based approaches via Score Distillation Sampling (SDS) have enabled new possibilities but either intricately couple with…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yufei Liu , Junshu Tang , Chu Zheng , Shijie Zhang , Jinkun Hao , Junwei Zhu , Dongjin Huang

Despite the astonishing progress in generative AI, 4D dynamic object generation remains an open challenge. With limited high-quality training data and heavy computing requirements, the combination of hallucinating unseen geometry together…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Lu Sang , Zehranaz Canfes , Dongliang Cao , Riccardo Marin , Florian Bernard , Daniel Cremers

Generating realistic 3D indoor scenes from user inputs remains a challenging problem in computer vision and graphics, requiring careful balance of geometric consistency, spatial relationships, and visual realism. While neural generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Mengqi Zhou , Xipeng Wang , Yuxi Wang , Zhaoxiang Zhang

The ability to generate highly realistic 2D images from mere text prompts has recently made huge progress in terms of speed and quality, thanks to the advent of image diffusion models. Naturally, the question arises if this can be also…

Computer Vision and Pattern Recognition · Computer Science 2023-04-26 Christina Tsalicoglou , Fabian Manhardt , Alessio Tonioni , Michael Niemeyer , Federico Tombari

We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Nanyang Wang , Yinda Zhang , Zhuwen Li , Yanwei Fu , Wei Liu , Yu-Gang Jiang

With the onset of diffusion-based generative models and their ability to generate text-conditioned images, content generation has received a massive invigoration. Recently, these models have been shown to provide useful guidance for the…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Alexander Vilesov , Pradyumna Chari , Achuta Kadambi