English
Related papers

Related papers: Direct3D: Scalable Image-to-3D Generation via 3D L…

200 papers

Generating novel views of a natural scene, e.g., every-day scenes both indoors and outdoors, from a single view is an under-explored problem, even though it is an organic extension to the object-centric novel view synthesis. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Wonbong Jang , Jonathan Tremblay , Lourdes Agapito

Recent advances in 3D generative models have rapidly improved image-to-3D synthesis quality, enabling higher-resolution geometry and more realistic appearance. Yet fidelity, which measures pixel-level faithfulness of the generated 3D asset…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Dong-Yang Li , Wang Zhao , Yuxin Chen , Wenbo Hu , Meng-Hao Guo , Fang-Lue Zhang , Ying Shan , Shi-Min Hu

We present a novel approach for enhancing the resolution and geometric fidelity of 3D Gaussian Splatting (3DGS) beyond native training resolution. Current 3DGS methods are fundamentally limited by their input resolution, producing…

Graphics · Computer Science 2025-06-10 Shuja Khalid , Mohamed Ibrahim , Yang Liu

Diffusion models have recently emerged as a powerful technique in image generation, especially for image super-resolution tasks. While 2D diffusion models significantly enhance the resolution of individual images, existing diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Bohao Chen , Yanchao Zhang , Yanan Lv , Hua Han , Xi Chen

High-resolution image synthesis remains a core challenge in generative modeling, particularly in balancing computational efficiency with the preservation of fine-grained visual detail. We present Latent Wavelet Diffusion (LWD), a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Luigi Sigillo , Shengfeng He , Danilo Comminiello

High-fidelity 3D asset generation is crucial for various industries. While recent 3D pretrained models show strong capability in producing realistic content, most are built upon diffusion models and follow a two-stage pipeline that first…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Guanjun Wu , Jiemin Fang , Chen Yang , Sikuang Li , Taoran Yi , Jia Lu , Zanwei Zhou , Jiazhong Cen , Lingxi Xie , Xiaopeng Zhang , Wei Wei , Wenyu Liu , Xinggang Wang , Qi Tian

High-fidelity 3D object synthesis remains significantly more challenging than 2D image generation due to the unstructured nature of mesh data and the cubic complexity of dense volumetric grids. Existing two-stage pipelines-compressing…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Zhihao Li , Yufei Wang , Heliang Zheng , Yihao Luo , Bihan Wen

Multimodal generative models require a unified approach to handle both discrete data (e.g., text and code) and continuous data (e.g., image, audio, video). In this work, we propose Latent Language Modeling (LatentLM), which seamlessly…

Computation and Language · Computer Science 2024-12-12 Yutao Sun , Hangbo Bao , Wenhui Wang , Zhiliang Peng , Li Dong , Shaohan Huang , Jianyong Wang , Furu Wei

Recent advancements in 3D generative modeling have significantly improved the generation realism, yet the field is still hampered by existing representations, which struggle to capture assets with complex topologies and detailed appearance.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Jianfeng Xiang , Xiaoxue Chen , Sicheng Xu , Ruicheng Wang , Zelong Lv , Yu Deng , Hongyuan Zhu , Yue Dong , Hao Zhao , Nicholas Jing Yuan , Jiaolong Yang

Autoregressive (AR) models have achieved remarkable success in natural language and image generation, but their application to 3D shape modeling remains largely unexplored. Unlike diffusion models, AR models enable more efficient and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Tejaswini Medi , Arianna Rampini , Pradyumna Reddy , Pradeep Kumar Jayaraman , Margret Keuper

Recent 3D human generative models have achieved remarkable progress by learning 3D-aware GANs from 2D images. However, existing 3D human generative methods model humans in a compact 1D latent space, ignoring the articulated structure and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Tao Hu , Fangzhou Hong , Ziwei Liu

We present DirectTriGS, a novel framework designed for 3D object generation with Gaussian Splatting (GS). GS-based rendering for 3D content has gained considerable attention recently. However, there has been limited exploration in directly…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xiaoliang Ju , Hongsheng Li

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Text-to-3D with diffusion models has achieved remarkable progress in recent years. However, existing methods either rely on score distillation-based optimization which suffer from slow inference, low diversity and Janus problems, or are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Jiahao Li , Hao Tan , Kai Zhang , Zexiang Xu , Fujun Luan , Yinghao Xu , Yicong Hong , Kalyan Sunkavalli , Greg Shakhnarovich , Sai Bi

We present I2V3D, a novel framework for animating static images into dynamic videos with precise 3D control, leveraging the strengths of both 3D geometry guidance and advanced generative models. Our approach combines the precision of a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Zhiyuan Zhang , Dongdong Chen , Jing Liao

Recent progress in text-to-3D object generation enables the synthesis of detailed geometry from text input by leveraging 2D diffusion models and differentiable 3D representations. However, the approaches often suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Ming He , Zhixiang Chen , Steve Maddock

Generating high-fidelity, seamless textures directly on 3D surfaces, what we term 3D-native texturing, remains a fundamental open challenge, with the potential to overcome long-standing limitations of UV-based and multi-view projection…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Chia-Hao Chen , Zi-Xin Zou , Yan-Pei Cao , Ze Yuan , Guan Luo , Xiaojuan Qi , Ding Liang , Song-Hai Zhang , Yuan-Chen Guo

Diffusion models learn strong image priors that can be leveraged to solve inverse problems like medical image reconstruction. However, for real-world applications such as 3D Computed Tomography (CT) imaging, directly training diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Taewon Yang , Jason Hu , Jeffrey A. Fessler , Liyue Shen

3D image display is essential for next-generation volumetric imaging; however, dense depth multiplexing for 3D image projection remains challenging because diffraction-induced cross-talk rapidly increases as the axial image planes get…

Diffusion Transformers have recently shown remarkable effectiveness in generating high-quality 3D point clouds. However, training voxel-based diffusion models for high-resolution 3D voxels remains prohibitively expensive due to the cubic…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Shentong Mo , Enze Xie , Yue Wu , Junsong Chen , Matthias Nießner , Zhenguo Li