English
Related papers

Related papers: UniDream: Unifying Diffusion Priors for Relightabl…

200 papers

The increased demand for 3D data in AR/VR, robotics and gaming applications, gave rise to powerful generative pipelines capable of synthesizing high-quality 3D objects. Most of these models rely on the Score Distillation Sampling (SDS)…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Ziyu Wan , Despoina Paschalidou , Ian Huang , Hongyu Liu , Bokui Shen , Xiaoyu Xiang , Jing Liao , Leonidas Guibas

In this work, we introduce \textbf{Wonder3D++}, a novel method for efficiently generating high-fidelity textured meshes from single-view images. Recent methods based on Score Distillation Sampling (SDS) have shown the potential to recover…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yuxiao Yang , Xiao-Xiao Long , Zhiyang Dou , Cheng Lin , Yuan Liu , Qingsong Yan , Yuexin Ma , Haoqian Wang , Zhiqiang Wu , Wei Yin

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

Text-to-Image diffusion models have made tremendous progress over the past two years, enabling the generation of highly realistic images based on open-domain text descriptions. However, despite their success, text descriptions often…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Shihao Zhao , Dongdong Chen , Yen-Chun Chen , Jianmin Bao , Shaozhe Hao , Lu Yuan , Kwan-Yee K. Wong

We present TexFusion (Texture Diffusion), a new method to synthesize textures for given 3D geometries, using large-scale text-guided image diffusion models. In contrast to recent works that leverage 2D text-to-image diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Tianshi Cao , Karsten Kreis , Sanja Fidler , Nicholas Sharp , Kangxue Yin

Text-driven 3D scene generation is widely applicable to video gaming, film industry, and metaverse applications that have a large demand for 3D scenes. However, existing text-to-3D generation methods are limited to producing 3D objects with…

Computer Vision and Pattern Recognition · Computer Science 2024-02-01 Jingbo Zhang , Xiaoyu Li , Ziyu Wan , Can Wang , Jing Liao

Large-scale diffusion models have achieved remarkable success in generating high-quality images from textual descriptions, gaining popularity across various applications. However, the generation of layered content, such as transparent…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Yusuf Dalva , Yijun Li , Qing Liu , Nanxuan Zhao , Jianming Zhang , Zhe Lin , Pinar Yanardag

We introduce MD-ProjTex, a method for fast and consistent text-guided texture generation for 3D shapes using pretrained text-to-image diffusion models. At the core of our approach is a multi-view consistency mechanism in UV space, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ahmet Burak Yildirim , Mustafa Utku Aydogdu , Duygu Ceylan , Aysegul Dundar

In recent times, the generation of 3D assets from text prompts has shown impressive results. Both 2D and 3D diffusion models can help generate decent 3D objects based on prompts. 3D diffusion models have good 3D consistency, but their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Taoran Yi , Jiemin Fang , Junjie Wang , Guanjun Wu , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Qi Tian , Xinggang Wang

Current text-to-3D generation methods based on score distillation often suffer from geometric inconsistencies, leading to repeated patterns across different poses of 3D assets. This issue, known as the Multi-Face Janus problem, arises…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Chenxi Zheng , Yihong Lin , Bangzhen Liu , Xuemiao Xu , Yongwei Nie , Shengfeng He

Existing text-based 3D generation methods generate attractive results but lack detailed geometry control. Sketches, known for their conciseness and expressiveness, have contributed to intuitive 3D modeling but are confined to producing…

Graphics · Computer Science 2024-05-15 Feng-Lin Liu , Hongbo Fu , Yu-Kun Lai , Lin Gao

We present a novel diffusion-based approach for coherent 3D scene reconstruction from a single RGB image. Our method utilizes an image-conditioned 3D scene diffusion model to simultaneously denoise the 3D poses and geometries of all objects…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Manuel Dahnert , Angela Dai , Norman Müller , Matthias Nießner

The introduction of generative models has significantly advanced image super-resolution (SR) in handling real-world degradations. However, they often incur fidelity-related issues, particularly distorting textual structures. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Qiming Hu , Linlong Fan , Yiyan Luo , Yuhang Yu , Xiaojie Guo , Qingnan Fan

Text-driven 3D scene generation techniques have made rapid progress in recent years. Their success is mainly attributed to using existing generative models to iteratively perform image warping and inpainting to generate 3D scenes. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Frank Zhang , Yibo Zhang , Quan Zheng , Rui Ma , Wei Hua , Hujun Bao , Weiwei Xu , Changqing Zou

We present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jingxiang Sun , Bo Zhang , Ruizhi Shao , Lizhen Wang , Wen Liu , Zhenda Xie , Yebin Liu

Recent advances in the diffusion models have significantly improved text-to-image generation. However, generating videos from text is a more challenging task than generating images from text, due to the much larger dataset and higher…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Taegyeong Lee , Soyeong Kwon , Taehwan Kim

In the realm of 3D reconstruction from 2D images, a persisting challenge is to achieve high-precision reconstructions devoid of 3D Ground Truth data reliance. We present UNeR3D, a pioneering unsupervised methodology that sets a new standard…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Hongbin Lin , Juangui Xu , Qingfeng Xu , Zhengyu Hu , Handing Xu , Yunzhi Chen , Yongjun Hu , Zhenguo Nie

In this work, we introduce Wonder3D, a novel method for efficiently generating high-fidelity textured meshes from single-view images.Recent methods based on Score Distillation Sampling (SDS) have shown the potential to recover 3D geometry…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Xiaoxiao Long , Yuan-Chen Guo , Cheng Lin , Yuan Liu , Zhiyang Dou , Lingjie Liu , Yuexin Ma , Song-Hai Zhang , Marc Habermann , Christian Theobalt , Wenping Wang

Modern text-to-image diffusion models encode rich visual priors, but expose them only through one-way text-conditioned generation. Existing unified vision--language models derived from them recover bidirectional capability through…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Eric Tillmann Bill , Enis Simsar , Alessio Tonioni , Thomas Hofmann

In this work, we investigate the problem of creating high-fidelity 3D content from only a single image. This is inherently challenging: it essentially involves estimating the underlying 3D geometry while simultaneously hallucinating unseen…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Junshu Tang , Tengfei Wang , Bo Zhang , Ting Zhang , Ran Yi , Lizhuang Ma , Dong Chen