English
Related papers

Related papers: Text2Tex: Text-driven Texture Synthesis via Diffus…

200 papers

This work investigates text-to-texture synthesis using diffusion models to generate physically-based texture maps. We aim to achieve realistic model appearances under varying lighting conditions. A prominent solution for the task is score…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Mishan Aliev , Dmitry Baranchuk , Kirill Struminsky

This paper presents Paint3D, a novel coarse-to-fine generative framework that is capable of producing high-resolution, lighting-less, and diverse 2K UV texture maps for untextured 3D meshes conditioned on text or image inputs. The key…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Xianfang Zeng , Xin Chen , Zhongqi Qi , Wen Liu , Zibo Zhao , Zhibin Wang , Bin Fu , Yong Liu , Gang Yu

We present UniTEX, a novel two-stage 3D texture generation framework to create high-quality, consistent textures for 3D assets. Existing approaches predominantly rely on UV-based inpainting to refine textures after reprojecting the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yixun Liang , Kunming Luo , Xiao Chen , Rui Chen , Hongyu Yan , Weiyu Li , Jiarui Liu , Ping Tan

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

This paper aims to generate materials for 3D meshes from text descriptions. Unlike existing methods that synthesize texture maps, we propose to generate segment-wise procedural material graphs as the appearance representation, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Tao Xu , Yuanbo Yang , Tianrun Chen , Nan Xue , Yujun Shen , Hujun Bao , Ruizhen Hu , Xiaowei Zhou

We present GOATex, a diffusion-based method for 3D mesh texturing that generates high-quality textures for both exterior and interior surfaces. While existing methods perform well on visible regions, they inherently lack mechanisms to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Hyunjin Kim , Kunho Kim , Adam Lee , Wonkwang Lee

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

We introduce Text2Immersion, an elegant method for producing high-quality 3D immersive scenes from text prompts. Our proposed pipeline initiates by progressively generating a Gaussian cloud using pre-trained 2D diffusion and depth…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Hao Ouyang , Kathryn Heal , Stephen Lombardi , Tiancheng Sun

We present TextureDreamer, a novel image-guided texture synthesis method to transfer relightable textures from a small number of input images (3 to 5) to target 3D shapes across arbitrary categories. Texture creation is a pivotal challenge…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yu-Ying Yeh , Jia-Bin Huang , Changil Kim , Lei Xiao , Thu Nguyen-Phuoc , Numair Khan , Cheng Zhang , Manmohan Chandraker , Carl S Marshall , Zhao Dong , Zhengqin Li

Scene text detection techniques have garnered significant attention due to their wide-ranging applications. However, existing methods have a high demand for training data, and obtaining accurate human annotations is labor-intensive and…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Ling Fu , Zijie Wu , Yingying Zhu , Yuliang Liu , Xiang Bai

This paper presents a novel approach to inpainting 3D regions of a scene, given masked multi-view images, by distilling a 2D diffusion model into a learned 3D scene representation (e.g. a NeRF). Unlike 3D generative methods that explicitly…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Kira Prabhu , Jane Wu , Lynn Tsai , Peter Hedman , Dan B Goldman , Ben Poole , Michael Broxton

The problem of text-guided image generation is a complex task in Computer Vision, with various applications, including creating visually appealing artwork and realistic product images. One popular solution widely used for this task is the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Halil Faruk Karagoz , Gulcin Baykal , Irem Arikan Eksi , Gozde Unal

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

The generation of industrial Computer-Aided Design (CAD) models from user requests and specifications is crucial to enhancing efficiency in modern manufacturing. Traditional methods of CAD generation rely heavily on manual inputs and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Mohsen Yavartanoo , Sangmin Hong , Reyhaneh Neshatavar , Kyoung Mu Lee

Recently, diffusion-based image generation methods are credited for their remarkable text-to-image generation capabilities, while still facing challenges in accurately generating multilingual scene text images. To tackle this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Lingjun Zhang , Xinyuan Chen , Yaohui Wang , Yue Lu , Yu Qiao

We present a diffusion-based model for 3D-aware generative novel view synthesis from as few as a single input image. Our model samples from the distribution of possible renderings consistent with the input and, even in the presence of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-06 Eric R. Chan , Koki Nagano , Matthew A. Chan , Alexander W. Bergman , Jeong Joon Park , Axel Levy , Miika Aittala , Shalini De Mello , Tero Karras , Gordon Wetzstein

We present EucliDreamer, a simple and effective method to generate textures for 3D models given text prompts and meshes. The texture is parametrized as an implicit function on the 3D surface, which is optimized with the Score Distillation…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Cindy Le , Congrui Hetang , Chendi Lin , Ang Cao , Yihui He

We consider the task of generating realistic 3D shapes, which is useful for a variety of applications such as automatic scene generation and physical simulation. Compared to other 3D representations like voxels and point clouds, meshes are…

Graphics · Computer Science 2023-04-18 Zhen Liu , Yao Feng , Michael J. Black , Derek Nowrouzezahrai , Liam Paull , Weiyang Liu

The diffusion model has been proven a powerful generative model in recent years, yet remains a challenge in generating visual text. Several methods alleviated this issue by incorporating explicit text position and content as guidance on…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Jingye Chen , Yupan Huang , Tengchao Lv , Lei Cui , Qifeng Chen , Furu Wei

Text-guided diffusion models have shown superior performance in image/video generation and editing. While few explorations have been performed in 3D scenarios. In this paper, we discuss three fundamental and interesting problems on this…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Gang Li , Heliang Zheng , Chaoyue Wang , Chang Li , Changwen Zheng , Dacheng Tao