English
Related papers

Related papers: DreamSpace: Dreaming Your Room Space with Text-Dri…

200 papers

The recent success of pre-trained diffusion models unlocks the possibility of the automatic generation of textures for arbitrary 3D meshes in the wild. However, these models are trained in the screen space, while converting them to a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Hongkun Zhang , Zherong Pan , Congyi Zhang , Lifeng Zhu , Xifeng Gao

We present DiffInDScene, a novel framework for tackling the problem of high-quality 3D indoor scene generation, which is challenging due to the complexity and diversity of the indoor scene geometry. Although diffusion-based generative…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Xiaoliang Ju , Zhaoyang Huang , Yijin Li , Guofeng Zhang , Yu Qiao , Hongsheng Li

We introduce VERTEX, an effective solution to recover 3D shape and intrinsic texture of vehicles from uncalibrated monocular input in real-world street environments. To fully utilize the template prior of vehicles, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiaochen Zhao , Zerong Zheng , Chaonan Ji , Zhenyi Liu , Siyou Lin , Tao Yu , Jinli Suo , Yebin Liu

We present Make-A-Texture, a new framework that efficiently synthesizes high-resolution texture maps from textual prompts for given 3D geometries. Our approach progressively generates textures that are consistent across multiple viewpoints…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Xiaoyu Xiang , Liat Sless Gorelik , Yuchen Fan , Omri Armstrong , Forrest Iandola , Yilei Li , Ita Lifshitz , Rakesh Ranjan

3D Gaussian splatting (3DGS) has demonstrated exceptional performance in image-based 3D reconstruction and real-time rendering. However, regions with complex textures require numerous Gaussians to capture significant color variations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Binxiao Huang , Zhihao Li , Shiyong Liu , Xiao Tang , Jiajun Tang , Jiaqi Lin , Yuxin Cheng , Zhenyu Chen , Xiaofei Wu , Ngai Wong

Traditional 3D garment creation is labor-intensive, involving sketching, modeling, UV mapping, and texturing, which are time-consuming and costly. Recent advances in diffusion-based generative models have enabled new possibilities for 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Boqian Li , Xuan Li , Ying Jiang , Tianyi Xie , Feng Gao , Huamin Wang , Yin Yang , Chenfanfu Jiang

Text-conditioned diffusion models can generate impressive images, but fall short when it comes to fine-grained control. Unlike direct-editing tools like Photoshop, text conditioned models require the artist to perform "prompt engineering,"…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Michelle Shu , Charles Herrmann , Richard Strong Bowen , Forrester Cole , Ramin Zabih

Text-to-3D generation has recently seen significant progress. To enhance its practicality in real-world applications, it is crucial to generate multiple independent objects with interactions, similar to layer-compositing in 2D image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Zizheng Yan , Jiapeng Zhou , Fanpeng Meng , Yushuang Wu , Lingteng Qiu , Zisheng Ye , Shuguang Cui , Guanying Chen , Xiaoguang Han

Generating complete 360-degree panoramas from narrow field of view images is ongoing research as omnidirectional RGB data is not readily available. Existing GAN-based approaches face some barriers to achieving higher quality output, and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tianhao Wu , Chuanxia Zheng , Tat-Jen Cham

Text-guided domain adaptation and generation of 3D-aware portraits find many applications in various fields. However, due to the lack of training data and the challenges in handling the high variety of geometry and appearance, the existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Biwen Lei , Kai Yu , Mengyang Feng , Miaomiao Cui , Xuansong Xie

3D object generation from a single image involves estimating the full 3D geometry and texture of unseen views from an unposed RGB image captured in the wild. Accurately reconstructing an object's complete 3D structure and texture has…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Hritam Basak , Hadi Tabatabaee , Shreekant Gayaka , Ming-Feng Li , Xin Yang , Cheng-Hao Kuo , Arnie Sen , Min Sun , Zhaozheng Yin

Recently, text-to-image generation has exhibited remarkable advancements, with the ability to produce visually impressive results. In contrast, text-to-3D generation has not yet reached a comparable level of quality. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yukang Cao , Yan-Pei Cao , Kai Han , Ying Shan , Kwan-Yee K. Wong

Panoramic video generation aims to synthesize 360-degree immersive videos, holding significant importance in the fields of VR, world models, and spatial intelligence. Existing works fail to synthesize high-quality panoramic videos due to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zixun Fang , Kai Zhu , Zhiheng Liu , Yu Liu , Wei Zhai , Yang Cao , Zheng-Jun Zha

This paper aims to generate materials for 3D meshes from text descriptions. Unlike existing methods that synthesize texture maps, we propose to generate segment-wise procedural material graphs as the appearance representation, which…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Shangzan Zhang , Sida Peng , Tao Xu , Yuanbo Yang , Tianrun Chen , Nan Xue , Yujun Shen , Hujun Bao , Ruizhen Hu , Xiaowei Zhou

3D scene modeling techniques serve as the bedrocks in the geospatial engineering and computer science, which drives many applications ranging from automated driving, terrain mapping, navigation, virtual, augmented, mixed, and extended…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Shuang Song

Painting textures for existing geometries is a critical yet labor-intensive process in 3D asset generation. Recent advancements in text-to-image (T2I) models have led to significant progress in texture generation. Most existing research…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Yifei Feng , Mingxin Yang , Shuhui Yang , Sheng Zhang , Jiaao Yu , Zibo Zhao , Yuhong Liu , Jie Jiang , Chunchao Guo

We introduce DreamDrone, a novel zero-shot and training-free pipeline for generating unbounded flythrough scenes from textual prompts. Different from other methods that focus on warping images frame by frame, we advocate explicitly warping…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Hanyang Kong , Dongze Lian , Michael Bi Mi , Xinchao Wang

Texture cues on 3D objects are key to compelling visual representations, with the possibility to create high visual fidelity with inherent spatial consistency across different views. Since the availability of textured 3D shapes remains very…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yawar Siddiqui , Justus Thies , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

Automatically generating multiview illusions is a compelling challenge, where a single piece of visual content offers distinct interpretations from different viewing perspectives. Traditional methods, such as shadow art and wire art, create…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yue Feng , Vaibhav Sanjay , Spencer Lutz , Badour AlBahar , Songwei Ge , Jia-Bin Huang

Personalized text-to-image models allow users to generate varied styles of images (specified with a sentence) for an object (specified with a set of reference images). While remarkable results have been achieved using diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Fanyue Wei , Wei Zeng , Zhenyang Li , Dawei Yin , Lixin Duan , Wen Li