English
Related papers

Related papers: Textured 3D Regenerative Morphing with 3D Diffusio…

200 papers

Diffusion-based voxel prior modelling is challenging for the reconstruction of large-scale 3D porous microstructures. Due to the demanding requirements for simultaneously modelling both the continuous pore morphology and the discrete…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Yue Shi , Peng Wang , Mingzhe Yu , Yunlong Zhao , Li Liu , Gareth D Hatton , Yan Lyu , Liangxiu Han

We introduce FabricDiffusion, a method for transferring fabric textures from a single clothing image to 3D garments of arbitrary shapes. Existing approaches typically synthesize textures on the garment surface through 2D-to-3D texture…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Cheng Zhang , Yuanhao Wang , Francisco Vicente Carrasco , Chenglei Wu , Jinlong Yang , Thabo Beeler , Fernando De la Torre

Establishing reliable correspondences is crucial for all registration tasks, including 2D image registration, 3D point cloud registration, and 2D-3D image-to-point cloud registration. However, these tasks are often complicated by challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Qianliang Wu , Haobo Jiang , Yaqing Ding , Lei Luo , Jun Li , Jin Xie , Xiaojun Wu , Jian Yang

Generating high-quality 3D objects from textual descriptions remains a challenging problem due to computational cost, the scarcity of 3D data, and complex 3D representations. We introduce Geometry Image Diffusion (GIMDiffusion), a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-09-06 Slava Elizarov , Ciara Rowles , Simon Donné

Diffusion models face significant challenges when employed for large-scale medical image reconstruction in real practice such as 3D Computed Tomography (CT). Due to the demanding memory, time, and data requirements, it is difficult to train…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Bowen Song , Jason Hu , Zhaoxu Luo , Jeffrey A. Fessler , Liyue Shen

Automatically generating multiview illusions is a compelling challenge, where a single piece of visual content offers distinct interpretations from different viewing perspectives. Traditional methods, such as shadow art and wire art, create…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Yue Feng , Vaibhav Sanjay , Spencer Lutz , Badour AlBahar , Songwei Ge , Jia-Bin Huang

We propose a novel image editing technique that enables 3D manipulations on single images, such as object rotation and translation. Existing 3D-aware image editing approaches typically rely on synthetic multi-view datasets for training…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Ruicheng Wang , Jianfeng Xiang , Jiaolong Yang , Xin Tong

Diffusion models learn strong image priors that can be leveraged to solve inverse problems like medical image reconstruction. However, for real-world applications such as 3D Computed Tomography (CT) imaging, directly training diffusion…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Taewon Yang , Jason Hu , Jeffrey A. Fessler , Liyue Shen

We present Surf-D, a novel method for generating high-quality 3D shapes as Surfaces with arbitrary topologies using Diffusion models. Previous methods explored shape generation with different representations and they suffer from limited…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Zhengming Yu , Zhiyang Dou , Xiaoxiao Long , Cheng Lin , Zekun Li , Yuan Liu , Norman Müller , Taku Komura , Marc Habermann , Christian Theobalt , Xin Li , Wenping Wang

A fundamental challenge in text-to-3D face generation is achieving high-quality geometry. The core difficulty lies in the arbitrary and intricate distribution of vertices in 3D space, making it challenging for existing models to establish…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Junyi Zhang , Yiming Wang , Yunhong Lu , Qichao Wang , Wenzhe Qian , Xiaoyin Xu , David Gu , Min Zhang

Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yiming Zhang , Zhe Wang , Xinjie Li , Yunchen Yuan , Chengsong Zhang , Xiao Sun , Zhihang Zhong , Jian Wang

In this work, we focus on synthesizing high-quality textures on 3D meshes. We present Point-UV diffusion, a coarse-to-fine pipeline that marries the denoising diffusion model with UV mapping to generate 3D consistent and high-quality…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xin Yu , Peng Dai , Wenbo Li , Lan Ma , Zhengzhe Liu , Xiaojuan Qi

Neural reconstruction approaches are rapidly emerging as the preferred representation for 3D scenes, but their limited editability is still posing a challenge. In this work, we propose an approach for 3D scene inpainting -- the task of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Ashkan Mirzaei , Riccardo De Lutio , Seung Wook Kim , David Acuna , Jonathan Kelly , Sanja Fidler , Igor Gilitschenski , Zan Gojcic

We propose a novel 3d colored shape reconstruction method from a single RGB image through diffusion model. Diffusion models have shown great development potentials for high-quality 3D shape generation. However, most existing work based on…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Bo Li , Xiaolin Wei , Fengwei Chen , Bin Liu

We present DreamCraft3D, a hierarchical 3D content generation method that produces high-fidelity and coherent 3D objects. We tackle the problem by leveraging a 2D reference image to guide the stages of geometry sculpting and texture…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Jingxiang Sun , Bo Zhang , Ruizhi Shao , Lizhen Wang , Wen Liu , Zhenda Xie , Yebin Liu

We propose SparseFusion, a sparse view 3D reconstruction approach that unifies recent advances in neural rendering and probabilistic image generation. Existing approaches typically build on neural rendering with re-projected features but…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zhizhuo Zhou , Shubham Tulsiani

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Recent advances in generative diffusion models have enabled the previously unfeasible capability of generating 3D assets from a single input image or a text prompt. In this work, we aim to enhance the quality and functionality of these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Xiyi Chen , Marko Mihajlovic , Shaofei Wang , Sergey Prokudin , Siyu Tang

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

Diffusion-based text-to-image models ignited immense attention from the vision community, artists, and content creators. Broad adoption of these models is due to significant improvement in the quality of generations and efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Tianfu Wang , Menelaos Kanakis , Konrad Schindler , Luc Van Gool , Anton Obukhov