English
Related papers

Related papers: Image-Guided Geometric Stylization of 3D Meshes

200 papers

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dave Zhenyu Chen , Yawar Siddiqui , Hsin-Ying Lee , Sergey Tulyakov , Matthias Nießner

Modern 3D-GANs synthesize geometry and texture by training on large-scale datasets with a consistent structure. Training such models on stylized, artistic data, with often unknown, highly variable geometry, and camera information has not…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Rameen Abdal , Hsin-Ying Lee , Peihao Zhu , Menglei Chai , Aliaksandr Siarohin , Peter Wonka , Sergey Tulyakov

Generating high-quality meshes with complex structures and realistic surfaces is the primary goal of 3D generative models. Existing methods typically employ sequence data or deformable tetrahedral grids for mesh generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ruowei Wang , Jiaqi Li , Dan Zeng , Xueqi Ma , Zixiang Xu , Jianwei Zhang , Qijun Zhao

We introduce a framework for intrinsic latent diffusion models operating directly on the surfaces of 3D shapes, with the goal of synthesizing high-quality textures. Our approach is underpinned by two contributions: field latents, a latent…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Thomas W. Mitchel , Carlos Esteves , Ameesh Makadia

Geometric Deep Learning has recently made striking progress with the advent of continuous deep implicit fields. They allow for detailed modeling of watertight surfaces of arbitrary topology while not relying on a 3D Euclidean grid,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Benoit Guillard , Edoardo Remelli , Artem Lukoianov , Stephan R. Richter , Timur Bagautdinov , Pierre Baque , Pascal Fua

Learning-based 3D reconstruction methods have shown impressive results. However, most methods require 3D supervision which is often hard to obtain for real-world datasets. Recently, several works have proposed differentiable rendering…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Michael Niemeyer , Lars Mescheder , Michael Oechsle , Andreas Geiger

Triangulated meshes have become ubiquitous discrete-surface representations. In this paper we address the problem of how to maintain the manifold properties of a surface while it undergoes strong deformations that may cause topological…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Andrei Zaharescu , Edmond Boyer , Radu Horaud

In this work, we introduce Unique3D, a novel image-to-3D framework for efficiently generating high-quality 3D meshes from single-view images, featuring state-of-the-art generation fidelity and strong generalizability. Previous methods based…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Kailu Wu , Fangfu Liu , Zhihan Cai , Runjie Yan , Hanyang Wang , Yating Hu , Yueqi Duan , Kaisheng Ma

In this work, we focus on synthesizing high-quality textures on 3D meshes. We present Point-UV diffusion, a coarse-to-fine pipeline that marries the denoising diffusion model with UV mapping to generate 3D consistent and high-quality…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Xin Yu , Peng Dai , Wenbo Li , Lan Ma , Zhengzhe Liu , Xiaojuan Qi

Generating 3D scenes is a challenging open problem, which requires synthesizing plausible content that is fully consistent in 3D space. While recent methods such as neural radiance fields excel at view synthesis and 3D reconstruction, they…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Fabian Manhardt , Federico Tombari , Paul Henderson

This paper presents a method to reconstruct high-quality textured 3D models from both multi-view and single-view images. The reconstruction is posed as an adaptation problem and is done progressively where in the first stage, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Aysegul Dundar , Jun Gao , Andrew Tao , Bryan Catanzaro

Neural representations of 3D data have been widely adopted across various applications, particularly in recent work leveraging coordinate-based networks to model scalar or vector fields. However, these approaches face inherent challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Biao Zhang , Jing Ren , Peter Wonka

The success of image generative models has enabled us to build methods that can edit images based on text or other user input. However, these methods are bespoke, imprecise, require additional information, or are limited to only 2D image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Rahul Sajnani , Jeroen Vanbaar , Jie Min , Kapil Katyal , Srinath Sridhar

Recent advances in differentiable rendering have sparked an interest in learning generative models of textured 3D meshes from image collections. These models natively disentangle pose and appearance, enable downstream applications in…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Dario Pavllo , Jonas Kohler , Thomas Hofmann , Aurelien Lucchi

We propose a probabilistic shape completion method extended to the continuous geometry of large-scale 3D scenes. Real-world scans of 3D scenes suffer from a considerable amount of missing data cluttered with unsegmented objects. The problem…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Dongsu Zhang , Changwoon Choi , Inbum Park , Young Min Kim

In this work, we address the lack of 3D understanding of generative neural networks by introducing a persistent 3D feature embedding for view synthesis. To this end, we propose DeepVoxels, a learned representation that encodes the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Vincent Sitzmann , Justus Thies , Felix Heide , Matthias Nießner , Gordon Wetzstein , Michael Zollhöfer

In this work, we aim to address the 3D scene stylization problem - generating stylized images of the scene at arbitrary novel view angles. A straightforward solution is to combine existing novel view synthesis and image/video style transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Pei-Ze Chiang , Meng-Shiun Tsai , Hung-Yu Tseng , Wei-sheng Lai , Wei-Chen Chiu

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Raquel Vidaurre , Elena Garces , Dan Casas

With the rising popularity of virtual worlds, the importance of data-driven parametric models of 3D meshes has grown rapidly. Numerous applications, such as computer vision, procedural generation, and mesh editing, vastly rely on these…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Robert Kosk , Richard Southern , Lihua You , Shaojun Bian , Willem Kokke , Greg Maguire

The scarcity of large-scale 3D-text paired data poses a great challenge on open vocabulary 3D scene understanding, and hence it is popular to leverage internet-scale 2D data and transfer their open vocabulary capabilities to 3D models…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Pengfei Wang , Yuxi Wang , Shuai Li , Zhaoxiang Zhang , Zhen Lei , Lei Zhang