English
Related papers

Related papers: Leveraging 2D Data to Learn Textured 3D Mesh Gener…

200 papers

This paper presents a novel method for building scalable 3D generative models utilizing pre-trained video diffusion models. The primary obstacle in developing foundation 3D generative models is the limited availability of 3D data. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2024-07-22 Junlin Han , Filippos Kokkinos , Philip Torr

The recent availability and adaptability of text-to-image models has sparked a new era in many related domains that benefit from the learned text priors as well as high-quality and fast generation capabilities, one of which is texture…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Raphael Bensadoun , Yanir Kleiman , Idan Azuri , Omri Harosh , Andrea Vedaldi , Natalia Neverova , Oran Gafni

Recently, learning frameworks have shown the capability of inferring the accurate shape, pose, and texture of an object from a single RGB image. However, current methods are trained on image collections of a single category in order to…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Alessandro Simoni , Stefano Pini , Roberto Vezzani , Rita Cucchiara

Recent years have seen the development of mature solutions for reconstructing deformable surfaces from a single image, provided that they are relatively well-textured. By contrast, recovering the 3D shape of texture-less surfaces remains an…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Jan Bednařík , Pascal Fua , Mathieu Salzmann

Capturing and labeling real-world 3D data is laborious and time-consuming, which makes it costly to train strong 3D models. To address this issue, recent works present a simple method by generating randomized 3D scenes without simulation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Lanxiao Li , Michael Heizmann

We train generative 'up-convolutional' neural networks which are able to generate images of objects given object style, viewpoint, and color. We train the networks on rendered 3D models of chairs, tables, and cars. Our experiments show that…

Computer Vision and Pattern Recognition · Computer Science 2017-08-04 Alexey Dosovitskiy , Jost Tobias Springenberg , Maxim Tatarchenko , Thomas Brox

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Dave Zhenyu Chen , Yawar Siddiqui , Hsin-Ying Lee , Sergey Tulyakov , Matthias Nießner

Recent advances in deep learning have significantly pushed the state-of-the-art in photorealistic video animation given a single image. In this paper, we extrapolate those advances to the 3D domain, by studying 3D image-to-video translation…

Computer Vision and Pattern Recognition · Computer Science 2020-07-22 Rolandos Alexandros Potamias , Jiali Zheng , Stylianos Ploumpis , Giorgos Bouritsas , Evangelos Ververas , Stefanos Zafeiriou

Generating compact and sharply detailed 3D meshes poses a significant challenge for current 3D generative models. Different from extracting dense meshes from neural representation, some recent works try to model the native mesh distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Haohan Weng , Yikai Wang , Tong Zhang , C. L. Philip Chen , Jun Zhu

Given a 3D mesh, we aim to synthesize 3D textures that correspond to arbitrary textual descriptions. Current methods for generating and assembling textures from sampled views often result in prominent seams or excessive smoothing. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Dong Huo , Zixin Guo , Xinxin Zuo , Zhihao Shi , Juwei Lu , Peng Dai , Songcen Xu , Li Cheng , Yee-Hong Yang

Learning to generate textures for a novel 3D mesh given a collection of 3D meshes and real-world 2D images is an important problem with applications in various domains such as 3D simulation, augmented and virtual reality, gaming,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Dharma KC , Clayton T. Morrison

Over the past decade, 3D graphics have become highly detailed to mimic the real world, exploding their size and complexity. Certain applications and device constraints necessitate their simplification and/or lossy compression, which can…

We present a technique for zero-shot generation of a 3D model using only a target text prompt. Without any 3D supervision our method deforms the control shape of a limit subdivided surface along with its texture map and normal map to obtain…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Nasir Mohammad Khalid , Tianhao Xie , Eugene Belilovsky , Tiberiu Popa

The estimation of 3D human body pose and shape from a single image has been extensively studied in recent years. However, the texture generation problem has not been fully discussed. In this paper, we propose an end-to-end learning strategy…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jian Wang , Yunshan Zhong , Yachun Li , Chi Zhang , Yichen Wei

Generating animated 3D objects is at the heart of many applications, yet most advanced works are typically difficult to apply in practice because of their limited setup, their long runtime, or their limited quality. We introduce ActionMesh,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Remy Sabathier , David Novotny , Niloy J. Mitra , Tom Monnier

We present Text2Room, a method for generating room-scale textured 3D meshes from a given text prompt as input. To this end, we leverage pre-trained 2D text-to-image models to synthesize a sequence of images from different poses. In order to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Lukas Höllein , Ang Cao , Andrew Owens , Justin Johnson , Matthias Nießner

Despite the astonishing progress in generative AI, 4D dynamic object generation remains an open challenge. With limited high-quality training data and heavy computing requirements, the combination of hallucinating unseen geometry together…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Lu Sang , Zehranaz Canfes , Dongliang Cao , Riccardo Marin , Florian Bernard , Daniel Cremers

With the recent advances in hardware and rendering techniques, 3D models have emerged everywhere in our life. Yet creating 3D shapes is arduous and requires significant professional knowledge. Meanwhile, Deep learning has enabled…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Zhiqin Chen

Directly generating 3D meshes, the default representation for 3D shapes in the graphics industry, using auto-regressive (AR) models has become popular these days, thanks to their sharpness, compactness in the generated results, and ability…

Graphics · Computer Science 2025-09-26 Jiabao Lei , Kewei Shi , Zhihao Liang , Kui Jia

We present a data-driven method for learning to generate animations of 3D garments using a 2D image diffusion model. In contrast to existing methods, typically based on fully connected networks, graph neural networks, or generative…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Raquel Vidaurre , Elena Garces , Dan Casas