English
Related papers

Related papers: Learning a Neural 3D Texture Space from 2D Exempla…

200 papers

Neural implicit functions have achieved impressive results for reconstructing 3D shapes from single images. However, the image features for describing 3D point samplings of implicit functions are less effective when significant variations…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Yixin Zhuang , Yunzhe Liu , Yujie Wang , Baoquan Chen

Analysis of the 3D Texture is indispensable for various tasks, such as retrieval, segmentation, classification, and inspection of sculptures, knitted fabrics, and biological tissues. A 3D texture is a locally repeated surface variation…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Iyyakutti Iyappan Ganapathi , Fayaz Ali , Sajid Javed , Syed Sadaf Ali , Naoufel Werghi

Deep learning for image processing typically treats input imagery as pixels in some color space. This paper proposes instead to learn from program traces of procedural fragment shaders -- programs that generate images. At each pixel, we…

Machine Learning · Computer Science 2022-04-26 Yuting Yang , Connelly Barnes , Adam Finkelstein

The demand for efficient 3D model generation techniques has grown exponentially, as manual creation of 3D models is time-consuming and requires specialized expertise. While generative models have shown potential in creating 3D textured…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Fanghua Yu , Xintao Wang , Zheyuan Li , Yan-Pei Cao , Ying Shan , Chao Dong

Generating high-quality and diverse human images is an important yet challenging task in vision and graphics. However, existing generative models often fall short under the high diversity of clothing shapes and textures. Furthermore, the…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Yuming Jiang , Shuai Yang , Haonan Qiu , Wayne Wu , Chen Change Loy , Ziwei Liu

Many methods have been proposed over the years to tackle the task of facial 3D geometry and texture recovery from a single image. Such methods often fail to provide high-fidelity texture without relying on 3D facial scans during training.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Ron Slossberg , Ibrahim Jubran , Ron Kimmel

Given a 3D mesh, we aim to synthesize 3D textures that correspond to arbitrary textual descriptions. Current methods for generating and assembling textures from sampled views often result in prominent seams or excessive smoothing. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-08-05 Dong Huo , Zixin Guo , Xinxin Zuo , Zhihao Shi , Juwei Lu , Peng Dai , Songcen Xu , Li Cheng , Yee-Hong Yang

We present Text2Room, a method for generating room-scale textured 3D meshes from a given text prompt as input. To this end, we leverage pre-trained 2D text-to-image models to synthesize a sequence of images from different poses. In order to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Lukas Höllein , Ang Cao , Andrew Owens , Justin Johnson , Matthias Nießner

Our objective is to compute a textural loss that can be used to train texture generators with multiple material channels typically used for physically based rendering such as albedo, normal, roughness, metalness, ambient occlusion, etc.…

Graphics · Computer Science 2021-05-28 Thomas Chambon , Eric Heitz , Laurent Belcour

Implicit neural representations have emerged as a powerful tool in learning 3D geometry, offering unparalleled advantages over conventional representations like mesh-based methods. A common type of INR implicitly encodes a shape's boundary…

Computer Vision and Pattern Recognition · Computer Science 2024-10-17 Shen Fan , Przemyslaw Musialski

In this paper, we propose a generic neural-based hair rendering pipeline that can synthesize photo-realistic images from virtual 3D hair models. Unlike existing supervised translation methods that require model-level similarity to preserve…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Menglei Chai , Jian Ren , Sergey Tulyakov

Recently, methods have been proposed that perform texture synthesis and style transfer by using convolutional neural networks (e.g. Gatys et al. [2015,2016]). These methods are exciting because they can in some cases create results with…

Graphics · Computer Science 2017-02-09 Eric Risser , Pierre Wilmot , Connelly Barnes

In this paper, we present TEXTure, a novel method for text-guided generation, editing, and transfer of textures for 3D shapes. Leveraging a pretrained depth-to-image diffusion model, TEXTure applies an iterative scheme that paints a 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-02-06 Elad Richardson , Gal Metzer , Yuval Alaluf , Raja Giryes , Daniel Cohen-Or

We present a system for learning full-body neural avatars, i.e. deep networks that produce full-body renderings of a person for varying body pose and camera position. Our system takes the middle path between the classical graphics pipeline…

We present a super-resolution method capable of creating a high-resolution texture map for a virtual 3D object from a set of lower-resolution images of that object. Our architecture unifies the concepts of (i) multi-view super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2020-01-15 Audrey Richard , Ian Cherabier , Martin R. Oswald , Vagia Tsiminaki , Marc Pollefeys , Konrad Schindler

Neural reflectance models are capable of reproducing the spatially-varying appearance of many real-world materials at different scales. Unfortunately, existing techniques such as NeuMIP have difficulties handling materials with strong…

Graphics · Computer Science 2024-04-25 Bowen Xue , Shuang Zhao , Henrik Wann Jensen , Zahra Montazeri

This paper aims for a new generation task: non-stationary multi-texture synthesis, which unifies synthesizing multiple non-stationary textures in a single model. Most non-stationary textures have large scale variance and can hardly be…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Xudong Xie , Zhen Zhu , Zijie Wu , Zhiliang Xu , Yingying Zhu

Learning to generate textures for a novel 3D mesh given a collection of 3D meshes and real-world 2D images is an important problem with applications in various domains such as 3D simulation, augmented and virtual reality, gaming,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-08 Dharma KC , Clayton T. Morrison

Texture synthesis is a fundamental problem in computer graphics that would benefit various applications. Existing methods are effective in handling 2D image textures. In contrast, many real-world textures contain meso-structure in the 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Yi-Hua Huang , Yan-Pei Cao , Yu-Kun Lai , Ying Shan , Lin Gao

We propose a Deep Texture Encoding Network (Deep-TEN) with a novel Encoding Layer integrated on top of convolutional layers, which ports the entire dictionary learning and encoding pipeline into a single model. Current methods build from…

Computer Vision and Pattern Recognition · Computer Science 2016-12-12 Hang Zhang , Jia Xue , Kristin Dana