English
Related papers

Related papers: Paint-it: Text-to-Texture Synthesis via Deep Convo…

200 papers

In this paper, we introduce MeshGen, an advanced image-to-3D pipeline that generates high-quality 3D meshes with detailed geometry and physically based rendering (PBR) textures. Addressing the challenges faced by existing 3D native…

Graphics · Computer Science 2025-05-09 Zilong Chen , Yikai Wang , Wenqiang Sun , Feng Wang , Yiwen Chen , Huaping Liu

While makeup virtual-try-on is now widespread, parametrizing a computer graphics rendering engine for synthesizing images of a given cosmetics product remains a challenging task. In this paper, we introduce an inverse computer graphics…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Robin Kips , Ruowei Jiang , Sileye Ba , Edmund Phung , Parham Aarabi , Pietro Gori , Matthieu Perrot , Isabelle Bloch

State-of-the-art RGB texture synthesis algorithms rely on style distances that are computed through statistics of deep features. These deep features are extracted by classification neural networks that have been trained on large datasets of…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Sélim Ollivier , Yann Gousseau , Sidonie Lefebvre

We present TexFusion (Texture Diffusion), a new method to synthesize textures for given 3D geometries, using large-scale text-guided image diffusion models. In contrast to recent works that leverage 2D text-to-image diffusion models to…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Tianshi Cao , Karsten Kreis , Sanja Fidler , Nicholas Sharp , Kangxue Yin

Texture cues on 3D objects are key to compelling visual representations, with the possibility to create high visual fidelity with inherent spatial consistency across different views. Since the availability of textured 3D shapes remains very…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Yawar Siddiqui , Justus Thies , Fangchang Ma , Qi Shan , Matthias Nießner , Angela Dai

The field of texture synthesis has witnessed important progresses over the last years, most notably through the use of Convolutional Neural Networks. However, neural synthesis methods still struggle to reproduce large scale structures,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Nicolas Gonthier , Yann Gousseau , Saïd Ladjal

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger

Synthesizing photo-realistic images and videos is at the heart of computer graphics and has been the focus of decades of research. Traditionally, synthetic images of a scene are generated using rendering algorithms such as rasterization or…

The advancements in neural rendering have increased the need for techniques that enable intuitive editing of 3D objects represented as neural implicit surfaces. This paper introduces a novel neural algorithm for parameterizing neural…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Baixin Xu , Jiangbei Hu , Fei Hou , Kwan-Yee Lin , Wayne Wu , Chen Qian , Ying He

We present a novel reinforcement learning-based natural media painting algorithm. Our goal is to reproduce a reference image using brush strokes and we encode the objective through observations. Our formulation takes into account that the…

Machine Learning · Computer Science 2019-09-24 Biao Jia , Jonathan Brandt , Radomir Mech , Byungmoon Kim , Dinesh Manocha

Accurate prediction of perceptual attributes of haptic textures is essential for advancing VR and AR applications and enhancing robotic interaction with physical surfaces. This paper presents a deep learning-based multi-modal framework,…

Human-Computer Interaction · Computer Science 2025-06-24 Mudassir Ibrahim Awan , Seokhee Jeon

Patch-based methods and deep networks have been employed to tackle image inpainting problem, with their own strengths and weaknesses. Patch-based methods are capable of restoring a missing region with high-quality texture through searching…

Computer Vision and Pattern Recognition · Computer Science 2021-11-05 Rui Xu , Minghao Guo , Jiaqi Wang , Xiaoxiao Li , Bolei Zhou , Chen Change Loy

This paper proposes a novel stroke-based rendering (SBR) method that translates images into vivid oil paintings. Previous SBR techniques usually formulate the oil painting problem as pixel-wise approximation. Different from this technique…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Zhengyan Tong , Xiaohang Wang , Shengchao Yuan , Xuanhong Chen , Junjie Wang , Xiangzhong Fang

We introduce a new video synthesis task: synthesizing time lapse videos depicting how a given painting might have been created. Artists paint using unique combinations of brushes, strokes, and colors. There are often many possible ways to…

Graphics · Computer Science 2020-04-28 Amy Zhao , Guha Balakrishnan , Kathleen M. Lewis , Frédo Durand , John V. Guttag , Adrian V. Dalca

We present a deep neural network-based methodology for synthesising percussive sounds with control over high-level timbral characteristics of the sounds. This approach allows for intuitive control of a synthesizer, enabling the user to…

Audio and Speech Processing · Electrical Eng. & Systems 2020-04-06 António Ramires , Pritish Chandna , Xavier Favory , Emilia Gómez , Xavier Serra

The advancement of diffusion models has pushed the boundary of text-to-3D object generation. While it is straightforward to composite objects into a scene with reasonable geometry, it is nontrivial to texture such a scene perfectly due to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Qi Wang , Ruijie Lu , Xudong Xu , Jingbo Wang , Michael Yu Wang , Bo Dai , Gang Zeng , Dan Xu

This paper addresses the challenges of designing mesh convolution neural networks for 3D mesh dense prediction. While deep learning has achieved remarkable success in image dense prediction tasks, directly applying or extending these…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Shi Hezi , Jiang Luo , Zheng Jianmin , Zeng Jun

We introduce an approach for the real-time (2Hz) creation of a dense map and alignment of a moving robotic agent within that map by rendering using a Graphics Processing Unit (GPU). This is done by recasting the scan alignment part of the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-23 Julian Ryde , Xuchu , Ding

With the help of Score Distillation Sampling (SDS) and the rapid development of neural 3D representations, some methods have been proposed to perform 3D editing such as adding additional geometries, or overwriting textures. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yige Chen , Teng Hu , Yizhe Tang , Siyuan Chen , Ang Chen , Ran Yi

This paper proposes an image-to-painting translation method that generates vivid and realistic painting artworks with controllable styles. Different from previous image-to-image translation methods that formulate the translation as…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Zhengxia Zou , Tianyang Shi , Shuang Qiu , Yi Yuan , Zhenwei Shi