English
Related papers

Related papers: Textured Neural Avatars

200 papers

Recent advances in deep generative models have led to an unprecedented level of realism for synthetically generated images of humans. However, one of the remaining fundamental limitations of these models is the ability to flexibly control…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Sergey Prokudin , Michael J. Black , Javier Romero

It is challenging to directly estimate the human geometry from a single image due to the high diversity and complexity of body shapes with the various clothing styles. Most of model-based approaches are limited to predict the shape and pose…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Lixiang Lin , Jianke Zhu

While progress in 2D generative models of human appearance has been rapid, many applications require 3D avatars that can be animated and rendered. Unfortunately, most existing methods for learning generative models of 3D humans with diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Zijian Dong , Xu Chen , Jinlong Yang , Michael J. Black , Otmar Hilliges , Andreas Geiger

We present a CloseUpAvatar - a novel approach for articulated human avatar representation dealing with more general camera motions, while preserving rendering quality for close-up views. CloseUpAvatar represents an avatar as a set of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 David Svitov , Pietro Morerio , Lourdes Agapito , Alessio Del Bue

Acquisition and rendering of photo-realistic human heads is a highly challenging research problem of particular importance for virtual telepresence. Currently, the highest quality is achieved by volumetric approaches trained in a person…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Amit Raj , Michael Zollhoefer , Tomas Simon , Jason Saragih , Shunsuke Saito , James Hays , Stephen Lombardi

We propose a deep videorealistic 3D human character model displaying highly realistic shape, motion, and dynamic appearance learned in a new weakly supervised way from multi-view imagery. In contrast to previous work, our controllable 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Marc Habermann , Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

We present a neural rendering framework that maps a voxelized scene into a high quality image. Highly-textured objects and scene element interactions are realistically rendered by our method, despite having a rough representation as an…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Konstantinos Rematas , Vittorio Ferrari

Realistic reconstruction of 3D clothing from an image has wide applications, such as avatar creation and virtual try-on. This paper presents a novel framework that reconstructs the texture map for 3D garments from a single image with pose.…

Graphics · Computer Science 2023-10-27 Hyun-Song Kwon , Sung-Hee Lee

To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex…

Computer Vision and Pattern Recognition · Computer Science 2022-04-14 Xu Chen , Tianjian Jiang , Jie Song , Jinlong Yang , Michael J. Black , Andreas Geiger , Otmar Hilliges

A human 3D avatar is one of the important elements in the metaverse, and the modeling effect directly affects people's visual experience. However, the human body has a complex topology and diverse details, so it is often expensive,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Mingyang Sun , Dingkang Yang , Dongliang Kou , Yang Jiang , Weihua Shan , Zhe Yan , Lihua Zhang

Visual attributes are great means of describing images or scenes, in a way both humans and computers understand. In order to establish a correspondence between images and to be able to compare the strength of each property between images,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-14 Yaser Souri , Erfan Noury , Ehsan Adeli

We present a novel approach that enables photo-realistic re-animation of portrait videos using only an input video. In contrast to existing approaches that are restricted to manipulations of facial expressions only, we are the first to…

Computer Vision and Pattern Recognition · Computer Science 2018-05-31 Hyeongwoo Kim , Pablo Garrido , Ayush Tewari , Weipeng Xu , Justus Thies , Matthias Nießner , Patrick Pérez , Christian Richardt , Michael Zollhöfer , Christian Theobalt

In this paper, we propose a novel hybrid representation and end-to-end trainable network architecture to model fully editable and customizable neural avatars. At the core of our work lies a representation that combines the modeling power of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-02 Hsuan-I Ho , Lixin Xue , Jie Song , Otmar Hilliges

We propose an approach to generate images of people given a desired appearance and pose. Disentangled representations of pose and appearance are necessary to handle the compound variability in the resulting generated images. Hence, we…

Computer Vision and Pattern Recognition · Computer Science 2021-04-27 Mengyao Zhai , Ruizhi Deng , Jiacheng Chen , Lei Chen , Zhiwei Deng , Greg Mori

We present a learning-based approach for virtual try-on applications based on a fully convolutional graph neural network. In contrast to existing data-driven models, which are trained for a specific garment or mesh topology, our fully…

Computer Vision and Pattern Recognition · Computer Science 2020-09-11 Raquel Vidaurre , Igor Santesteban , Elena Garces , Dan Casas

In this paper we predict a full 3D avatar of a person from a single image. We infer texture and geometry in the UV-space of the SMPL model using an image-to-image translation method. Given partial texture and segmentation layout maps…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Verica Lazova , Eldar Insafutdinov , Gerard Pons-Moll

This paper investigates a novel task of generating texture images from perceptual descriptions. Previous work on texture generation focused on either synthesis from examples or generation from procedural models. Generating textures from…

Computer Vision and Pattern Recognition · Computer Science 2017-03-30 Yanhai Gan , Huifang Chi , Ying Gao , Jun Liu , Guoqiang Zhong , Junyu Dong

This paper presents a neural network to estimate a detailed depth map of the foreground human in a single RGB image. The result captures geometry details such as cloth wrinkles, which are important in visualization applications. To achieve…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Sicong Tang , Feitong Tan , Kelvin Cheng , Zhaoyang Li , Siyu Zhu , Ping Tan

Real-time rendering of human head avatars is a cornerstone of many computer graphics applications, such as augmented reality, video games, and films, to name a few. Recent approaches address this challenge with computationally efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-09-19 Kartik Teotia , Hyeongwoo Kim , Pablo Garrido , Marc Habermann , Mohamed Elgharib , Christian Theobalt

In the field of pattern recognition research, the method of using deep neural networks based on improved computing hardware recently attracted attention because of their superior accuracy compared to conventional methods. Deep neural…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Kyongsik Yun , Alexander Huyen , Thomas Lu