English
Related papers

Related papers: Creating and Reenacting Controllable 3D Humans wit…

200 papers

In this paper, we present a method to reconstruct the world and multiple dynamic humans in 3D from a monocular video input. As a key idea, we represent both the world and multiple humans via the recently emerging 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Inhee Lee , Byungjun Kim , Hanbyul Joo

Controllable scene synthesis consists of generating 3D information that satisfy underlying specifications. Thereby, these specifications should be abstract, i.e. allowing easy user interaction, whilst providing enough interface for detailed…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Helisa Dhamo , Fabian Manhardt , Nassir Navab , Federico Tombari

We propose ID-to-3D, a method to generate identity- and text-guided 3D human heads with disentangled expressions, starting from even a single casually captured in-the-wild image of a subject. The foundation of our approach is anchored in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Francesca Babiloni , Alexandros Lattas , Jiankang Deng , Stefanos Zafeiriou

Nowadays as convolution neural networks demonstrate its powerful problem-solving ability in the area of image processing, efforts have been made to reconstruct detailed face shapes from 2D face images or videos. However, to make the full…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 Zhangnan Jiang , Zichen Yang

Human video synthesis aims to create lifelike characters in various environments, with wide applications in VR, storytelling, and content creation. While 2D diffusion-based methods have made significant progress, they struggle to generalize…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Liyuan Cui , Xiaogang Xu , Wenqi Dong , Zesong Yang , Hujun Bao , Zhaopeng Cui

We present a method to reconstruct time-consistent human body models from monocular videos, focusing on extremely loose clothing or handheld object interactions. Prior work in human reconstruction is either limited to tight clothing with no…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jeff Tan , Donglai Xiang , Shubham Tulsiani , Deva Ramanan , Gengshan Yang

Sketch portrait generation benefits a wide range of applications such as digital entertainment and law enforcement. Although plenty of efforts have been dedicated to this task, several issues still remain unsolved for generating vivid and…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Dongyu Zhang , Liang Lin , Tianshui Chen , Xian Wu , Wenwei Tan , Ebroul Izquierdo

We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Liguo Jiang , Miaopeng Li , Jianjie Zhang , Congyi Wang , Juntao Ye , Xinguo Liu , Jinxiang Chai

Simultaneous reconstruction of geometry and reflectance properties in uncontrolled environments remains a challenging problem. In this paper, we propose an efficient method to reconstruct the scene's 3D geometry and reflectance from…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Rui Li , Guangmin Zang , Miao Qi , Wolfgang Heidrich

Recovering 3D human body shape and pose from 2D images is a challenging task due to high complexity and flexibility of human body, and relatively less 3D labeled data. Previous methods addressing these issues typically rely on predicting…

Computer Vision and Pattern Recognition · Computer Science 2019-03-29 Pengfei Yao , Zheng Fang , Fan Wu , Yao Feng , Jiwei Li

This paper aims to develop a new architecture that can make full use of the feature maps of convolutional networks. To this end, we study a number of methods for video-based person re-identification and make the following findings: 1)…

Computer Vision and Pattern Recognition · Computer Science 2017-12-06 Zeng Yu , Tianrui Li , Ning Yu , Xun Gong , Ke Chen , Yi Pan

Creating detailed 3D human avatars with fitted garments traditionally requires specialized expertise and labor-intensive workflows. While recent advances in generative AI have enabled text-to-3D human and clothing synthesis, existing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Zhiyao Sun , Yu-Hui Wen , Ho-Jui Fang , Sheng Ye , Matthieu Lin , Tian Lv , Yong-Jin Liu

We propose a Transformer-based framework for 3D human texture estimation from a single image. The proposed Transformer is able to effectively exploit the global information of the input image, overcoming the limitations of existing methods…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiangyu Xu , Chen Change Loy

Creating human avatars is a highly desirable yet challenging task. Recent advancements in radiance field rendering have achieved unprecedented photorealism and real-time performance for personalized dynamic human avatars. However, these…

Graphics · Computer Science 2025-09-09 Dongliang Cao , Guoxing Sun , Marc Habermann , Florian Bernard

We present Neural Head Avatars, a novel neural representation that explicitly models the surface geometry and appearance of an animatable human avatar that can be used for teleconferencing in AR/VR or other applications in the movie or…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Philip-William Grassal , Malte Prinzler , Titus Leistner , Carsten Rother , Matthias Nießner , Justus Thies

We propose a learning based method for generating new animations of a cartoon character given a few example images. Our method is designed to learn from a traditionally animated sequence, where each frame is drawn by an artist, and thus the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Omid Poursaeed , Vladimir G. Kim , Eli Shechtman , Jun Saito , Serge Belongie

Humans can intuitively decompose an image into a sequence of strokes to create a painting, yet existing methods for generating drawing processes are limited to specific data types and often rely on expensive human-annotated datasets. We…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Junjie Hu , Shuyong Gao , Qianyu Guo , Yan Wang , Qishan Wang , Yuang Feng , Wenqiang Zhang

In this paper, we aim to reconstruct a full 3D human shape from a single image. Previous vertex-level and parameter regression approaches reconstruct 3D human shape based on a pre-defined adjacency matrix to encode positive relations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Shihao Zhou , Mengxi Jiang , Shanshan Cai , Yunqi Lei

The automated generation of 3D human heads has been an intriguing and challenging task for computer vision researchers. Prevailing methods synthesize realistic avatars but with limited control over the diversity and quality of rendered…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Debayan Deb , Suvidha Tripathi , Pranit Puri

While successful for various computer vision tasks, deep neural networks have shown to be vulnerable to texture style shifts and small perturbations to which humans are robust. In this work, we show that the robustness of neural networks…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Zhenlin Xu , Deyi Liu , Junlin Yang , Colin Raffel , Marc Niethammer