English
Related papers

Related papers: PixelHuman: Animatable Neural Radiance Fields from…

200 papers

Combining human body models with differentiable rendering has recently enabled animatable avatars of clothed humans from sparse sets of multi-view RGB videos. While state-of-the-art approaches achieve realistic appearance with neural…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Shaofei Wang , Katja Schwarz , Andreas Geiger , Siyu Tang

We address the task of unsupervised retargeting of human actions from one video to another. We consider the challenging setting where only a few frames of the target is available. The core of our approach is a conditional generative model…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Jessica Lee , Deva Ramanan , Rohit Girdhar

The estimation of 3D human body pose and shape from a single image has been extensively studied in recent years. However, the texture generation problem has not been fully discussed. In this paper, we propose an end-to-end learning strategy…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Jian Wang , Yunshan Zhong , Yachun Li , Chi Zhang , Yichen Wei

We present a novel approach for generating animatable 3D-aware art avatars from a single image, with controllable facial expressions, head poses, and shoulder movements. Unlike previous reenactment methods, our approach utilizes a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Shaoxu Li

We present a one-shot method to infer and render a photorealistic 3D representation from a single unposed image (e.g., face portrait) in real-time. Given a single RGB input, our image encoder directly predicts a canonical triplane…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Alex Trevithick , Matthew Chan , Michael Stengel , Eric R. Chan , Chao Liu , Zhiding Yu , Sameh Khamis , Manmohan Chandraker , Ravi Ramamoorthi , Koki Nagano

This paper proposes the novel Pose Guided Person Generation Network (PG$^2$) that allows to synthesize person images in arbitrary poses, based on an image of that person and a novel pose. Our generation framework PG$^2$ utilizes the pose…

Computer Vision and Pattern Recognition · Computer Science 2018-01-30 Liqian Ma , Xu Jia , Qianru Sun , Bernt Schiele , Tinne Tuytelaars , Luc Van Gool

We introduce a novel framework that learns a dynamic neural radiance field (NeRF) for full-body talking humans from monocular videos. Prior work represents only the body pose or the face. However, humans communicate with their full body,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Aggelina Chatziagapi , Bindita Chaudhuri , Amit Kumar , Rakesh Ranjan , Dimitris Samaras , Nikolaos Sarafianos

Given an "in-the-wild" video of a person, we reconstruct an animatable model of the person in the video. The output model can be rendered in any body pose to any camera view, via the learned controls, without explicit 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Chung-Yi Weng , Brian Curless , Ira Kemelmacher-Shlizerman

In the rapidly evolving landscape of digital content creation, the demand for fast, convenient, and autonomous methods of crafting detailed 3D reconstructions of humans has grown significantly. Addressing this pressing need, our AirNeRF…

Robotics · Computer Science 2024-07-16 Alexey Kotcov , Maria Dronova , Vladislav Cheremnykh , Sausar Karaf , Dzmitry Tsetserukou

Reconstructing animatable 3D humans from casually captured images of articulated subjects without camera or pose information is highly practical but remains challenging due to view misalignment, occlusions, and the absence of structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lingteng Qiu , Peihao Li , Heyuan Li , Qi Zuo , Xiaodong Gu , Yuan Dong , Weihao Yuan , Rui Peng , Siyu Zhu , Xiaoguang Han , Guanying Chen , Zilong Dong

Character Animation aims to generating character videos from still images through driving signals. Currently, diffusion models have become the mainstream in visual generation research, owing to their robust generative capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Li Hu , Xin Gao , Peng Zhang , Ke Sun , Bang Zhang , Liefeng Bo

We revisit human motion synthesis, a task useful in various real world applications, in this paper. Whereas a number of methods have been developed previously for this task, they are often limited in two aspects: focusing on the poses while…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Jingbo Wang , Sijie Yan , Bo Dai , Dahua LIn

We present a method and application for animating a human subject from a single photo. E.g., the character can walk out, run, sit, or jump in 3D. The key contributions of this paper are: 1) an application of viewing and animating humans in…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Chung-Yi Weng , Brian Curless , Ira Kemelmacher-Shlizerman

We present a simple method to reconstruct a high-resolution video from a face-video, where the identity of a person is obscured by pixelization. This concealment method is popular because the viewer can still perceive a human face figure…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Maayan Shuvi , Noa Fish , Kfir Aberman , Ariel Shamir , Daniel Cohen-Or

This paper studies the task of full generative modelling of realistic images of humans, guided only by coarse sketch of the pose, while providing control over the specific instance or type of outfit worn by the user. This is a difficult…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Xu Chen , Jie Song , Otmar Hilliges

Text-driven person image generation is an emerging and challenging task in cross-modality image generation. Controllable person image generation promotes a wide range of applications such as digital human interaction and virtual try-on.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Kaiduo Zhang , Muyi Sun , Jianxin Sun , Binghao Zhao , Kunbo Zhang , Zhenan Sun , Tieniu Tan

Despite recent progress, video generative models still struggle to animate static images into videos that portray delicate human actions, particularly when handling uncommon or novel actions whose training data are limited. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Haoxin Li , Yingchen Yu , Qilong Wu , Hanwang Zhang , Song Bai , Boyang Li

While GANs can produce photo-realistic images in ideal conditions for certain domains, the generation of full-body human images remains difficult due to the diversity of identities, hairstyles, clothing, and the variance in pose. Instead of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Anna Frühstück , Krishna Kumar Singh , Eli Shechtman , Niloy J. Mitra , Peter Wonka , Jingwan Lu

Pose-guided human image animation aims to synthesize realistic videos of a reference character driven by a sequence of poses. While diffusion-based methods have achieved remarkable success, most existing approaches are limited to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yingcheng Hu , Haowen Gong , Chuanguang Yang , Zhulin An , Yongjun Xu , Songhua Liu

This paper proposes an end-to-end framework for generating 3D human pose datasets using Neural Radiance Fields (NeRF). Public datasets generally have limited diversity in terms of human poses and camera viewpoints, largely due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Mohsen Gholami , Rabab Ward , Z. Jane Wang