English
Related papers

Related papers: SparseFusion: Dynamic Human Avatar Modeling from S…

200 papers

This paper presents RoGSplat, a novel approach for synthesizing high-fidelity novel views of unseen human from sparse multi-view images, while requiring no cumbersome per-subject optimization. Unlike previous methods that typically struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Junjin Xiao , Qing Zhang , Yonewei Nie , Lei Zhu , Wei-Shi Zheng

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang

For visual manipulation tasks, we aim to represent image content with semantically meaningful features. However, learning implicit representations from images often lacks interpretability, especially when attributes are intertwined. We…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xue Hu , Xinghui Li , Benjamin Busam , Yiren Zhou , Ales Leonardis , Shanxin Yuan

There is a growing demand for the accessible creation of high-quality 3D avatars that are animatable and customizable. Although 3D morphable models provide intuitive control for editing and animation, and robustness for single-view face…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Connor Z. Lin , Koki Nagano , Jan Kautz , Eric R. Chan , Umar Iqbal , Leonidas Guibas , Gordon Wetzstein , Sameh Khamis

Real-time dense scene reconstruction during unstable camera motions is crucial for robotics, yet current RGB-D SLAM systems fail when cameras experience large viewpoint changes, fast motions, or sudden shaking. Classical optimization-based…

Robotics · Computer Science 2026-03-04 Siyan Dong , Zijun Wang , Lulu Cai , Yi Ma , Yanchao Yang

This work addresses the problem of real-time rendering of photorealistic human body avatars learned from multi-view videos. While the classical approaches to model and render virtual humans generally use a textured mesh, recent research has…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Arthur Moreau , Jifei Song , Helisa Dhamo , Richard Shaw , Yiren Zhou , Eduardo Pérez-Pellitero

We present a novel 3D face reconstruction technique that leverages sparse photometric stereo (PS) and latest advances on face registration/modeling from a single image. We observe that 3D morphable faces approach provides a reasonable…

Computer Vision and Pattern Recognition · Computer Science 2017-11-30 Xuan Cao , Zhang Chen , Anpei Chen , Xin Chen , Cen Wang , Jingyi Yu

Photo-real digital human avatars are of enormous importance in graphics, as they enable immersive communication over the globe, improve gaming and entertainment experiences, and can be particularly beneficial for AR and VR settings.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Marc Habermann , Lingjie Liu , Weipeng Xu , Gerard Pons-Moll , Michael Zollhoefer , Christian Theobalt

We present a novel framework for generating photorealistic 3D human head and subsequently manipulating and reposing them with remarkable flexibility. The proposed approach leverages an implicit function representation of 3D human heads,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yushi Lan , Feitong Tan , Di Qiu , Qiangeng Xu , Kyle Genova , Zeng Huang , Sean Fanello , Rohit Pandey , Thomas Funkhouser , Chen Change Loy , Yinda Zhang

We present a deep learning-based multitask framework for joint 3D human pose estimation and action recognition from RGB video sequences. Our approach proceeds along two stages. In the first, we run a real-time 2D pose detector to determine…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Huy Hieu Pham , Houssam Salmane , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A Velastin

We present a fully automatic system that can produce high-fidelity, photo-realistic 3D digital human heads with a consumer RGB-D selfie camera. The system only needs the user to take a short selfie RGB-D video while rotating his/her head,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-30 Linchao Bao , Xiangkai Lin , Yajing Chen , Haoxian Zhang , Sheng Wang , Xuefei Zhe , Di Kang , Haozhi Huang , Xinwei Jiang , Jue Wang , Dong Yu , Zhengyou Zhang

While the problem of estimating shapes and diffuse reflectances of human faces from images has been extensively studied, there is relatively less work done on recovering the specular albedo. This paper presents a lightweight solution for…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Guoxian Song , Jianmin Zheng , Jianfei Cai , Tat-Jen Cham

In this study, we introduce a novel two-stage technique for decomposing and reconstructing facial features from sparse-view images, a task made challenging by the unique geometry and complex skin reflectance of each individual. To…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Daisheng Jin , Jiangbei Hu , Baixin Xu , Yuxin Dai , Chen Qian , Ying He

The report proposes an effective solution about 3D human body reconstruction from multiple unconstrained frames for ECCV 2022 WCPA Challenge: From Face, Body and Fashion to 3D Virtual avatars I (track1: Multi-View Based 3D Human Body…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Han Huang , Liliang Chen , Xihao Wang

We present an approach to generate high fidelity 3D face avatar with a high-resolution UV texture map from a single image. To estimate the face geometry, we use a deep neural network to directly predict vertex coordinates of the 3D face…

Computer Vision and Pattern Recognition · Computer Science 2019-12-10 Ruizhe Wang , Chih-Fan Chen , Hao Peng , Xudong Liu , Oliver Liu , Xin Li

Temporal 3D human pose estimation from monocular videos is a challenging task in human-centered computer vision due to the depth ambiguity of 2D-to-3D lifting. To improve accuracy and address occlusion issues, inertial sensor has been…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yiming Bao , Xu Zhao , Dahong Qian

We introduce PeeledHuman - a novel shape representation of the human body that is robust to self-occlusions. PeeledHuman encodes the human body as a set of Peeled Depth and RGB maps in 2D, obtained by performing ray-tracing on the 3D body…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Sai Sagar Jinka , Rohan Chacko , Avinash Sharma , P. J. Narayanan

With the increasing demands of applications in virtual reality such as 3D films, virtual Human-Machine Interactions and virtual agents, the analysis of 3D human face analysis is considered to be more and more important as a fundamental step…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Shu Zhang , Hui Yu , Ting Wang , Junyu Dong , Honghai Liu

Sparse representation of 3D images is considered within the context of data reduction. The goal is to produce high quality approximations of 3D images using fewer elementary components than the number of intensity points in the 3D array.…

Image and Video Processing · Electrical Eng. & Systems 2019-06-12 Laura Rebollo-Neira , Daniel Whitehouse

3D human avatar animation aims at transforming a human avatar from an arbitrary initial pose to a specified target pose using deformation algorithms. Existing approaches typically divide this task into two stages: canonical template…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Jian Shu , Nanjie Yao , Gangjian Zhang , Junlong Ren , Yu Feng , Hao Wang