English
Related papers

Related papers: PSHuman: Photorealistic Single-image 3D Human Reco…

200 papers

Creating realistic avatars from a single RGB image is an attractive yet challenging problem. Due to its ill-posed nature, recent works leverage powerful prior from 2D diffusion models pretrained on large datasets. Although 2D diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yuxuan Xue , Xianghui Xie , Riccardo Marin , Gerard Pons-Moll

Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Yiming Zhang , Zhe Wang , Xinjie Li , Yunchen Yuan , Chengsong Zhang , Xiao Sun , Zhihang Zhong , Jian Wang

To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e.g., motion capture, sport analysis) and robustness to single-view ambiguities. Existing solutions typically suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xuan Gong , Liangchen Song , Meng Zheng , Benjamin Planche , Terrence Chen , Junsong Yuan , David Doermann , Ziyan Wu

Recent months have witnessed rapid progress in 3D generation based on diffusion models. Most advances require fine-tuning existing 2D Stable Diffsuions into multi-view settings or tedious distilling operations and hence fall short of 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Suyi Jiang , Haimin Luo , Haoran Jiang , Ziyu Wang , Jingyi Yu , Lan Xu

We propose a 3D generation pipeline that uses diffusion models to generate realistic human digital avatars. Due to the wide variety of human identities, poses, and stochastic details, the generation of 3D human meshes has been a challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-09-18 Byungjun Kim , Patrick Kwon , Kwangho Lee , Myunggi Lee , Sookwan Han , Daesik Kim , Hanbyul Joo

Recently, implicit neural representation has been widely used to generate animatable human avatars. However, the materials and geometry of those representations are coupled in the neural network and hard to edit, which hinders their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Qifeng Chen , Rengan Xie , Kai Huang , Qi Wang , Wenting Zheng , Rong Li , Yuchi Huo

Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Panwang Pan , Zhuo Su , Chenguo Lin , Zhen Fan , Yongjie Zhang , Zeming Li , Tingting Shen , Yadong Mu , Yebin Liu

In this work, we tackle the task of learning 3D human Gaussians from a single image, focusing on recovering detailed appearance and geometry including unobserved regions. We introduce a single-view generalizable Human Gaussian Model (HGM),…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Jinnan Chen , Chen Li , Jianfeng Zhang , Lingting Zhu , Buzhen Huang , Hanlin Chen , Gim Hee Lee

We present PHORHUM, a novel, end-to-end trainable, deep neural network methodology for photorealistic 3D human reconstruction given just a monocular RGB image. Our pixel-aligned method estimates detailed 3D geometry and, for the first time,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Thiemo Alldieck , Mihai Zanfir , Cristian Sminchisescu

In this paper, we aim to address the challenge of novel view rendering of human performers who wear clothes with complex texture patterns using a sparse set of camera views. Although some recent works have achieved remarkable rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Tiansong Zhou , Jing Huang , Tao Yu , Ruizhi Shao , Kun Li

3D Human Body Reconstruction from a monocular image is an important problem in computer vision with applications in virtual and augmented reality platforms, animation industry, en-commerce domain, etc. While several of the existing works…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Abbhinav Venkat , Chaitanya Patel , Yudhik Agrawal , Avinash Sharma

Generating a 3D human model from a single reference image is challenging because it requires inferring textures and geometries in invisible views while maintaining consistency with the reference image. Previous methods utilizing 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Jingbo Zhang , Xiaoyu Li , Qi Zhang , Yanpei Cao , Ying Shan , Jing Liao

This work focuses on the problem of reconstructing a 3D human body mesh from a given 2D image. Despite the inherent ambiguity of the task of human mesh recovery, most existing works have adopted a method of regressing a single output. In…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Hanbyel Cho , Junmo Kim

The creation of lifelike human avatars capable of realistic pose variation and viewpoint flexibility remains a fundamental challenge in computer vision and graphics. Current approaches typically yield either geometrically inconsistent…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Chia-Hern Lai , I-Hsuan Lo , Yen-Ku Yeh , Thanh-Nguyen Truong , Ching-Chun Huang

Reconstructing complete and animatable 3D human avatars from monocular videos remains challenging, particularly under severe occlusions. While 3D Gaussian Splatting has enabled photorealistic human rendering, existing methods struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Jinlong Fan , Shanshan Zhao , Liang Zheng , Jing Zhang , Yuxiang Yang , Mingming Gong

In recent years, diffusion models have revolutionized visual generation, outperforming traditional frameworks like Generative Adversarial Networks (GANs). However, generating images of humans with realistic semantic parts, such as hands and…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Benzhi Wang , Jingkai Zhou , Jingqi Bai , Yang Yang , Weihua Chen , Fan Wang , Zhen Lei

Recent advances in deep generative models have led to an unprecedented level of realism for synthetically generated images of humans. However, one of the remaining fundamental limitations of these models is the ability to flexibly control…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Sergey Prokudin , Michael J. Black , Javier Romero

We present an approach to generate a 360-degree view of a person with a consistent, high-resolution appearance from a single input image. NeRF and its variants typically require videos or images from different viewpoints. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Badour AlBahar , Shunsuke Saito , Hung-Yu Tseng , Changil Kim , Johannes Kopf , Jia-Bin Huang

We present a novel method to improve the accuracy of the 3D reconstruction of clothed human shape from a single image. Recent work has introduced volumetric, implicit and model-based shape learning frameworks for reconstruction of objects…

Computer Vision and Pattern Recognition · Computer Science 2020-09-30 Akin Caliskan , Armin Mustafa , Evren Imre , Adrian Hilton

We introduce PeeledHuman - a novel shape representation of the human body that is robust to self-occlusions. PeeledHuman encodes the human body as a set of Peeled Depth and RGB maps in 2D, obtained by performing ray-tracing on the 3D body…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Sai Sagar Jinka , Rohan Chacko , Avinash Sharma , P. J. Narayanan