English
Related papers

Related papers: SyncHuman: Synchronizing 2D and 3D Generative Mode…

200 papers

Recent years have witnessed tremendous progress in the 3D reconstruction of dynamic humans from a monocular video with the advent of neural rendering techniques. This task has a wide range of applications, including the creation of virtual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Kanghao Chen , Zeyu Wang , Lin Wang

Advances in Deep Learning have recently made it possible to recover full 3D meshes of human poses from individual images. However, extension of this notion to videos for recovering temporally coherent poses still remains unexplored. A major…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Jian Liu , Naveed Akhtar , Ajmal Mian

In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion guidance in curernt human generative techniques. The…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Shenhao Zhu , Junming Leo Chen , Zuozhuo Dai , Qingkun Su , Yinghui Xu , Xun Cao , Yao Yao , Hao Zhu , Siyu Zhu

Novel view synthesis (NVS) of multi-human scenes imposes challenges due to the complex inter-human occlusions. Layered representations handle the complexities by dividing the scene into multi-layered radiance fields, however, they are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Youssef Abdelkareem , Shady Shehata , Fakhri Karray

In this paper, we aim to address the challenge of novel view rendering of human performers who wear clothes with complex texture patterns using a sparse set of camera views. Although some recent works have achieved remarkable rendering…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Tiansong Zhou , Jing Huang , Tao Yu , Ruizhi Shao , Kun Li

Remarkable strides have been made in reconstructing static scenes or human bodies from monocular videos. Yet, the two problems have largely been approached independently, without much synergy. Most visual SLAM methods can only reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Yizhou Zhao , Tuanfeng Y. Wang , Bhiksha Raj , Min Xu , Jimei Yang , Chun-Hao Paul Huang

Recent advances in 3D foundation models have led to growing interest in reconstructing humans and their surrounding environments. However, most existing approaches focus on monocular inputs, and extending them to multi-view settings…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Sangmin Kim , Minhyuk Hwang , Geonho Cha , Dongyoon Wee , Jaesik Park

Monocular 3D clothed human reconstruction aims to create a complete 3D avatar from a single image. To tackle the human geometry lacking in one RGB image, current methods typically resort to a preceding model for an explicit geometric…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Nanjie Yao , Gangjian Zhang , Wenhao Shen , Jian Shu , Hao Wang

In this paper, we introduce a method for reconstructing 3D humans from a single image using a biomechanically accurate skeleton model. To achieve this, we train a transformer that takes an image as input and estimates the parameters of the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Yan Xia , Xiaowei Zhou , Etienne Vouga , Qixing Huang , Georgios Pavlakos

Animatable 3D human reconstruction from a single image is a challenging problem due to the ambiguity in decoupling geometry, appearance, and deformation. Recent advances in 3D human reconstruction mainly focus on static human modeling, and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Lingteng Qiu , Xiaodong Gu , Peihao Li , Qi Zuo , Weichao Shen , Junfei Zhang , Kejie Qiu , Weihao Yuan , Guanying Chen , Zilong Dong , Liefeng Bo

The creation of 3D human face avatars from a single unconstrained image is a fundamental task that underlies numerous real-world vision and graphics applications. Despite the significant progress made in generative models, existing methods…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Wenqing Wang , Haosen Yang , Josef Kittler , Xiatian Zhu

In this work, we propose a method to address the challenge of rendering a 3D human from a single image in a free-view manner. Some existing approaches could achieve this by using generalizable pixel-aligned implicit fields to reconstruct a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Xiangjun Gao , Xiaoyu Li , Chaopeng Zhang , Qi Zhang , Yanpei Cao , Ying Shan , Long Quan

Recent advancements in video diffusion models have shown exceptional abilities in simulating real-world dynamics and maintaining 3D consistency. This progress inspires us to investigate the potential of these models to ensure dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Jianhong Bai , Menghan Xia , Xintao Wang , Ziyang Yuan , Xiao Fu , Zuozhu Liu , Haoji Hu , Pengfei Wan , Di Zhang

Reconstructing 3D humans from a single image has been extensively investigated. However, existing approaches often fall short on capturing fine geometry and appearance details, hallucinating occluded parts with plausible details, and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhenzhen Weng , Jingyuan Liu , Hao Tan , Zhan Xu , Yang Zhou , Serena Yeung-Levy , Jimei Yang

Single-image-to-3D models typically follow a sequential generation and reconstruction workflow. However, intermediate multi-view images synthesized by pre-trained generation models often lack cross-view consistency (CVC), significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xinyue Liang , Zhiyuan Ma , Lingchen Sun , Yanjun Guo , Lei Zhang

Recent advances in deep generative models have led to an unprecedented level of realism for synthetically generated images of humans. However, one of the remaining fundamental limitations of these models is the ability to flexibly control…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Sergey Prokudin , Michael J. Black , Javier Romero

Recent approaches to jointly reconstruct 3D humans and objects from a single RGB image represent 3D shapes with template-based or coarse models, which fail to capture details of loose clothing on human bodies. In this paper, we introduce a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ayushi Dutta , Marco Pesavento , Marco Volino , Adrian Hilton , Armin Mustafa

We present PHORHUM, a novel, end-to-end trainable, deep neural network methodology for photorealistic 3D human reconstruction given just a monocular RGB image. Our pixel-aligned method estimates detailed 3D geometry and, for the first time,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Thiemo Alldieck , Mihai Zanfir , Cristian Sminchisescu

Recent techniques on implicit geometry representation learning and neural rendering have shown promising results for 3D clothed human reconstruction from sparse video inputs. However, it is still challenging to reconstruct detailed surface…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Hao Wang , Qingshan Xu , Hongyuan Chen , Rui Ma

Despite substantial progress in text-driven 3D human motion synthesis, generating realistic multi-person interaction sequences remains challenging. Notably, body inter-penetration is a pervasive issue from both data acquisition to the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Nan Lei , Yuan-Ming Li , Ling-An Zeng , Liang Xu , Zhi-Wei Xia , Hui-Wen Huang , Fa-Ting Hong , Wei-Shi Zheng