English
Related papers

Related papers: HumanRAM: Feed-forward Human Reconstruction and An…

200 papers

We present a first step towards 4D (3D and time) human video stylization, which addresses style transfer, novel view synthesis and human animation within a unified framework. While numerous video stylization methods have been developed,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Tiantian Wang , Xinxin Zuo , Fangzhou Mu , Jian Wang , Ming-Hsuan Yang

We introduce UniCon3R, a unified feed-forward framework for online human-scene 4D reconstruction from monocular video. Current feed-forward human-scene reconstruction methods suffer from artifacts, where bodies float above the ground or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tanuj Sur , Shashank Tripathi , Nikos Athanasiou , Ha Linh Nguyen , Kai Xu , Michael J. Black , Angela Yao

Deep neural networks have achieved great progress in single-image 3D human reconstruction. However, existing methods still fall short in predicting rare poses. The reason is that most of the current models perform regression based on a…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Yu Rong , Ziwei Liu , Chen Change Loy

Reconstructing physically plausible human motion from monocular videos remains a challenging problem in computer vision and graphics. Existing methods primarily focus on kinematics-based pose estimation, often leading to unrealistic results…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Qiao Feng , Yiming Huang , Yufu Wang , Jiatao Gu , Lingjie Liu

Fast 3D clothed human reconstruction from monocular video remains a significant challenge in computer vision, particularly in balancing computational efficiency with reconstruction quality. Current approaches are either focused on static…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Matthew Marchellus , Nadhira Noor , In Kyu Park

The neural rendering of humans is a topic of great research significance. However, previous works mostly focus on achieving photorealistic details, neglecting the exploration of human parsing. Additionally, classical semantic work are all…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jie Zhang , Pengcheng Shi , Zaiwang Gu , Yiyang Zhou , Zhi Wang

Recent advances in generative models have achieved high-fidelity in 3D human reconstruction, yet their utility for specific tasks (e.g., human 3D segmentation) remains constrained. We propose HumanCrafter, a unified framework that enables…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Panwang Pan , Tingting Shen , Chenxin Li , Yunlong Lin , Kairun Wen , Jingjing Zhao , Yixuan Yuan

We introduce GRM, a large-scale reconstructor capable of recovering a 3D asset from sparse-view images in around 0.1s. GRM is a feed-forward transformer-based model that efficiently incorporates multi-view information to translate the input…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Yinghao Xu , Zifan Shi , Wang Yifan , Hansheng Chen , Ceyuan Yang , Sida Peng , Yujun Shen , Gordon Wetzstein

We present "Humans and Structure from Motion" (HSfM), a method for jointly reconstructing multiple human meshes, scene point clouds, and camera parameters in a metric world coordinate system from a sparse set of uncalibrated multi-view…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Lea Müller , Hongsuk Choi , Anthony Zhang , Brent Yi , Jitendra Malik , Angjoo Kanazawa

While previous years have seen great progress in the 3D reconstruction of humans from monocular videos, few of the state-of-the-art methods are able to handle loose garments that exhibit large non-rigid surface deformations during…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Chen Guo , Tianjian Jiang , Manuel Kaufmann , Chengwei Zheng , Julien Valentin , Jie Song , Otmar Hilliges

Human Mesh Recovery (HMR) from an image is a challenging problem because of the inherent ambiguity of the task. Existing HMR methods utilized either temporal information or kinematic relationships to achieve higher accuracy, but there is no…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Hanbyel Cho , Jaesung Ahn , Yooshin Cho , Junmo Kim

3D understanding and rendering of moving humans from monocular videos is a challenging task. Despite recent progress, the task remains difficult in real-world scenarios, where obstacles may block the camera view and cause partial occlusions…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Tiange Xiang , Adam Sun , Jiajun Wu , Ehsan Adeli , Li Fei-Fei

Despite recent advancements in high-fidelity human reconstruction techniques, the requirements for densely captured images or time-consuming per-instance optimization significantly hinder their applications in broader scenarios. To tackle…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Panwang Pan , Zhuo Su , Chenguo Lin , Zhen Fan , Yongjie Zhang , Zeming Li , Tingting Shen , Yadong Mu , Yebin Liu

We present a novel framework to reconstruct human avatars from monocular videos. Recent approaches have struggled either to capture the fine-grained dynamic details from the input or to generate plausible details at novel viewpoints, which…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yushuo Chen , Ruizhi Shao , Youxin Pang , Hongwen Zhang , Xinyi Wu , Rihui Wu , Yebin Liu

While the keypoint-based maps created by sparse monocular simultaneous localisation and mapping (SLAM) systems are useful for camera tracking, dense 3D reconstructions may be desired for many robotic tasks. Solutions involving depth cameras…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Tristan Laidlow , Jan Czarnowski , Stefan Leutenegger

We present animatable neural radiance fields (animatable NeRF) for detailed human avatar creation from monocular videos. Our approach extends neural radiance fields (NeRF) to the dynamic scenes with human movements via introducing explicit…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Jianchuan Chen , Ying Zhang , Di Kang , Xuefei Zhe , Linchao Bao , Xu Jia , Huchuan Lu

In multi-view 3D human pose estimation, models typically rely on images captured simultaneously from different camera views to predict a pose at a specific moment. While providing accurate spatial information, this traditional approach…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Ling Li , Changjie Chen , Yuyan Wang , Jiaqing Lyu , Kenglun Chang , Yiyun Chen , Zhidong Deng

Monocular SLAM has received a lot of attention due to its simple RGB inputs and the lifting of complex sensor constraints. However, existing monocular SLAM systems are designed for bounded scenes, restricting the applicability of SLAM…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Heng Zhou , Zhetao Guo , Shuhong Liu , Lechen Zhang , Qihao Wang , Yuxiang Ren , Mingrui Li

Human-motion video generation has been a challenging task, primarily due to the difficulty inherent in learning human body movements. While some approaches have attempted to drive human-centric video generation explicitly through pose…

Computer Vision and Pattern Recognition · Computer Science 2025-04-02 Boyuan Wang , Xiaofeng Wang , Chaojun Ni , Guosheng Zhao , Zhiqin Yang , Zheng Zhu , Muyang Zhang , Yukun Zhou , Xinze Chen , Guan Huang , Lihong Liu , Xingang Wang

Photorealistic and animatable human avatars are a key enabler for virtual/augmented reality, telepresence, and digital entertainment. While recent advances in 3D Gaussian Splatting (3DGS) have greatly improved rendering quality and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Cheng Peng , Jingxiang Sun , Yushuo Chen , Zhaoqi Su , Zhuo Su , Yebin Liu