English
Related papers

Related papers: Mocap-2-to-3: Multi-view Lifting for Monocular Mot…

200 papers

Estimating 3D human poses from a monocular video is still a challenging task. Many existing methods' performance drops when the target person is occluded by other objects, or the motion is too fast/slow relative to the scale and speed of…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Cheng Yu , Bo Wang , Bo Yang , Robby T. Tan

The proliferation of commercial egocentric devices offers a unique lens into human behavior, yet reconstructing full-body 3D motion remains difficult due to frequent self-occlusion and the 'out-of-sight' nature of the wearer's limbs. While…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Kyungwon Cho , Hanbyul Joo

Monocular 3D human performance capture is indispensable for many applications in computer graphics and vision for enabling immersive experiences. However, detailed capture of humans requires tracking of multiple aspects, including the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yue Jiang , Marc Habermann , Vladislav Golyanik , Christian Theobalt

Inter-person occlusion and depth ambiguity make estimating the 3D poses of monocular multiple persons as camera-centric coordinates a challenging problem. Typical top-down frameworks suffer from high computational redundancy with an…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Juze Zhang , Jingya Wang , Ye Shi , Fei Gao , Lan Xu , Jingyi Yu

Monocular 3D human pose estimation has made progress in recent years. Most of the methods focus on single persons, which estimate the poses in the person-centric coordinates, i.e., the coordinates based on the center of the target person.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Yu Cheng , Bo Wang , Robby T. Tan

We present a novel method for recovering world-grounded human motion from monocular video. The main challenge lies in the ambiguity of defining the world coordinate system, which varies between sequences. Previous approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zehong Shen , Huaijin Pi , Yan Xia , Zhi Cen , Sida Peng , Zechen Hu , Hujun Bao , Ruizhen Hu , Xiaowei Zhou

In this paper we present a novel method to estimate 3D human pose and shape from monocular videos. This task requires directly recovering pixel-alignment 3D human pose and body shape from monocular images or videos, which is challenging due…

Computer Vision and Pattern Recognition · Computer Science 2023-03-02 Sen Yang , Wen Heng , Gang Liu , Guozhong Luo , Wankou Yang , Gang Yu

Tracking 3D human motion from egocentric multi-camera headset is challenged by severe egomotion, partial visibility or occlusions and lack of training data. Existing methods designed for monocular video often require static or slowly-moving…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Nan Yang , Julian Straub , Fan Zhang , Richard Newcombe , Jakob Engel , Lingni Ma

Monocular 6-DoF pose estimation plays an important role in multiple spacecraft missions. Most existing pose estimation approaches rely on single images with static keypoint localisation, failing to exploit valuable temporal information…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Jose Sosa , Dan Pineau , Arunkumar Rathinam , Abdelrahman Shabayek , Djamila Aouada

Existing human Motion Capture (MoCap) methods mostly focus on the visual similarity while neglecting the physical plausibility. As a result, downstream tasks such as driving virtual human in 3D scene or humanoid robots in real world suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Shenghao Ren , Yi Lu , Jiayi Huang , Jiayi Zhao , He Zhang , Tao Yu , Qiu Shen , Xun Cao

In monocular video 3D multi-person pose estimation, inter-person occlusion and close interactions can cause human detection to be erroneous and human-joints grouping to be unreliable. Existing top-down methods rely on human detection and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Yu Cheng , Bo Wang , Bo Yang , Robby T. Tan

Reconstructing 3D human bodies from realistic motion sequences remains a challenge due to pervasive and complex occlusions. Current methods struggle to capture the dynamics of occluded body parts, leading to model penetration and distorted…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Hongsheng Wang , Lizao Zhang , Zhangnan Zhong , Shuolin Xu , Xinrui Zhou , Shengyu Zhang , Huahao Xu , Fei Wu , Feng Lin

Estimating human pose from video is a task that receives considerable attention due to its applicability in numerous 3D fields. The complexity of prior knowledge of human body movements poses a challenge to neural network models in the task…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Wenshuo Chen , Xiang Zhou , Zhengdi Yu , Weixi Gu , Kai Zhang

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

We introduce a data capture system and a new dataset, HO-Cap, for 3D reconstruction and pose tracking of hands and objects in videos. The system leverages multiple RGBD cameras and a HoloLens headset for data collection, avoiding the use of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jikai Wang , Qifan Zhang , Yu-Wei Chao , Bowen Wen , Xiaohu Guo , Yu Xiang

Estimating 3D poses from a monocular video is still a challenging task, despite the significant progress that has been made in recent years. Generally, the performance of existing methods drops when the target person is too small/large, or…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Yu Cheng , Bo Yang , Bo Wang , Robby T. Tan

Learning 3D human motion from 2D inputs is a fundamental task in the realms of computer vision and computer graphics. Many previous methods grapple with this inherently ambiguous task by introducing motion priors into the learning process.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Shuaiying Hou , Hongyu Tao , Junheng Fang , Changqing Zou , Hujun Bao , Weiwei Xu

State-of-the-art methods can recover accurate overall 3D human body motion from in-the-wild videos. However, they often fail to capture fine-grained articulations, especially in the feet, which are critical for applications such as gait…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Tom Wehrbein , Bodo Rosenhahn

Autonomous motion capture (mocap) systems for outdoor scenarios involving flying or mobile cameras rely on i) a robotic front-end to track and follow a human subject in real-time while he/she performs physical activities, and ii) an…

We present a unified perspective on tackling various human-centric video tasks by learning human motion representations from large-scale and heterogeneous data resources. Specifically, we propose a pretraining stage in which a motion…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Wentao Zhu , Xiaoxuan Ma , Zhaoyang Liu , Libin Liu , Wayne Wu , Yizhou Wang