English
Related papers

Related papers: Leveraging MoCap Data for Human Mesh Recovery

200 papers

We present a novel approach for tracking multiple people in video. Unlike past approaches which employ 2D representations, we focus on using 3D representations of people, located in three-dimensional space. To this end, we develop a method,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jathushan Rajasegaran , Georgios Pavlakos , Angjoo Kanazawa , Jitendra Malik

To date, little attention has been given to multi-view 3D human mesh estimation, despite real-life applicability (e.g., motion capture, sport analysis) and robustness to single-view ambiguities. Existing solutions typically suffer from poor…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xuan Gong , Liangchen Song , Meng Zheng , Benjamin Planche , Terrence Chen , Junsong Yuan , David Doermann , Ziyan Wu

Existing human Motion Capture (MoCap) methods mostly focus on the visual similarity while neglecting the physical plausibility. As a result, downstream tasks such as driving virtual human in 3D scene or humanoid robots in real world suffer…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Shenghao Ren , Yi Lu , Jiayi Huang , Jiayi Zhao , He Zhang , Tao Yu , Qiu Shen , Xun Cao

There has been great progress in human 3D mesh recovery and great interest in learning about the world from consumer video data. Unfortunately current methods for 3D human mesh recovery work rather poorly on consumer video data, since on…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Chris Rockwell , David F. Fouhey

Recovering 3D human mesh from monocular images is a popular topic in computer vision and has a wide range of applications. This paper aims to estimate 3D mesh of multiple body parts (e.g., body, hands) with large-scale differences from a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-28 Yu Sun , Qian Bao , Wu Liu , Wenpeng Gao , Yili Fu , Chuang Gan , Tao Mei

Multi-person 3D mesh recovery from videos is a critical first step towards automatic perception of group behavior in virtual reality, physical therapy and beyond. However, existing approaches rely on multi-stage paradigms, where the person…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Haoyuan Li , Haoye Dong , Hanchao Jia , Dong Huang , Michael C. Kampffmeyer , Liang Lin , Xiaodan Liang

Dynamic multi-person mesh recovery has broad applications in sports broadcasting, virtual reality, and video games. However, current multi-view frameworks rely on a time-consuming camera calibration procedure. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Buzhen Huang , Jingyi Ju , Yuan Shu , Yangang Wang

We present MeshLeTemp, a powerful method for 3D human pose and mesh reconstruction from a single image. In terms of human body priors encoding, we propose using a learnable template human mesh instead of a constant template as utilized by…

Computer Vision and Pattern Recognition · Computer Science 2022-11-09 Trung Tran-Quang , Cuong Than-Cao , Hai Nguyen-Thanh , Hong Hoang Si

Human motion analysis has seen drastic improvements recently, however, due to the lack of representative datasets, for clinical in-bed scenarios it is still lagging behind. To address this issue, we implemented BlanketGen, a pipeline that…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 João Carmona , Tamás Karácsony , João Paulo Silva Cunha

Markerless motion capture and understanding of professional non-daily human movements is an important yet unsolved task, which suffers from complex motion patterns and severe self-occlusion, especially for the monocular setting. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Xin Chen , Anqi Pang , Wei Yang , Yuexin Ma , Lan Xu , Jingyi Yu

Human pose and shape estimation from RGB images is a highly sought after alternative to marker-based motion capture, which is laborious, requires expensive equipment, and constrains capture to laboratory environments. Monocular vision-based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Soyong Shin , Eni Halilaj

Although existing video-based 3D human mesh recovery methods have made significant progress, simultaneously estimating human pose and shape from low-resolution image features limits their performance. These image features lack sufficient…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Tao Tang , Hong Liu , Yingxuan You , Ti Wang , Wenhao Li

We introduce MulayCap, a novel human performance capture method using a monocular video camera without the need for pre-scanning. The method uses "multi-layer" representations for geometry reconstruction and texture rendering, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Zhaoqi Su , Weilin Wan , Tao Yu , Lingjie Liu , Lu Fang , Wenping Wang , Yebin Liu

We propose an efficient approach to exploiting motion information from consecutive frames of a video sequence to recover the 3D pose of people. Previous approaches typically compute candidate poses in individual frames and then link them in…

Computer Vision and Pattern Recognition · Computer Science 2016-09-05 Bugra Tekin , Artem Rozantsev , Vincent Lepetit , Pascal Fua

In this research, we address the challenge faced by existing deep learning-based human mesh reconstruction methods in balancing accuracy and computational efficiency. These methods typically prioritize accuracy, resulting in large network…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Ayman Ali , Ekkasit Pinyoanuntapong , Pu Wang , Mohsen Dorodchi

Optical motion capture (mocap) requires accurately reconstructing the human body from retroreflective markers, including pose and shape. In a typical mocap setting, marker labeling is an important but tedious and error-prone step. Previous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Nicholas Milef , John Keyser , Shu Kong

We propose a novel algorithm for the fitting of 3D human shape to images. Combining the accuracy and refinement capabilities of iterative gradient-based optimization techniques with the robustness of deep neural networks, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Jie Song , Xu Chen , Otmar Hilliges

The task of reconstructing 3D human motion has wideranging applications. The gold standard Motion capture (MoCap) systems are accurate but inaccessible to the general public due to their cost, hardware and space constraints. In contrast,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Kuan-Chieh Wang , Zhenzhen Weng , Maria Xenochristou , Joao Pedro Araujo , Jeffrey Gu , C. Karen Liu , Serena Yeung

Monocular 3D human pose estimation remains a challenging and ill-posed problem, particularly in real-time settings and unconstrained environments. While direct imageto-3D approaches require large annotated datasets and heavy models,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Mohamed Adjel

With the rapid development of autonomous driving, LiDAR-based 3D Human Pose Estimation (3D HPE) is becoming a research focus. However, due to the noise and sparsity of LiDAR-captured point clouds, robust human pose estimation remains…

Computer Vision and Pattern Recognition · Computer Science 2024-12-19 Xiaoqi An , Lin Zhao , Chen Gong , Jun Li , Jian Yang