English
Related papers

Related papers: ClimbingCap: Multi-Modal Dataset and Method for Ro…

200 papers

Human motion plays an important role in many fields. Large databases exist that store and make available recordings of human motions. However, annotating each motion with multiple labels is a cumbersome and error-prone process. This…

Machine Learning · Computer Science 2016-05-06 Matthias Plappert

We present an approach for 3D global human mesh recovery from monocular videos recorded with dynamic cameras. Our approach is robust to severe and long-term occlusions and tracks human bodies even when they go outside the camera's field of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ye Yuan , Umar Iqbal , Pavlo Molchanov , Kris Kitani , Jan Kautz

We present the first marker-less approach for temporally coherent 3D performance capture of a human with general clothing from monocular video. Our approach reconstructs articulated human skeleton motion as well as medium-scale non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Weipeng Xu , Avishek Chatterjee , Michael Zollhöfer , Helge Rhodin , Dushyant Mehta , Hans-Peter Seidel , Christian Theobalt

We present Multi-HMR, a strong sigle-shot model for multi-person 3D human mesh recovery from a single RGB image. Predictions encompass the whole body, i.e., including hands and facial expressions, using the SMPL-X parametric model and 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Fabien Baradel , Matthieu Armando , Salma Galaaoui , Romain Brégier , Philippe Weinzaepfel , Grégory Rogez , Thomas Lucas

State-of-the-art methods can recover accurate overall 3D human body motion from in-the-wild videos. However, they often fail to capture fine-grained articulations, especially in the feet, which are critical for applications such as gait…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Tom Wehrbein , Bodo Rosenhahn

Monocular 3D motion capture (mocap) is beneficial to many applications. The use of a single camera, however, often fails to handle occlusions of different body parts and hence it is limited to capture relatively simple movements. We present…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Han Liang , Yannan He , Chengfeng Zhao , Mutian Li , Jingya Wang , Jingyi Yu , Lan Xu

Multiple cameras can provide comprehensive multi-view video coverage of a person. Fusing this multi-view data is crucial for tasks like behavioral analysis, although it traditionally requires camera calibration, a process that is often…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yitao Zhu , Sheng Wang , Mengjie Xu , Zixu Zhuang , Zhixin Wang , Kaidong Wang , Han Zhang , Qian Wang

Humans constantly interact with daily objects to accomplish tasks. To understand such interactions, computers need to reconstruct these from cameras observing whole-body interaction with scenes. This is challenging due to occlusion between…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Yinghao Huang , Omid Tehari , Michael J. Black , Dimitrios Tzionas

Humanoid motion tracking policies are central to building teleoperation pipelines and hierarchical controllers, yet they face a fundamental challenge: the embodiment gap between humans and humanoid robots. Current approaches address this…

Robotics · Computer Science 2025-10-03 Joao Pedro Araujo , Yanjie Ze , Pei Xu , Jiajun Wu , C. Karen Liu

The high frame rate is a critical requirement for capturing fast human motions. In this setting, existing markerless image-based methods are constrained by the lighting requirement, the high data bandwidth and the consequent high…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Lan Xu , Weipeng Xu , Vladislav Golyanik , Marc Habermann , Lu Fang , Christian Theobalt

We introduce MetricHMSR, a novel framework for recovering metric human meshes and 3D scenes from a single monocular image. Existing methods struggle to recover metric scale due to monocular scale ambiguity and weak-perspective camera…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Chentao Song , He Zhang , Haolei Yuan , Haozhe Lin , Jianhua Tao , Hongwen Zhang , Tao Yu

Single-image human mesh recovery provides a compact 3D, person-centric representation that supports analysis, animation, AR and VR, rehabilitation, and human-computer interaction. However, prevailing systems impose an intact-limb prior and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Jiaying Ying , Heming Du , Kaihao Zhang , Sean M. Tweedy , Xin Yu

Dynamic multi-person mesh recovery has broad applications in sports broadcasting, virtual reality, and video games. However, current multi-view frameworks rely on a time-consuming camera calibration procedure. In this work, we focus on…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Buzhen Huang , Jingyi Ju , Yuan Shu , Yangang Wang

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Yating Tian , Hongwen Zhang , Yebin Liu , Limin Wang

We present a new online approach to track human whole-body motion from motion capture data, i.e., positions of labeled markers attached to the human body. Tracking in noisy data can be effectively performed with the aid of well-established…

Systems and Control · Computer Science 2015-11-16 Jannik Steinbring , Christian Mandery , Nikolaus Vahrenkamp , Tamim Asfour , Uwe D. Hanebeck

We present DiverseMotion, a new approach for synthesizing high-quality human motions conditioned on textual descriptions while preserving motion diversity.Despite the recent significant process in text-based human motion generation,existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Yunhong Lou , Linchao Zhu , Yaxiong Wang , Xiaohan Wang , Yi Yang

In this work, we consider the problem of estimating the 3D position of multiple humans in a scene as well as their body shape and articulation from a single RGB video recorded with a static camera. In contrast to expensive marker-based or…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Diogo Luvizon , Marc Habermann , Vladislav Golyanik , Adam Kortylewski , Christian Theobalt

We present an approach to reconstruct humans and track them over time. At the core of our approach, we propose a fully "transformerized" version of a network for human mesh recovery. This network, HMR 2.0, advances the state of the art and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Shubham Goel , Georgios Pavlakos , Jathushan Rajasegaran , Angjoo Kanazawa , Jitendra Malik

In sports, such as alpine skiing, coaches would like to know the speed and various biomechanical variables of their athletes and competitors. Existing methods use either body-worn sensors, which are cumbersome to setup, or manual image…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Roman Bachmann , Jörg Spörri , Pascal Fua , Helge Rhodin

Recently, through development of several 3d vision systems, widely used in various applications, medical and biometric fields. Microsoft kinect sensor have been most of used camera among 3d vision systems. Microsoft kinect sensor can obtain…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 M. S. Gokmen , M. Akbaba , O. Findik