English
Related papers

Related papers: FrankMocap: A Monocular 3D Whole-Body Pose Estimat…

200 papers

We present a lightweight and affordable motion capture method based on two smartwatches and a head-mounted camera. In contrast to the existing approaches that use six or more expert-level IMU devices, our approach is much more…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Jiye Lee , Hanbyul Joo

This paper focuses on the regression of multiple 3D people from a single RGB image. Existing approaches predominantly follow a multi-stage pipeline that first detects people in bounding boxes and then independently regresses their 3D body…

Computer Vision and Pattern Recognition · Computer Science 2021-09-17 Yu Sun , Qian Bao , Wu Liu , Yili Fu , Michael J. Black , Tao Mei

We propose the first real-time approach for the egocentric estimation of 3D human body pose in a wide range of unconstrained everyday activities. This setting has a unique set of challenges, such as mobility of the hardware setup, and…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Weipeng Xu , Avishek Chatterjee , Michael Zollhoefer , Helge Rhodin , Pascal Fua , Hans-Peter Seidel , Christian Theobalt

We present a bundle-adjustment-based algorithm for recovering accurate 3D human pose and meshes from monocular videos. Unlike previous algorithms which operate on single frames, we show that reconstructing a person over an entire sequence…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Anurag Arnab , Carl Doersch , Andrew Zisserman

Training state-of-the-art models for human pose estimation in videos requires datasets with annotations that are really hard and expensive to obtain. Although transformers have been recently utilized for body pose sequence modeling, related…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Fabien Baradel , Romain Brégier , Thibault Groueix , Philippe Weinzaepfel , Yannis Kalantidis , Grégory Rogez

Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jogendra Nath Kundu , Siddharth Seth , Rahul M , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

Robust 3D human pose estimation is crucial to ensure safe and effective human-robot collaboration. Accurate human perception,however, is particularly challenging in these scenarios due to strong occlusions and limited camera viewpoints.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Laura Bragagnolo , Matteo Terreran , Davide Allegro , Stefano Ghidoni

Marker-less 3D human motion capture from a single colour camera has seen significant progress. However, it is a very challenging and severely ill-posed problem. In consequence, even the most accurate state-of-the-art approaches have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Soshi Shimada , Vladislav Golyanik , Weipeng Xu , Christian Theobalt

We present a method for the real-time estimation of the full 3D pose of one or more human hands using a single commodity RGB camera. Recent work in the area has displayed impressive progress using RGBD input. However, since the introduction…

Computer Vision and Pattern Recognition · Computer Science 2017-12-12 Paschalis Panteleris , Iason Oikonomidis , Antonis Argyros

Accurate 3D human pose estimation from single images is possible with sophisticated deep-net architectures that have been trained on very large datasets. However, this still leaves open the problem of capturing motions for which no such…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Helge Rhodin , Jörg Spörri , Isinsu Katircioglu , Victor Constantin , Frédéric Meyer , Erich Müller , Mathieu Salzmann , Pascal Fua

The lifting-based methods have dominated monocular 3D human pose estimation by leveraging detected 2D poses as intermediate representations. The 2D component of the final 3D human pose benefits from the detected 2D poses, whereas its depth…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Mengyuan Liu , Jiajie Liu , Jinyan Zhang , Wenhao Li , Junsong Yuan

We present Ego3DPose, a highly accurate binocular egocentric 3D pose reconstruction system. The binocular egocentric setup offers practicality and usefulness in various applications, however, it remains largely under-explored. It has been…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Taeho Kang , Kyungjin Lee , Jinrui Zhang , Youngki Lee

Estimating camera wearer's body pose from an egocentric view (egopose) is a vital task in augmented and virtual reality. Existing approaches either use a narrow field of view front facing camera that barely captures the wearer, or an…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Hao Jiang , Vamsi Krishna Ithapu

3D hand pose estimation in everyday egocentric images is challenging for several reasons: poor visual signal (occlusion from the object of interaction, low resolution & motion blur), large perspective distortion (hands are close to the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Aditya Prakash , Ruisen Tu , Matthew Chang , Saurabh Gupta

Applications providing automated coaching for physical training are increasing in popularity, for example physical therapy. These applications rely on accurate and robust pose estimation using monocular video streams. State-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Tobias Leuthold , Michele Xiloyannis , Yves Zimmermann

Monocular 3D estimation is crucial for visual perception. However, current methods fall short by relying on oversimplified assumptions, such as pinhole camera models or rectified images. These limitations severely restrict their general…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Luigi Piccinelli , Christos Sakaridis , Mattia Segu , Yung-Hsu Yang , Siyuan Li , Wim Abbeloos , Luc Van Gool

The proliferation of commercial egocentric devices offers a unique lens into human behavior, yet reconstructing full-body 3D motion remains difficult due to frequent self-occlusion and the 'out-of-sight' nature of the wearer's limbs. While…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Kyungwon Cho , Hanbyul Joo

We present the first single-network approach for 2D~whole-body pose estimation, which entails simultaneous localization of body, face, hands, and feet keypoints. Due to the bottom-up formulation, our method maintains constant real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Gines Hidalgo , Yaadhav Raaj , Haroon Idrees , Donglai Xiang , Hanbyul Joo , Tomas Simon , Yaser Sheikh

3D human pose estimation involves reconstructing the human skeleton by detecting the body joints. Accurate and efficient solutions are required for several real-world applications including animation, human-robot interaction, surveillance,…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Ana Filipa Rodrigues Nogueira , Hélder P. Oliveira , Luís F. Teixeira

Hand pose estimation from a single image has many applications. However, approaches to full 3D body pose estimation are typically trained on day-to-day activities or actions. As such, detailed hand-to-hand interactions are poorly…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Maksym Ivashechkin , Oscar Mendez , Richard Bowden