English
Related papers

Related papers: Estimating Egocentric 3D Human Pose in the Wild wi…

200 papers

Estimation of 3D human pose from monocular image has gained considerable attention, as a key step to several human-centric applications. However, generalizability of human pose estimation models developed using supervision on large-scale…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Jogendra Nath Kundu , Siddharth Seth , Rahul M , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

Understanding social interactions from egocentric views is crucial for many applications, ranging from assistive robotics to AR/VR. Key to reasoning about interactions is to understand the body pose and motion of the interaction partner…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Siwei Zhang , Qianli Ma , Yan Zhang , Zhiyin Qian , Taein Kwon , Marc Pollefeys , Federica Bogo , Siyu Tang

We propose a method for object-aware 3D egocentric pose estimation that tightly integrates kinematics modeling, dynamics modeling, and scene object information. Unlike prior kinematics or dynamics-based approaches where the two components…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Zhengyi Luo , Ryo Hachiuma , Ye Yuan , Kris Kitani

We propose a CNN-based approach for 3D human body pose estimation from single RGB images that addresses the issue of limited generalizability of models trained solely on the starkly limited publicly available 3D pose data. Using only the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Dushyant Mehta , Helge Rhodin , Dan Casas , Pascal Fua , Oleksandr Sotnychenko , Weipeng Xu , Christian Theobalt

Body orientation estimation provides crucial visual cues in many applications, including robotics and autonomous driving. It is particularly desirable when 3-D pose estimation is difficult to infer due to poor image resolution, occlusion or…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 Chenyan Wu , Yukun Chen , Jiajia Luo , Che-Chun Su , Anuja Dawane , Bikramjot Hanzra , Zhuo Deng , Bilan Liu , James Wang , Cheng-Hao Kuo

Egocentric 3D human pose estimation (HPE) from images is challenging due to severe self-occlusions and strong distortion introduced by the fish-eye view from the head mounted camera. Although existing works use intermediate heatmap-based…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Jinman Park , Kimathi Kaai , Saad Hossain , Norikatsu Sumi , Sirisha Rambhatla , Paul Fieguth

Marker-based and marker-less optical skeletal motion-capture methods use an outside-in arrangement of cameras placed around a scene, with viewpoints converging on the center. They often create discomfort by possibly needed marker suits, and…

Computer Vision and Pattern Recognition · Computer Science 2017-01-03 Helge Rhodin , Christian Richardt , Dan Casas , Eldar Insafutdinov , Mohammad Shafiei , Hans-Peter Seidel , Bernt Schiele , Christian Theobalt

We focus on the task of everyday hand pose estimation from egocentric viewpoints. For this task, we show that depth sensors are particularly informative for extracting near-field interactions of the camera wearer with his/her environment.…

Computer Vision and Pattern Recognition · Computer Science 2014-12-02 Gregory Rogez , James S. Supancic , Maryam Khademi , Jose Maria Martinez Montiel , Deva Ramanan

Accurately estimating the 3D pose of the camera wearer in egocentric video sequences is crucial to modeling human behavior in virtual and augmented reality applications. The task presents unique challenges due to the limited visibility of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-08 Luca Scofano , Alessio Sampieri , Edoardo De Matteis , Indro Spinelli , Fabio Galasso

Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant. However, as the acquisition of ground-truth 3D labels is labor intensive and time consuming, recent attention has shifted…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soumava Kumar Roy , Leonardo Citraro , Sina Honari , Pascal Fua

Recently, remarkable advances have been achieved in 3D human pose estimation from monocular images because of the powerful Deep Convolutional Neural Networks (DCNNs). Despite their success on large-scale datasets collected in the…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Wei Yang , Wanli Ouyang , Xiaolong Wang , Jimmy Ren , Hongsheng Li , Xiaogang Wang

Current unsupervised 2D-3D human pose estimation (HPE) methods do not work in multi-person scenarios due to perspective ambiguity in monocular images. Therefore, we present one of the first studies investigating the feasibility of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Peter Hardy , Hansung Kim

Camera captured human pose is an outcome of several sources of variation. Performance of supervised 3D pose estimation approaches comes at the cost of dispensing with variations, such as shape and appearance, that may be useful for solving…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Jogendra Nath Kundu , Siddharth Seth , Varun Jampani , Mugalodi Rakesh , R. Venkatesh Babu , Anirban Chakraborty

We present EgoCOL, an egocentric camera pose estimation method for open-world 3D object localization. Our method leverages sparse camera pose reconstructions in a two-fold manner, video and scan independently, to estimate the camera pose of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Cristhian Forigua , Maria Escobar , Jordi Pont-Tuset , Kevis-Kokitsi Maninis , Pablo Arbeláez

We present EgoPoseFormer, a simple yet effective transformer-based model for stereo egocentric human pose estimation. The main challenge in egocentric pose estimation is overcoming joint invisibility, which is caused by self-occlusion or a…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Chenhongyi Yang , Anastasia Tkach , Shreyas Hampali , Linguang Zhang , Elliot J. Crowley , Cem Keskin

We propose the use of a proportional-derivative (PD) control based policy learned via reinforcement learning (RL) to estimate and forecast 3D human pose from egocentric videos. The method learns directly from unsegmented egocentric videos…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Ye Yuan , Kris Kitani

We address the problem of 3D human pose estimation from 2D input images using only weakly supervised training data. Despite showing considerable success for 2D pose estimation, the application of supervised machine learning to 3D pose…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Matteo Ruggero Ronchi , Oisin Mac Aodha , Robert Eng , Pietro Perona

Monocular egocentric human pose estimation is essential for ubiquitous activity monitoring. However, understanding the user's absolute location within the environment remains a challenge. Existing methods primarily focus on relative motion…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hiroyuki Deguchi , Ryosuke Hori , Kotaro Amaya , Tsubasa Maruyama , Mitsunori Tada , Hideo Saito

We present a simple, yet effective, approach for self-supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi-view self-supervision. During training, we rely on triangulating 2D body…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Arij Bouazizi , Ulrich Kressel , Vasileios Belagiannis

Egocentric, or first-person vision which became popular in recent years with an emerge in wearable technology, is different than exocentric (third-person) vision in some distinguishable ways, one of which being that the camera wearer is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-11 Jessica Finocchiaro , Aisha Urooj Khan , Ali Borji