English
Related papers

Related papers: Ego2HandsPose: A Dataset for Egocentric Two-hand 3…

200 papers

We present the first single-network approach for 2D~whole-body pose estimation, which entails simultaneous localization of body, face, hands, and feet keypoints. Due to the bottom-up formulation, our method maintains constant real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Gines Hidalgo , Yaadhav Raaj , Haroon Idrees , Donglai Xiang , Hanbyul Joo , Tomas Simon , Yaser Sheikh

Scene understanding is essential in determining how intelligent robotic grasping and manipulation could get. It is a problem that can be approached using different techniques: seen object segmentation, unseen object segmentation, or 6D pose…

Robotics · Computer Science 2022-11-29 Anas Gouda , Abraham Ghanem , Christopher Reining

We present a unified framework for understanding 3D hand and object interactions in raw image sequences from egocentric RGB cameras. Given a single RGB image, our model jointly estimates the 3D hand and object poses, models their…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Bugra Tekin , Federica Bogo , Marc Pollefeys

Convolutional Neural Network based approaches for monocular 3D human pose estimation usually require a large amount of training images with 3D pose annotations. While it is feasible to provide 2D joint annotations for large corpora of…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Ikhsanul Habibie , Weipeng Xu , Dushyant Mehta , Gerard Pons-Moll , Christian Theobalt

We present in this work the first end-to-end deep learning based method that predicts both 3D hand shape and pose from RGB images in the wild. Our network consists of the concatenation of a deep convolutional encoder, and a fixed…

Computer Vision and Pattern Recognition · Computer Science 2019-02-12 Adnane Boukhayma , Rodrigo de Bem , Philip H. S. Torr

Estimating 3D poses of multiple humans in real-time is a classic but still challenging task in computer vision. Its major difficulty lies in the ambiguity in cross-view association of 2D poses and the huge state space when there are…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Long Chen , Haizhou Ai , Rui Chen , Zijie Zhuang , Shuang Liu

Reliable embodied perception from an egocentric perspective is challenging yet essential for autonomous navigation technology of intelligent mobile agents. With the growing demand of social robotics, near-field scene understanding becomes…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Haisheng Su , Feixiang Song , Cong Ma , Wei Wu , Junchi Yan

This report introduces our team's (PCIE_EgoPose) solutions for the EgoExo4D Pose and Proficiency Estimation Challenges at CVPR2025. Focused on the intricate task of estimating 21 3D hand joints from RGB egocentric videos, which are…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Feng Chen , Kanokphan Lertniphonphan , Qiancheng Yan , Xiaohui Fan , Jun Xie , Tao Zhang , Zhepeng Wang

In this paper, we tackle the problem of Egocentric Human-Object Interaction (EHOI) detection in an industrial setting. To overcome the lack of public datasets in this context, we propose a pipeline and a tool for generating synthetic images…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Rosario Leonardi , Francesco Ragusa , Antonino Furnari , Giovanni Maria Farinella

We propose the use of a proportional-derivative (PD) control based policy learned via reinforcement learning (RL) to estimate and forecast 3D human pose from egocentric videos. The method learns directly from unsegmented egocentric videos…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Ye Yuan , Kris Kitani

Pose estimation commonly refers to computer vision methods that recognize people's body postures in images or videos. With recent advancements in deep learning, we now have compelling models to tackle the problem in real-time. Since these…

Robotics · Computer Science 2021-07-07 Arash Amini , Hafez Farazi , Sven Behnke

The availability of the large-scale labeled 3D poses in the Human3.6M dataset plays an important role in advancing the algorithms for 3D human pose estimation from a still image. We observe that recent innovation in this area mainly focuses…

Computer Vision and Pattern Recognition · Computer Science 2019-04-12 Luyang Wang , Yan Chen , Zhenhua Guo , Keyuan Qian , Mude Lin , Hongsheng Li , Jimmy S. Ren

Tracking and reconstructing the 3D pose and geometry of two hands in interaction is a challenging problem that has a high relevance for several human-computer interaction applications, including AR/VR, robotics, or sign language…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Jiayi Wang , Franziska Mueller , Florian Bernard , Suzanne Sorli , Oleksandr Sotnychenko , Neng Qian , Miguel A. Otaduy , Dan Casas , Christian Theobalt

Face performance capture and reenactment techniques use multiple cameras and sensors, positioned at a distance from the face or mounted on heavy wearable devices. This limits their applications in mobile and outdoor environments. We present…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Mohamed Elgharib , Mallikarjun BR , Ayush Tewari , Hyeongwoo Kim , Wentao Liu , Hans-Peter Seidel , Christian Theobalt

We present WorldPose, a novel dataset for advancing research in multi-person global pose estimation in the wild, featuring footage from the 2022 FIFA World Cup. While previous datasets have primarily focused on local poses, often limited to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Tianjian Jiang , Johsan Billingham , Sebastian Müksch , Juan Zarate , Nicolas Evans , Martin R. Oswald , Marc Pollefeys , Otmar Hilliges , Manuel Kaufmann , Jie Song

Contactless hand pose estimation requires sensors that provide precise spatial information and low computational complexity for real-time processing. Unlike vision-based systems, radar offers lighting independence and direct motion…

Signal Processing · Electrical Eng. & Systems 2024-06-21 Johanna Bräunig , Vanessa Wirth , Marc Stamminger , Ingrid Ullmann , Martin Vossiek

Training accurate 3D human pose estimators requires large amount of 3D ground-truth data which is costly to collect. Various weakly or self supervised pose estimation methods have been proposed due to lack of 3D data. Nevertheless, these…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Muhammed Kocabas , Salih Karagoz , Emre Akbas

Egocentric 3D human pose estimation (HPE) from images is challenging due to severe self-occlusions and strong distortion introduced by the fish-eye view from the head mounted camera. Although existing works use intermediate heatmap-based…

Computer Vision and Pattern Recognition · Computer Science 2022-06-13 Jinman Park , Kimathi Kaai , Saad Hossain , Norikatsu Sumi , Sirisha Rambhatla , Paul Fieguth

We present a new self-supervised approach, SelfPose3d, for estimating 3d poses of multiple persons from multiple camera views. Unlike current state-of-the-art fully-supervised methods, our approach does not require any 2d or 3d ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Vinkle Srivastav , Keqi Chen , Nicolas Padoy

This paper proposes a statistical approach to 2D pose estimation from human images. The main problems with the standard supervised approach, which is based on a deep recognition (image-to-pose) model, are that it often yields anatomically…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Takayuki Nakatsuka , Kazuyoshi Yoshii , Yuki Koyama , Satoru Fukayama , Masataka Goto , Shigeo Morishima