English
Related papers

Related papers: An End-to-end Framework for Unconstrained Monocula…

200 papers

This paper considers to jointly tackle the highly correlated tasks of estimating 3D human body poses and predicting future 3D motions from RGB image sequences. Based on Lie algebra pose representation, a novel self-projection mechanism is…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Ji Yang , Youdong Ma , Xinxin Zuo , Sen Wang , Minglun Gong , Li Cheng

We present the first single-network approach for 2D~whole-body pose estimation, which entails simultaneous localization of body, face, hands, and feet keypoints. Due to the bottom-up formulation, our method maintains constant real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Gines Hidalgo , Yaadhav Raaj , Haroon Idrees , Donglai Xiang , Hanbyul Joo , Tomas Simon , Yaser Sheikh

We present a deep learning-based multitask framework for joint 3D human pose estimation and action recognition from RGB video sequences. Our approach proceeds along two stages. In the first, we run a real-time 2D pose detector to determine…

Computer Vision and Pattern Recognition · Computer Science 2019-07-17 Huy Hieu Pham , Houssam Salmane , Louahdi Khoudour , Alain Crouzil , Pablo Zegers , Sergio A Velastin

Following the successful application of deep convolutional neural networks to 2d human pose estimation, the next logical problem to solve is 3d human pose estimation from monocular images. While previous solutions have shown some success,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Alec Diaz-Arias , Mitchell Messmore , Dmitriy Shin , Stephen Baek

This paper presents an approach to estimating the continuous 6-DoF pose of an object from a single RGB image. The approach combines semantic keypoints predicted by a convolutional network (convnet) with a deformable shape model. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Karl Schmeckpeper , Philip R. Osteen , Yufu Wang , Georgios Pavlakos , Kenneth Chaney , Wyatt Jordan , Xiaowei Zhou , Konstantinos G. Derpanis , Kostas Daniilidis

We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori, and then adapt it to the task of category-independent…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Qihao Liu , Weichao Qiu , Weiyao Wang , Gregory D. Hager , Alan L. Yuille

Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weakly-supervised methods require less supervision, by utilizing 2D poses or multi-view imagery without annotations, they…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Helge Rhodin , Mathieu Salzmann , Pascal Fua

Current unsupervised 2D-3D human pose estimation (HPE) methods do not work in multi-person scenarios due to perspective ambiguity in monocular images. Therefore, we present one of the first studies investigating the feasibility of…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Peter Hardy , Hansung Kim

We address the highly challenging problem of real-time 3D hand tracking based on a monocular RGB-only sequence. Our tracking method combines a convolutional neural network with a kinematic 3D hand model, such that it generalizes well to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Franziska Mueller , Florian Bernard , Oleksandr Sotnychenko , Dushyant Mehta , Srinath Sridhar , Dan Casas , Christian Theobalt

3D human pose estimation is frequently seen as the task of estimating 3D poses relative to the root body joint. Alternatively, we propose a 3D human pose estimation method in camera coordinates, which allows effective combination of 2D…

Computer Vision and Pattern Recognition · Computer Science 2021-08-23 Diogo C Luvizon , Hedi Tabia , David Picard

We propose an approach to estimating the 3D pose of a hand, possibly handling an object, given a depth image. We show that we can correct the mistakes made by a Convolutional Neural Network trained to predict an estimate of the 3D pose by…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Markus Oberweger , Paul Wohlhart , Vincent Lepetit

The primary focus of this paper is the development of a framework for pose and size estimation of unseen objects given a single RGB image - all in real-time. In 2019, the first category-level pose and size estimation framework was proposed…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Eduardo Davalos , Mehran Aminian

Tremendous amounts of expensive annotated data are a vital ingredient for state-of-the-art 3d hand pose estimation. Therefore, synthetic data has been popularized as annotations are automatically available. However, models trained only with…

Computer Vision and Pattern Recognition · Computer Science 2018-07-17 Masoud Abdi , Ehsan Abbasnejad , Chee Peng Lim , Saeid Nahavandi

Unlike traditional robotic hands, underactuated compliant hands are challenging to model due to inherent uncertainties. Consequently, pose estimation of a grasped object is usually performed based on visual perception. However, visual…

Robotics · Computer Science 2024-01-18 Osher Azulay , Inbar Ben-David , Avishai Sintov

In this paper, we present a method for unconstrained end-to-end head pose estimation. We address the problem of ambiguous rotation labels by introducing the rotation matrix formalism for our ground truth data and propose a continuous 6D…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Thorsten Hempel , Ahmed A. Abdelrahman , Ayoub Al-Hamadi

3D hand pose estimation from a single depth image plays an important role in computer vision and human-computer interaction. Although recent hand pose estimation methods using convolution neural network (CNN) have shown notable improvements…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Cheol-hwan Yoo , Seo-won Ji , Yong-goo Shin , Seung-wook Kim , Sung-jea Ko

Recently, 3D input data based hand pose estimation methods have shown state-of-the-art performance, because 3D data capture more spatial information than the depth image. Whereas 3D voxel-based methods need a large amount of memory,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-06 Shile Li , Dongheui Lee

Category-level 3D pose estimation is a fundamentally important problem in computer vision and robotics, e.g. for embodied agents or to train 3D generative models. However, so far methods that estimate the category-level object pose require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Leonhard Sommer , Artur Jesslen , Eddy Ilg , Adam Kortylewski

In this work, we address the challenging task of 3D object recognition without the reliance on real-world 3D labeled data. Our goal is to predict the 3D shape, size, and 6D pose of objects within a single RGB-D image, operating at the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mayank Lunayach , Sergey Zakharov , Dian Chen , Rares Ambrus , Zsolt Kira , Muhammad Zubair Irshad

Reconstructing a 3D hand from a single-view RGB image is challenging due to various hand configurations and depth ambiguity. To reliably reconstruct a 3D hand from a monocular image, most state-of-the-art methods heavily rely on 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Yujin Chen , Zhigang Tu , Di Kang , Linchao Bao , Ying Zhang , Xuefei Zhe , Ruizhi Chen , Junsong Yuan