English
Related papers

Related papers: Pixel-wise Regression: 3D Hand Pose Estimation via…

200 papers

Predicting camera-space hand meshes from single RGB images is crucial for enabling realistic hand interactions in 3D virtual and augmented worlds. Previous work typically divided the task into two stages: given a cropped image of the hand,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Eugene Valassakis , Guillermo Garcia-Hernando

This report describes our 1st place solution to ECCV 2022 challenge on Human Body, Hands, and Activities (HBHA) from Egocentric and Multi-view Cameras (hand pose estimation). In this challenge, we aim to estimate global 3D hand poses from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Hoseong Cho , Donguk Kim , Chanwoo Kim , Seongyeong Lee , Seungryul Baek

The task of estimating the 6D pose of an object from RGB images can be broken down into two main steps: an initial pose estimation step, followed by a refinement procedure to correctly register the object and its observation. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2021-01-06 Stefan Stevsic , Otmar Hilliges

Encouraged by the success of contrastive learning on image classification tasks, we propose a new self-supervised method for the structured regression task of 3D hand pose estimation. Contrastive learning makes use of unlabeled data for the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Adrian Spurr , Aneesh Dahiya , Xi Wang , Xucong Zhang , Otmar Hilliges

Eye-in-hand camera calibration is a fundamental and long-studied problem in robotics. We present a study on using learning-based methods for solving this problem online from a single RGB image, whilst training our models with entirely…

Robotics · Computer Science 2021-11-05 Eugene Valassakis , Kamil Dreczkowski , Edward Johns

Global visual localization estimates the absolute pose of a camera using a single image, in a previously mapped area. Obtaining the pose from a single image enables many robotics and augmented/virtual reality applications. Inspired by…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Mohammad Altillawi , Shile Li , Sai Manoj Prakhya , Ziyuan Liu , Joan Serrat

In this paper, we propose a novel structure-aware 3D hourglass network for hand pose estimation from a single depth image, which achieves state-of-the-art results on MSRA and NYU datasets. Compared to existing works that perform…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Fuyang Huang , Ailing Zeng , Minhao Liu , Jing Qin , Qiang Xu

Solving the camera-to-robot pose is a fundamental requirement for vision-based robot control, and is a process that takes considerable effort and cares to make accurate. Traditional approaches require modification of the robot via markers,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Jingpei Lu , Florian Richter , Michael C. Yip

As a fundamental and challenging problem in computer vision, hand pose estimation aims to estimate the hand joint locations from depth images. Typically, the problem is modeled as learning a mapping function from images to hand joint…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Yiming Wu , Wei Ji , Xi Li , Gang Wang , Jianwei Yin , Fei Wu

DeepPrior is a simple approach based on Deep Learning that predicts the joint 3D locations of a hand given a depth map. Since its publication early 2015, it has been outperformed by several impressive works. Here we show that with simple…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Markus Oberweger , Vincent Lepetit

Most of the existing deep learning-based methods for 3D hand and human pose estimation from a single depth map are based on a common framework that takes a 2D depth map and directly regresses the 3D coordinates of keypoints, such as hand or…

Computer Vision and Pattern Recognition · Computer Science 2018-08-17 Gyeongsik Moon , Ju Yong Chang , Kyoung Mu Lee

In this paper, we address the problem of building dense correspondences between human images under arbitrary camera viewpoints and body poses. Prior art either assumes small motion between frames or relies on local descriptors, which cannot…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Feitong Tan , Danhang Tang , Mingsong Dou , Kaiwen Guo , Rohit Pandey , Cem Keskin , Ruofei Du , Deqing Sun , Sofien Bouaziz , Sean Fanello , Ping Tan , Yinda Zhang

We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands. Our approach is the first two-hand tracking solution that combines an extensive list of favorable properties, namely it is marker-less,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Franziska Mueller , Micah Davis , Florian Bernard , Oleksandr Sotnychenko , Mickeal Verschoor , Miguel A. Otaduy , Dan Casas , Christian Theobalt

In this work, we introduce a novel method for calculating the 6DoF pose of an object using a single RGB-D image. Unlike existing methods that either directly predict objects' poses or rely on sparse keypoints for pose recovery, our approach…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Zong-Wei Hong , Yen-Yang Hung , Chu-Song Chen

This study considers the 3D human pose estimation problem in a single RGB image by proposing a conditional random field (CRF) model over 2D poses, in which the 3D pose is obtained as a byproduct of the inference process. The unary term of…

Computer Vision and Pattern Recognition · Computer Science 2017-12-29 Ju Yong Chang , Kyoung Mu Lee

We present 3D Points Splatting Hand Reconstruction (3D-PSHR), a real-time and photo-realistic hand reconstruction approach. We propose a self-adaptive canonical points upsampling strategy to achieve high-resolution hand geometry…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Zheheng Jiang , Hossein Rahmani , Sue Black , Bryan M. Williams

Pose estimation of 3D objects in monocular images is a fundamental and long-standing problem in computer vision. Existing deep learning approaches for 6D pose estimation typically rely on the assumption of availability of 3D object models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Fu Li , Hao Yu , Ivan Shugurov , Benjamin Busam , Shaowu Yang , Slobodan Ilic

In the field of 3D Human Pose Estimation from monocular videos, the presence of diverse occlusion types presents a formidable challenge. Prior research has made progress by harnessing spatial and temporal cues to infer 3D poses from 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Mehwish Ghafoor , Arif Mahmood , Muhammad Bilal

Human hands are highly articulated and versatile at handling objects. Jointly estimating the 3D poses of a hand and the object it manipulates from a monocular camera is challenging due to frequent occlusions. Thus, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Haozhe Qi , Chen Zhao , Mathieu Salzmann , Alexander Mathis

Estimating the 3D pose of a hand from a 2D image is a well-studied problem and a requirement for several real-life applications such as virtual reality, augmented reality, and hand gesture recognition. Currently, reasonable estimations can…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Adriano Fragomeni , Daniele Pannone