English
Related papers

Related papers: 3D Pose Estimation of Two Interacting Hands from a…

200 papers

Accurate depth estimation under adverse night conditions has practical impact and applications, such as on autonomous driving and rescue robots. In this work, we studied monocular depth estimation at night time in which various adverse…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Peilun Shi , Jiachuan Peng , Jianing Qiu , Xinwei Ju , Frank Po Wen Lo , Benny Lo

This work addresses the challenging problem of unconstrained 3D hand pose estimation using monocular RGB images. Most of the existing approaches assume some prior knowledge of hand (such as hand locations and side information) is available…

Computer Vision and Pattern Recognition · Computer Science 2019-12-02 Sanjeev Sharma , Shaoli Huang , Dacheng Tao

We address the highly challenging problem of real-time 3D hand tracking based on a monocular RGB-only sequence. Our tracking method combines a convolutional neural network with a kinematic 3D hand model, such that it generalizes well to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Franziska Mueller , Florian Bernard , Oleksandr Sotnychenko , Dushyant Mehta , Srinath Sridhar , Dan Casas , Christian Theobalt

Event cameras offer the exciting possibility of tracking the camera's pose during high-speed motion and in adverse lighting conditions. Despite this promise, existing event-based monocular visual odometry (VO) approaches demonstrate limited…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Simon Klenk , Marvin Motzet , Lukas Koestler , Daniel Cremers

We present a method for reconstructing accurate and consistent 3D hands from a monocular video. We observe that detected 2D hand keypoints and the image texture provide important cues about the geometry and texture of the 3D hand, which can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Zhigang Tu , Zhisheng Huang , Yujin Chen , Di Kang , Linchao Bao , Bisheng Yang , Junsong Yuan

In this paper, we introduce a method to automatically reconstruct the 3D motion of a person interacting with an object from a single RGB video. Our method estimates the 3D poses of the person and the object, contact positions, and forces…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Zongmian Li , Jiri Sedlar , Justin Carpentier , Ivan Laptev , Nicolas Mansard , Josef Sivic

Estimating the 3D pose of a hand is an essential part of human-computer interaction. Estimating 3D pose using depth or multi-view sensors has become easier with recent advances in computer vision, however, regressing pose from a single RGB…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Umar Iqbal , Pavlo Molchanov , Thomas Breuel , Juergen Gall , Jan Kautz

We present an approach for real-time, robust and accurate hand pose estimation from moving egocentric RGB-D cameras in cluttered real environments. Existing methods typically fail for hand-object interactions in cluttered scenes imaged from…

Computer Vision and Pattern Recognition · Computer Science 2018-11-26 Franziska Mueller , Dushyant Mehta , Oleksandr Sotnychenko , Srinath Sridhar , Dan Casas , Christian Theobalt

We present a novel method for monocular hand shape and pose estimation at unprecedented runtime performance of 100fps and at state-of-the-art accuracy. This is enabled by a new learning based architecture designed such that it can make use…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Yuxiao Zhou , Marc Habermann , Weipeng Xu , Ikhsanul Habibie , Christian Theobalt , Feng Xu

We present a novel solution to the problem of 3D tracking of the articulated motion of human hand(s), possibly in interaction with other objects. The vast majority of contemporary relevant work capitalizes on depth information provided by…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Paschalis Panteleris , Antonis Argyros

3D hand pose tracking/estimation will be very important in the next generation of human-computer interaction. Most of the currently available algorithms rely on low-cost active depth sensors. However, these sensors can be easily interfered…

Computer Vision and Pattern Recognition · Computer Science 2016-10-25 Jiawei Zhang , Jianbo Jiao , Mingliang Chen , Liangqiong Qu , Xiaobin Xu , Qingxiong Yang

Vision-based localization is a cost-effective and thus attractive solution for many intelligent mobile platforms. However, its accuracy and especially robustness still suffer from low illumination conditions, illumination changes, and…

Robotics · Computer Science 2024-01-17 Yi-Fan Zuo , Wanting Xu , Xia Wang , Yifu Wang , Laurent Kneip

3D object detection is essential for autonomous systems, enabling precise localization and dimension estimation. While LiDAR and RGB cameras are widely used, their fixed frame rates create perception gaps in high-speed scenarios. Event…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Jae-Young Kang , Hoonhee Cho , Kuk-Jin Yoon

Estimating human pose using a front-facing egocentric camera is essential for applications such as sports motion analysis, VR/AR, and AI for wearable devices. However, many existing methods rely on RGB cameras and do not account for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Wataru Ikeda , Masashi Hatano , Ryosei Hara , Mariko Isogawa

Hand pose estimation from the monocular 2D image is challenging due to the variation in lighting, appearance, and background. While some success has been achieved using deep neural networks, they typically require collecting a large dataset…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Yikang Li , Chris Twigg , Yuting Ye , Lingling Tao , Xiaogang Wang

In whiteboard-based remote communication, the seamless integration of drawn content and hand-screen interactions is essential for an immersive user experience. Previous methods either require bulky device setups for capturing hand gestures…

Human-Computer Interaction · Computer Science 2024-09-23 Xinshuang Liu , Yizhong Zhang , Xin Tong

Capturing the interactions between humans and their environment in 3D is important for many applications in robotics, graphics, and vision. Recent works to reconstruct the 3D human and object from a single RGB image do not have consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xianghui Xie , Bharat Lal Bhatnagar , Gerard Pons-Moll

We propose an approach to estimate arm and hand dynamics from monocular video by utilizing the relationship between arm and hand. Although monocular full human motion capture technologies have made great progress in recent years, recovering…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Shuying Liu , Wenbin Wu , Jiaxian Wu , Yue Lin

Event cameras provide microsecond latency, making them suitable for 6D object pose tracking in fast, dynamic scenes where conventional RGB and depth pipelines suffer from motion blur and large pixel displacements. We introduce EventTrack6D,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jae-Young Kang , Hoonhee Cho , Taeyeop Lee , Minjun Kang , Bowen Wen , Youngho Kim , Kuk-Jin Yoon

We introduce EDS, a direct monocular visual odometry using events and frames. Our algorithm leverages the event generation model to track the camera motion in the blind time between frames. The method formulates a direct probabilistic…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Javier Hidalgo-Carrió , Guillermo Gallego , Davide Scaramuzza