English
Related papers

Related papers: Parallel mesh reconstruction streams for pose esti…

200 papers

Reconstructing multi-human body mesh from a single monocular image is an important but challenging computer vision problem. In addition to the individual body mesh models, we need to estimate relative 3D positions among subjects to generate…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Chenyan Wu , Yandong Li , Xianfeng Tang , James Wang

Reconstructing interacting hands from a single RGB image is a very challenging task. On the one hand, severe mutual occlusion and similar local appearance between two hands confuse the extraction of visual features, resulting in the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Pengfei Ren , Chao Wen , Xiaozheng Zheng , Zhou Xue , Haifeng Sun , Qi Qi , Jingyu Wang , Jianxin Liao

Realistic reconstruction of two hands interacting with objects is a new and challenging problem that is essential for building personalized Virtual and Augmented Reality environments. Graph Convolutional networks (GCNs) allow for the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Ahmed Tawfik Aboukhadra , Jameel Malik , Ahmed Elhayek , Nadia Robertini , Didier Stricker

This paper presents a simple yet powerful method for 3D human mesh reconstruction from a single RGB image. Most recently, the non-local interactions of the whole mesh vertices have been effectively estimated in the transformer while the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Jeonghwan Kim , Mi-Gyeong Gwon , Hyunwoo Park , Hyukmin Kwon , Gi-Mun Um , Wonjun Kim

3D interacting hand reconstruction is essential to facilitate human-machine interaction and human behaviors understanding. Previous works in this field either rely on auxiliary inputs such as depth images or they can only handle a single…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Yu Rong , Jingbo Wang , Ziwei Liu , Chen Change Loy

Monocular 3D reconstruction of deformable objects, such as human body parts, has been typically approached by predicting parameters of heavyweight linear models. In this paper, we demonstrate an alternative solution that is based on the…

Computer Vision and Pattern Recognition · Computer Science 2019-08-06 Dominik Kulon , Haoyang Wang , Riza Alp Güler , Michael Bronstein , Stefanos Zafeiriou

In the modern context, hand gesture recognition has emerged as a focal point. This is due to its wide range of applications, which include comprehending sign language, factories, hands-free devices, and guiding robots. Many researchers have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Md Abdur Rahim , Abu Saleh Musa Miah , Hemel Sharker Akash , Jungpil Shin , Md. Imran Hossain , Md. Najmul Hossain

Estimating 3D interacting hand pose from a single RGB image is essential for understanding human actions. Unlike most previous works that directly predict the 3D poses of two interacting hands simultaneously, we propose to decompose the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Hao Meng , Sheng Jin , Wentao Liu , Chen Qian , Mengxiang Lin , Wanli Ouyang , Ping Luo

Accurate hand pose estimation is vital in robotics, advancing dexterous manipulation in human-computer interaction. Toward this goal, this paper presents ReJSHand (which stands for Refined Joint and Skeleton Features), a cutting-edge…

Multi-view hand mesh reconstruction is a critical task for applications in virtual reality and human-computer interaction, but it remains a formidable challenge. Although existing multi-view hand reconstruction methods achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Jian Yang , Jiakun Li , Guoming Li , Zhen Shen , Huai-Yu Wu , Zhaoxin Fan , Heng Huang

Low-cost consumer depth cameras and deep learning have enabled reasonable 3D hand pose estimation from single depth images. In this paper, we present an approach that estimates 3D hand pose from regular RGB images. This task has far more…

Computer Vision and Pattern Recognition · Computer Science 2017-10-17 Christian Zimmermann , Thomas Brox

Monocular 3D hand mesh recovery is challenging due to high degrees of freedom of hands, 2D-to-3D ambiguity and self-occlusion. Most existing methods are either inefficient or less straightforward for predicting the position of 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yihong Lin , Xianjia Wu , Xilai Wang , Jianqiao Hu , Songju Lei , Xiandong Li , Wenxiong Kang

We present a new method, called MEsh TRansfOrmer (METRO), to reconstruct 3D human pose and mesh vertices from a single image. Our method uses a transformer encoder to jointly model vertex-vertex and vertex-joint interactions, and outputs 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Kevin Lin , Lijuan Wang , Zicheng Liu

3D hand pose estimation from images has seen considerable interest from the literature, with new methods improving overall 3D accuracy. One current challenge is to address hand-to-hand interaction where self-occlusions and finger…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Maksym Ivashechkin , Oscar Mendez , Richard Bowden

This work introduces a novel and generalizable multi-view Hand Mesh Reconstruction (HMR) model, named POEM, designed for practical use in real-world hand motion capture scenarios. The advances of the POEM model consist of two main aspects.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Lixin Yang , Licheng Zhong , Pengxiang Zhu , Xinyu Zhan , Junxiao Kong , Jian Xu , Cewu Lu

Recent years have witnessed a trend of the deep integration of the generation and reconstruction paradigms. In this paper, we extend the ability of controllable generative models for a more comprehensive hand mesh recovery task: direct hand…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Mengcheng Li , Hongwen Zhang , Yuxiang Zhang , Ruizhi Shao , Tao Yu , Yebin Liu

Predicting camera-space hand meshes from single RGB images is crucial for enabling realistic hand interactions in 3D virtual and augmented worlds. Previous work typically divided the task into two stages: given a cropped image of the hand,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Eugene Valassakis , Guillermo Garcia-Hernando

Reconstructing the hand mesh from one single RGB image is a challenging task because hands are often occluded by other objects. Most previous works attempt to explore more additional information and adopt attention mechanisms for improving…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Zixun Jiao , Xihan Wang , Zhaoqiang Xia , Lianhe Shao , Quanli Gao

We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands. Our approach is the first two-hand tracking solution that combines an extensive list of favorable properties, namely it is marker-less,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Franziska Mueller , Micah Davis , Florian Bernard , Oleksandr Sotnychenko , Mickeal Verschoor , Miguel A. Otaduy , Dan Casas , Christian Theobalt

This work addresses hand mesh recovery from a single RGB image. In contrast to most of the existing approaches where the parametric hand models are employed as the prior, we show that the hand mesh can be learned directly from the input…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Akila Pemasiri , Kien Nguyen Thanh , Sridha Sridharan , Clinton Fookes