English
Related papers

Related papers: HandMIM: Pose-Aware Self-Supervised Learning for 3…

200 papers

Driven by recent computer vision and robotic applications, recovering 3D human poses has become increasingly important and attracted growing interests. In fact, completing this task is quite challenging due to the diverse appearances,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Keze Wang , Liang Lin , Chenhan Jiang , Chen Qian , Pengxu Wei

Hand pose estimation is difficult due to different environmental conditions, object- and self-occlusion as well as diversity in hand shape and appearance. Exhaustively covering this wide range of factors in fully annotated datasets has…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Adrian Spurr , Pavlo Molchanov , Umar Iqbal , Jan Kautz , Otmar Hilliges

We propose a Bayesian approximation to a deep learning architecture for 3D hand pose estimation. Through this framework, we explore and analyse the two types of uncertainties that are influenced either by data or by the learning capability.…

Computer Vision and Pattern Recognition · Computer Science 2021-02-23 Razvan Caramalau , Binod Bhattarai , Tae-Kyun Kim

Existing RGB-based 2D hand pose estimation methods learn the joint locations from a single resolution, which is not suitable for different hand sizes. To tackle this problem, we propose a new deep learning-based framework that consists of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Ikram Kourbane , Yakup Genc

3D hand-mesh reconstruction from RGB images facilitates many applications, including augmented reality (AR). However, this requires not only real-time speed and accurate hand pose and shape but also plausible mesh-image alignment. While…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Xiao Tang , Tianyu Wang , Chi-Wing Fu

Human pose estimation is an important topic in computer vision with many applications including gesture and activity recognition. However, pose estimation from image is challenging due to appearance variations, occlusions, clutter…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Lipeng Ke , Ming-Ching Chang , Honggang Qi , Siwei Lyu

The human hand moves in complex and high-dimensional ways, making estimation of 3D hand pose configurations from images alone a challenging task. In this work we propose a method to learn a statistical hand model represented by a…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Adrian Spurr , Jie Song , Seonwook Park , Otmar Hilliges

In this paper, we propose a self-supervised learningmethod for multi-object pose estimation. 3D object under-standing from 2D image is a challenging task that infers ad-ditional dimension from reduced-dimensional information.In particular,…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Hyeonwoo Yu , Jean Oh

We present a simple, yet effective, approach for self-supervised 3D human pose estimation. Unlike the prior work, we explore the temporal information next to the multi-view self-supervision. During training, we rely on triangulating 2D body…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Arij Bouazizi , Ulrich Kressel , Vasileios Belagiannis

Thanks to the rapid development of CNNs and depth sensors, great progress has been made in 3D hand pose estimation. Nevertheless, it is still far from being solved for its cluttered circumstance and severe self-occlusion of hand. In this…

Robotics · Computer Science 2019-11-13 Weiguo Zhou , Xin Jiang , Chen Chen , Sijia Mei , Yun-Hui Liu

Recently, masked image modeling (MIM) has gained considerable attention due to its capacity to learn from vast amounts of unlabeled data and has been demonstrated to be effective on a wide variety of vision tasks involving natural images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Zekai Chen , Devansh Agarwal , Kshitij Aggarwal , Wiem Safta , Samit Hirawat , Venkat Sethuraman , Mariann Micsinai Balan , Kevin Brown

2D Key-point estimation is an important precursor to 3D pose estimation problems for human body and hands. In this work, we discuss the data, architecture, and training procedure necessary to deploy extremely efficient 2.5D hand pose…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Prajwal Chidananda , Ayan Sinha , Adithya Rao , Douglas Lee , Andrew Rabinovich

The development of autoregressive modeling (AM) in computer vision lags behind natural language processing (NLP) in self-supervised pre-training. This is mainly caused by the challenge that images are not sequential signals and lack a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Kaiyou Song , Shan Zhang , Tong Wang

The combination of transformers and masked image modeling (MIM) pre-training framework has shown great potential in various vision tasks. However, the pre-training computational budget is too heavy and withholds the MIM from becoming a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Jianyuan Guo , Kai Han , Han Wu , Yehui Tang , Yunhe Wang , Chang Xu

Masked Image Modeling (MIM) achieves outstanding success in self-supervised representation learning. Unfortunately, MIM models typically have huge computational burden and slow learning process, which is an inevitable obstacle for their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haoqing Wang , Yehui Tang , Yunhe Wang , Jianyuan Guo , Zhi-Hong Deng , Kai Han

We study the problem of learning to estimate the 3D object pose from a few labelled examples and a collection of unlabelled data. Our main contribution is a learning framework, neural view synthesis and matching, that can transfer the 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Angtian Wang , Shenxiao Mei , Alan Yuille , Adam Kortylewski

Previous learning based hand pose estimation methods does not fully exploit the prior information in hand model geometry. Instead, they usually rely a separate model fitting step to generate valid hand poses. Such a post processing is…

Computer Vision and Pattern Recognition · Computer Science 2016-06-23 Xingyi Zhou , Qingfu Wan , Wei Zhang , Xiangyang Xue , Yichen Wei

In this paper, we study the task of 3D human pose estimation in the wild. This task is challenging due to lack of training data, as existing datasets are either in the wild images with 2D pose or in the lab images with 3D pose. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2017-08-01 Xingyi Zhou , Qixing Huang , Xiao Sun , Xiangyang Xue , Yichen Wei

A well-designed strong-weak augmentation strategy and the stable teacher to generate reliable pseudo labels are essential in the teacher-student framework of semi-supervised learning (SSL). Considering these in mind, to suit the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 JongMok Kim , Hwijun Lee , Jaeseung Lim , Jongkeun Na , Nojun Kwak , Jin Young Choi

Estimating the 3D pose of a hand from a 2D image is a well-studied problem and a requirement for several real-life applications such as virtual reality, augmented reality, and hand gesture recognition. Currently, reasonable estimations can…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Danilo Avola , Luigi Cinque , Alessio Fagioli , Gian Luca Foresti , Adriano Fragomeni , Daniele Pannone