English
Related papers

Related papers: Weakly-supervised 3D Pose Transfer with Keypoints

200 papers

Estimating the 3D pose of desktop objects is crucial for applications such as robotic manipulation. Many existing approaches to this problem require a depth map of the object for both training and prediction, which restricts them to opaque,…

Computer Vision and Pattern Recognition · Computer Science 2020-05-20 Xingyu Liu , Rico Jonschkowski , Anelia Angelova , Kurt Konolige

We present a deployment friendly, fast bottom-up framework for multi-person 3D human pose estimation. We adopt a novel neural representation of multi-person 3D pose which unifies the position of person instances with their corresponding 3D…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Jogendra Nath Kundu , Ambareesh Revanur , Govind Vitthal Waghmare , Rahul Mysore Venkatesh , R. Venkatesh Babu

Human pose transfer has typically been modeled as a 2D image-to-image translation problem. This formulation ignores the human body shape prior in 3D space and inevitably causes implausible artifacts, especially when facing occlusion. To…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Jinxiang Liu , Yangheng Zhao , Siheng Chen , Ya Zhang

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

Driven by recent computer vision and robotic applications, recovering 3D human poses has become increasingly important and attracted growing interests. In fact, completing this task is quite challenging due to the diverse appearances,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-16 Keze Wang , Liang Lin , Chenhan Jiang , Chen Qian , Pengxu Wei

In this paper, we consider the challenging task of simultaneously locating and recovering multiple hands from a single 2D image. Previous studies either focus on single hand reconstruction or solve this problem in a multi-stage way.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Jinwei Ren , Jianke Zhu , Jialiang Zhang

Recently, deep learning based 3D face reconstruction methods have shown promising results in both quality and efficiency.However, training deep neural networks typically requires a large volume of data, whereas face images with ground-truth…

Computer Vision and Pattern Recognition · Computer Science 2020-04-10 Yu Deng , Jiaolong Yang , Sicheng Xu , Dong Chen , Yunde Jia , Xin Tong

Human pose estimation is a major computer vision problem with applications ranging from augmented reality and video capture to surveillance and movement tracking. In the medical context, the latter may be an important biomarker for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Luca Schmidtke , Athanasios Vlontzos , Simon Ellershaw , Anna Lukens , Tomoki Arichi , Bernhard Kainz

In this paper, we propose an end-to-end framework that jointly learns keypoint detection, descriptor representation and cross-frame matching for the task of image-based 3D localization. Prior art has tackled each of these components…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Xiangyu Xu , Li Guan , Enrique Dunn , Haoxiang Li , Gang Hua

Image matching is still challenging in such scenes with large viewpoints or illumination changes or with low textures. In this paper, we propose a Transformer-based pseudo 3D image matching method. It upgrades the 2D features extracted from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Liming Han , Zhaoxiang Liu , Shiguo Lian

Understanding the geometry and pose of objects in 2D images is a fundamental necessity for a wide range of real world applications. Driven by deep neural networks, recent methods have brought significant improvements to object pose…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Jogendra Nath Kundu , Rahul M. V. , Aditya Ganeshan , R. Venkatesh Babu

Estimating the 6D object pose is an essential task in many applications. Due to the lack of depth information, existing RGB-based methods are sensitive to occlusion and illumination changes. How to extract and utilize the geometry features…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Xiao Lin , Deming Wang , Guangliang Zhou , Chengju Liu , Qijun Chen

The task of 2D human pose estimation is challenging as the number of keypoints is typically large (~ 17) and this necessitates the use of robust neural network architectures and training pipelines that can capture the relevant features from…

Machine Learning · Computer Science 2022-04-22 Kaushik Balakrishnan , Devesh Upadhyay

We present an unsupervised learning approach to recover 3D human pose from 2D skeletal joints extracted from a single image. Our method does not require any multi-view image data, 3D skeletons, correspondences between 2D-3D points, or use…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ching-Hang Chen , Ambrish Tyagi , Amit Agrawal , Dylan Drover , Rohith MV , Stefan Stojanov , James M. Rehg

We propose a direct, regression-based approach to 2D human pose estimation from single images. We formulate the problem as a sequence prediction task, which we solve using a Transformer network. This network directly learns a regression…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Weian Mao , Yongtao Ge , Chunhua Shen , Zhi Tian , Xinlong Wang , Zhibin Wang , Anton van den Hengel

Accurate 7DoF prediction of vehicles at an intersection is an important task for assessing potential conflicts between road users. In principle, this could be achieved by a single camera system that is capable of detecting the pose of each…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Matthew Howe , Ian Reid , Jamie Mackenzie

Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weakly-supervised methods require less supervision, by utilizing 2D poses or multi-view imagery without annotations, they…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Helge Rhodin , Mathieu Salzmann , Pascal Fua

Object pose estimation enables robots to understand and interact with their environments. Training with synthetic data is necessary in order to adapt to novel situations. Unfortunately, pose estimation under domain shift, i.e., training on…

Computer Vision and Pattern Recognition · Computer Science 2020-11-02 Stefan Thalhammer , Markus Leitner , Timothy Patten , Markus Vincze

Most recent view-invariant action recognition and performance assessment approaches rely on a large amount of annotated 3D skeleton data to extract view-invariant features. However, acquiring 3D skeleton data can be cumbersome, if not…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Faegheh Sardari , Björn Ommer , Majid Mirmehdi

Transferring the style from one image onto another is a popular and widely studied task in computer vision. Yet, style transfer in the 3D setting remains a largely unexplored problem. To our knowledge, we propose the first learning-based…

Computer Vision and Pattern Recognition · Computer Science 2021-05-19 Mattia Segu , Margarita Grinvald , Roland Siegwart , Federico Tombari