English
Related papers

Related papers: Human Pose as Compositional Tokens

200 papers

We propose an end-to-end trainable approach for multi-instance pose estimation, called POET (POse Estimation Transformer). Combining a convolutional neural network with a transformer encoder-decoder architecture, we formulate multiinstance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Lucas Stoffl , Maxime Vidal , Alexander Mathis

Video annotation is expensive and time consuming. Consequently, datasets for multi-person pose estimation and tracking are less diverse and have more sparse annotations compared to large scale image datasets for human pose estimation. This…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Umer Rafi , Andreas Doering , Bastian Leibe , Juergen Gall

Deep ConvNets have been shown to be effective for the task of human pose estimation from single images. However, several challenging issues arise in the video-based case such as self-occlusion, motion blur, and uncommon poses with few or no…

Computer Vision and Pattern Recognition · Computer Science 2017-04-03 Jie Song , Limin Wang , Luc Van Gool , Otmar Hilliges

In keypoint estimation tasks such as human pose estimation, heatmap-based regression is the dominant approach despite possessing notable drawbacks: heatmaps intrinsically suffer from quantization error and require excessive computation to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 William McNally , Kanav Vats , Alexander Wong , John McPhee

In general, human pose estimation methods are categorized into two approaches according to their architectures: regression (i.e., heatmap-free) and heatmap-based methods. The former one directly estimates precise coordinates of each…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Jonghyun Kim , Bosang Kim , Hyotae Lee , Jungpyo Kim , Wonhyeok Im , Lanying Jin , Dowoo Kwon , Jungho Lee

Human pose forecasting is the task of predicting articulated human motion given past human motion. There exists a number of popular benchmarks that evaluate an array of different models performing human pose forecasting. These benchmarks do…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Maria Priisalu , Ted Kronvall , Cristian Sminchisescu

Creating pose-driven human avatars is about modeling the mapping from the low-frequency driving pose to high-frequency dynamic human appearances, so an effective pose encoding method that can encode high-fidelity human details is essential…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zhe Li , Zerong Zheng , Yuxiao Liu , Boyao Zhou , Yebin Liu

This paper addresses the problem of estimating and tracking human body keypoints in complex, multi-person video. We propose an extremely lightweight yet highly effective approach that builds upon the latest advancements in human detection…

Computer Vision and Pattern Recognition · Computer Science 2018-05-04 Rohit Girdhar , Georgia Gkioxari , Lorenzo Torresani , Manohar Paluri , Du Tran

This work addresses 3D human pose reconstruction in single images. We present a method that combines Forward Kinematics (FK) with neural networks to ensure a fast and valid prediction of 3D pose. Pose is represented as a hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Maksym Ivashechkin , Oscar Mendez , Richard Bowden

In this paper, we focus on the coordinate representation in human pose estimation. While being the standard choice, heatmap based representation has not been systematically investigated. We found that the process of coordinate decoding…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Hanbin Dai , Liangbo Zhou , Feng Zhang , Zhengyu Zhang , Hong Hu , Xiatian Zhu , Mao Ye

Person re identification is a challenging retrieval task that requires matching a person's acquired image across non overlapping camera views. In this paper we propose an effective approach that incorporates both the fine and coarse pose…

Computer Vision and Pattern Recognition · Computer Science 2018-04-03 M. Saquib Sarfraz , Arne Schumann , Andreas Eberle , Rainer Stiefelhagen

Monocular 3D human pose estimation has made progress in recent years. Most of the methods focus on single persons, which estimate the poses in the person-centric coordinates, i.e., the coordinates based on the center of the target person.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Yu Cheng , Bo Wang , Robby T. Tan

Human pose estimation is a key step to action recognition. We propose a method of estimating 3D human poses from a single image, which works in conjunction with an existing 2D pose/joint detector. 3D pose estimation is challenging because…

Computer Vision and Pattern Recognition · Computer Science 2014-06-10 Chunyu Wang , Yizhou Wang , Zhouchen Lin , Alan L. Yuille , Wen Gao

Both the tasks of multi-person human pose estimation and pose tracking in videos are quite challenging. Existing methods can be categorized into two groups: top-down and bottom-up approaches. In this paper, following the top-down approach,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-24 Guanghan Ning , Ping Liu , Xiaochuan Fan , Chi Zhang

Occlusion presents a significant challenge in human pose estimation. The challenges posed by occlusion can be attributed to the following factors: 1) Data: The collection and annotation of occluded human pose samples are relatively…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Linhao Xu , Lin Zhao , Xinxin Sun , Di Wang , Guangyu Li , Kedong Yan

We explore the importance of spatial contextual information in human pose estimation. Most state-of-the-art pose networks are trained in a multi-stage manner and produce several auxiliary predictions for deep supervision. With this…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Hong Zhang , Hao Ouyang , Shu Liu , Xiaojuan Qi , Xiaoyong Shen , Ruigang Yang , Jiaya Jia

This paper presents a novel method for 3D human pose and shape estimation from images with sparse views, using joint points and silhouettes, based on a parametric model. Firstly, the parametric model is fitted to the joint points estimated…

Computer Vision and Pattern Recognition · Computer Science 2020-12-14 Zhongguo Li , Anders Heyden , Magnus Oskarsson

The task of 2D human pose estimation is challenging as the number of keypoints is typically large (~ 17) and this necessitates the use of robust neural network architectures and training pipelines that can capture the relevant features from…

Machine Learning · Computer Science 2022-04-22 Kaushik Balakrishnan , Devesh Upadhyay

Understanding the geometry and pose of objects in 2D images is a fundamental necessity for a wide range of real world applications. Driven by deep neural networks, recent methods have brought significant improvements to object pose…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Jogendra Nath Kundu , Rahul M. V. , Aditya Ganeshan , R. Venkatesh Babu

Human-object interaction(HOI) detection is a critical task in scene understanding. The goal is to infer the triplet <subject, predicate, object> in a scene. In this work, we note that the human pose itself as well as the relative spatial…

Computer Vision and Pattern Recognition · Computer Science 2020-08-06 Zhijun Liang , Junfa Liu , Yisheng Guan , Juan Rojas