English
Related papers

Related papers: Self-Supervised 3D Human Pose Estimation in Static…

200 papers

Transformer architectures have become the model of choice in natural language processing and are now being introduced into computer vision tasks such as image classification, object detection, and semantic segmentation. However, in the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Ce Zheng , Sijie Zhu , Matias Mendieta , Taojiannan Yang , Chen Chen , Zhengming Ding

We propose embodied scene-aware human pose estimation where we estimate 3D poses based on a simulated agent's proprioception and scene awareness, along with external third-person observations. Unlike prior methods that often resort to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Zhengyi Luo , Shun Iwase , Ye Yuan , Kris Kitani

Current human pose estimation systems focus on retrieving an accurate 3D global estimate of a single person. Therefore, this paper presents one of the first 3D multi-person human pose estimation systems that is able to work in real-time and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Pawel Knap , Peter Hardy , Alberto Tamajo , Hwasup Lim , Hansung Kim

Monocular 3D human pose and shape estimation is challenging due to the many degrees of freedom of the human body and thedifficulty to acquire training data for large-scale supervised learning in complex visual scenes. In this paper we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Andrei Zanfir , Eduard Gabriel Bazavan , Hongyi Xu , Bill Freeman , Rahul Sukthankar , Cristian Sminchisescu

We address the problem of 3D human pose estimation from 2D input images using only weakly supervised training data. Despite showing considerable success for 2D pose estimation, the application of supervised machine learning to 3D pose…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Matteo Ruggero Ronchi , Oisin Mac Aodha , Robert Eng , Pietro Perona

This paper addresses the problem of 3D human pose estimation from a single image. We follow a standard two-step pipeline by first detecting the 2D position of the $N$ body joints, and then using these observations to infer 3D pose. For the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Francesc Moreno-Noguer

Human pose estimation is a major computer vision problem with applications ranging from augmented reality and video capture to surveillance and movement tracking. In the medical context, the latter may be an important biomarker for…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Luca Schmidtke , Athanasios Vlontzos , Simon Ellershaw , Anna Lukens , Tomoki Arichi , Bernhard Kainz

We propose a novel 3D human pose detector using two panoramic cameras. We show that transforming fisheye perspectives to rectilinear views allows a direct application of two-dimensional deep-learning pose estimation methods, without the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-02 Christoph Heindl , Thomas Pönitz , Andreas Pichler , Josef Scharinger

Human pose estimation aims at localizing human anatomical keypoints or body parts in the input data (e.g., images, videos, or signals). It forms a crucial component in enabling machines to have an insightful understanding of the behaviors…

Computer Vision and Pattern Recognition · Computer Science 2022-04-18 Haoming Chen , Runyang Feng , Sifan Wu , Hao Xu , Fengcheng Zhou , Zhenguang Liu

Estimating 3D hand and object pose from a single image is an extremely challenging problem: hands and objects are often self-occluded during interactions, and the 3D annotations are scarce as even humans cannot directly label the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Shaowei Liu , Hanwen Jiang , Jiarui Xu , Sifei Liu , Xiaolong Wang

Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant. However, as the acquisition of ground-truth 3D labels is labor intensive and time consuming, recent attention has shifted…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Soumava Kumar Roy , Leonardo Citraro , Sina Honari , Pascal Fua

Modern 3D human pose estimation techniques rely on deep networks, which require large amounts of training data. While weakly-supervised methods require less supervision, by utilizing 2D poses or multi-view imagery without annotations, they…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Helge Rhodin , Mathieu Salzmann , Pascal Fua

We propose a method of estimating a 3D human pose from a single view without 3D supervision. The key to our method is to leverage the 2D diffusion priors of motion diffusion models (MDMs) pre-trained on large 2D human pose datasets.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ryohei Goto , Takuya Fujihashi , Shunsuke Saruwatari , Fumio Okura

Reconstruction of 3D neural fields from posed images has emerged as a promising method for self-supervised representation learning. The key challenge preventing the deployment of these 3D scene learners on large-scale video data is their…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Cameron Smith , Yilun Du , Ayush Tewari , Vincent Sitzmann

Existing marker-less motion capture methods often assume known backgrounds, static cameras, and sequence specific motion priors, which narrows its application scenarios. Here we propose a fully automatic method that given multi-view video,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Yinghao Huang , Federica Bogo , Christoph Lassner , Angjoo Kanazawa , Peter V. Gehler , Ijaz Akhter , Michael J. Black

3D human pose estimation in multi-view operating room (OR) videos is a relevant asset for person tracking and action recognition. However, the surgical environment makes it challenging to find poses due to sterile clothing, frequent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Beerend G. A. Gerats , Jelmer M. Wolterink , Ivo A. M. J. Broeders

We present an unsupervised learning approach to recover 3D human pose from 2D skeletal joints extracted from a single image. Our method does not require any multi-view image data, 3D skeletons, correspondences between 2D-3D points, or use…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Ching-Hang Chen , Ambrish Tyagi , Amit Agrawal , Dylan Drover , Rohith MV , Stefan Stojanov , James M. Rehg

Our goal in this work is to generate realistic videos given just one initial frame as input. Existing unsupervised approaches to this task do not consider the fact that a video typically shows a 3D environment, and that this should remain…

Computer Vision and Pattern Recognition · Computer Science 2021-06-18 Paul Henderson , Christoph H. Lampert , Bernd Bickel

We propose an approach to estimate 3D human pose in real world units from a single RGBD image and show that it exceeds performance of monocular 3D pose estimation approaches from color as well as pose estimation exclusively from depth. Our…

Computer Vision and Pattern Recognition · Computer Science 2018-03-14 Christian Zimmermann , Tim Welschehold , Christian Dornhege , Wolfram Burgard , Thomas Brox

We propose to leverage recent advances in reliable 2D pose estimation with Convolutional Neural Networks (CNN) to estimate the 3D pose of people from depth images in multi-person Human-Robot Interaction (HRI) scenarios. Our method is based…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Angel Martínez-González , Michael Villamizar , Olivier Canévet , Jean-Marc Odobez