English
Related papers

Related papers: Self-Supervised 3D Human Pose Estimation with Mult…

200 papers

Depth and ego-motion estimations are essential for the localization and navigation of autonomous robots and autonomous driving. Recent studies make it possible to learn the per-pixel depth and ego-motion from the unlabeled monocular video.…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Guangming Wang , Jiquan Zhong , Shijie Zhao , Wenhua Wu , Zhe Liu , Hesheng Wang

3D human pose estimation in multi-view operating room (OR) videos is a relevant asset for person tracking and action recognition. However, the surgical environment makes it challenging to find poses due to sterile clothing, frequent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Beerend G. A. Gerats , Jelmer M. Wolterink , Ivo A. M. J. Broeders

Monocular 3D human pose and shape estimation is an inherently ill-posed problem due to depth ambiguities, occlusions, and truncations. Recent probabilistic approaches learn a distribution over plausible 3D human meshes by maximizing the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tom Wehrbein , Marco Rudolph , Bodo Rosenhahn , Bastian Wandt

We propose embodied scene-aware human pose estimation where we estimate 3D poses based on a simulated agent's proprioception and scene awareness, along with external third-person observations. Unlike prior methods that often resort to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Zhengyi Luo , Shun Iwase , Ye Yuan , Kris Kitani

Articulation-centric 2D/3D pose supervision forms the core training objective in most existing 3D human pose estimation techniques. Except for synthetic source environments, acquiring such rich supervision for each real target domain at…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Mugalodi Rakesh , Jogendra Nath Kundu , Varun Jampani , R. Venkatesh Babu

We present a self-supervised learning approach to learning monocular 3D face reconstruction with a pose guidance network (PGN). First, we unveil the bottleneck of pose estimation in prior parametric 3D face learning methods, and propose to…

Computer Vision and Pattern Recognition · Computer Science 2020-10-12 Pengpeng Liu , Xintong Han , Michael Lyu , Irwin King , Jia Xu

Understanding the geometry and pose of objects in 2D images is a fundamental necessity for a wide range of real world applications. Driven by deep neural networks, recent methods have brought significant improvements to object pose…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Jogendra Nath Kundu , Rahul M. V. , Aditya Ganeshan , R. Venkatesh Babu

Head pose estimation plays a vital role in various applications, e.g., driverassistance systems, human-computer interaction, virtual reality technology, and so on. We propose a novel geometry based algorithm for accurately estimating the…

Computer Vision and Pattern Recognition · Computer Science 2020-01-06 Hui Yuan , Mengyu Li , Junhui Hou , Jimin Xiao

Category-level 3D pose estimation is a fundamentally important problem in computer vision and robotics, e.g. for embodied agents or to train 3D generative models. However, so far methods that estimate the category-level object pose require…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Leonhard Sommer , Artur Jesslen , Eddy Ilg , Adam Kortylewski

It is an exciting task to recover the scene's 3d-structure and camera pose from the video sequence. Most of the current solutions divide it into two parts, monocular depth recovery and camera pose estimation. The monocular depth recovery is…

Computer Vision and Pattern Recognition · Computer Science 2018-05-24 YanTong Wu , Yang Liu

Human pose estimation in two-dimensional images videos has been a hot topic in the computer vision problem recently due to its vast benefits and potential applications for improving human life, such as behaviors recognition, motion capture…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Thong Duy Nguyen , Milan Kresovic

We present a novel data-driven regularizer for weakly-supervised learning of 3D human pose estimation that eliminates the drift problem that affects existing approaches. We do this by moving the stereo reconstruction problem into the loss…

Computer Vision and Pattern Recognition · Computer Science 2019-09-16 Guillaume Rochette , Chris Russell , Richard Bowden

The common approach to 3D human pose estimation is predicting the body joint coordinates relative to the hip. This works well for a single person but is insufficient in the case of multiple interacting people. Methods predicting absolute…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Márton Véges , András Lőrincz

We address the challenges in estimating 3D human poses from multiple views under occlusion and with limited overlapping views. We approach multi-view, single-person 3D human pose reconstruction as a regression problem and propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Olivier Moliner , Sangxia Huang , Kalle Åström

Modern deep learning-based 3D pose estimation approaches require plenty of 3D pose annotations. However, existing 3D datasets lack diversity, which limits the performance of current methods and their generalization ability. Although…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Zhongwei Qiu , Kai Qiu , Jianlong Fu , Dongmei Fu

We describe a method for 3D human pose estimation from transient images (i.e., a 3D spatio-temporal histogram of photons) acquired by an optical non-line-of-sight (NLOS) imaging system. Our method can perceive 3D human pose by `looking…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Mariko Isogawa , Ye Yuan , Matthew O'Toole , Kris Kitani

This paper addresses the problem of cross-dataset generalization of 3D human pose estimation models. Testing a pre-trained 3D pose estimator on a new dataset results in a major performance drop. Previous methods have mainly addressed this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Mohsen Gholami , Bastian Wandt , Helge Rhodin , Rabab Ward , Z. Jane Wang

In many automation tasks involving manipulation of rigid objects, the poses of the objects must be acquired. Vision-based pose estimation using a single RGB or RGB-D sensor is especially popular due to its broad applicability. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Rasmus Laurvig Haugaard , Thorbjørn Mosekjær Iversen

We propose an end-to-end architecture for joint 2D and 3D human pose estimation in natural images. Key to our approach is the generation and scoring of a number of pose proposals per image, which allows us to predict 2D and 3D poses of…

Computer Vision and Pattern Recognition · Computer Science 2019-01-15 Gregory Rogez , Philippe Weinzaepfel , Cordelia Schmid

We present an approach to estimate 3D poses of multiple people from multiple camera views. In contrast to the previous efforts which require to establish cross-view correspondence based on noisy and incomplete 2D pose estimations, we…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Hanyue Tu , Chunyu Wang , Wenjun Zeng