English
Related papers

Related papers: Neural Descent for Visual 3D Human Pose and Shape

200 papers

Recent progress in human shape learning, shows that neural implicit models are effective in generating 3D human surfaces from limited number of views, and even from a single RGB image. However, existing monocular approaches still struggle…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Marco Pesavento , Yuanlu Xu , Nikolaos Sarafianos , Robert Maier , Ziyan Wang , Chun-Han Yao , Marco Volino , Edmond Boyer , Adrian Hilton , Tony Tung

Most of the recent deep learning-based 3D human pose and mesh estimation methods regress the pose and shape parameters of human mesh models, such as SMPL and MANO, from an input image. The first weakness of these methods is an appearance…

Computer Vision and Pattern Recognition · Computer Science 2021-04-28 Hongsuk Choi , Gyeongsik Moon , Kyoung Mu Lee

Constructing and animating humans is an important component for building virtual worlds in a wide variety of applications such as virtual reality or robotics testing in simulation. As there are exponentially many variations of humans with…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Ze Yang , Shenlong Wang , Sivabalan Manivasagam , Zeng Huang , Wei-Chiu Ma , Xinchen Yan , Ersin Yumer , Raquel Urtasun

Neural shape models can represent complex 3D shapes with a compact latent space. When applied to dynamically deforming shapes such as the human hands, however, they would need to preserve temporal coherence of the deformation as well as the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Binbin Xu , Lingni Ma , Yuting Ye , Tanner Schmidt , Christopher D. Twigg , Steven Lovegrove

We describe Human Mesh Recovery (HMR), an end-to-end framework for reconstructing a full 3D mesh of a human body from a single RGB image. In contrast to most current methods that compute 2D or 3D joint locations, we produce a richer and…

Computer Vision and Pattern Recognition · Computer Science 2018-06-26 Angjoo Kanazawa , Michael J. Black , David W. Jacobs , Jitendra Malik

We present an approach to reconstruct humans and track them over time. At the core of our approach, we propose a fully "transformerized" version of a network for human mesh recovery. This network, HMR 2.0, advances the state of the art and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Shubham Goel , Georgios Pavlakos , Jathushan Rajasegaran , Angjoo Kanazawa , Jitendra Malik

In this paper, we present a learning-based approach for recovering the 3D geometry of human head from a single portrait image. Our method is learned in an unsupervised manner without any ground-truth 3D data. We represent the head geometry…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Sicheng Xu , Jiaolong Yang , Dong Chen , Fang Wen , Yu Deng , Yunde Jia , Xin Tong

This paper focuses on structured-output learning using deep neural networks for 3D human pose estimation from monocular images. Our network takes an image and 3D pose as inputs and outputs a score value, which is high when the image-pose…

Computer Vision and Pattern Recognition · Computer Science 2015-08-28 Sijin Li , Weichen Zhang , Antoni B. Chan

3D human pose estimation and mesh recovery have attracted widespread research interest in many areas, such as computer vision, autonomous driving, and robotics. Deep learning on 3D human pose estimation and mesh recovery has recently…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Yang Liu , Changzhen Qiu , Zhiyong Zhang

Recent techniques on implicit geometry representation learning and neural rendering have shown promising results for 3D clothed human reconstruction from sparse video inputs. However, it is still challenging to reconstruct detailed surface…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Hao Wang , Qingshan Xu , Hongyuan Chen , Rui Ma

Recovering the 3D geometric structure of a face from a single input image is a challenging active research area in computer vision. In this paper, we present a novel method for reconstructing 3D heads from a single or multiple image(s)…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Oussema Bouafif , Bogdan Khomutenko , Mohamed Daoudi

This paper introduces a new architecture for human pose estimation using a multi- layer convolutional network architecture and a modified learning technique that learns low-level features and higher-level weak spatial models. Unconstrained…

Computer Vision and Pattern Recognition · Computer Science 2014-04-24 Arjun Jain , Jonathan Tompson , Mykhaylo Andriluka , Graham W. Taylor , Christoph Bregler

We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose and shape. Though substantial progress has been made in estimating 3D human motion and shape from dynamic observations, recovering plausible pose sequences…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Davis Rempe , Tolga Birdal , Aaron Hertzmann , Jimei Yang , Srinath Sridhar , Leonidas J. Guibas

Humans can infer the three-dimensional structure of objects from two-dimensional visual inputs. Modeling this ability has been a longstanding goal for the science and engineering of visual intelligence, yet decades of computational methods…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Tyler Bonnen , Jitendra Malik , Angjoo Kanazawa

This paper explores the capabilities of convolutional neural networks to deal with a task that is easily manageable for humans: perceiving 3D pose of a human body from varying angles. However, in our approach, we are restricted to using a…

Computer Vision and Pattern Recognition · Computer Science 2017-07-21 Agne Grinciunaite , Amogh Gudi , Emrah Tasli , Marten den Uyl

As 3D human pose estimation can now be achieved with very high accuracy in the supervised learning scenario, tackling the case where 3D pose annotations are not available has received increasing attention. In particular, several methods…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Krishna Kanth Nakka , Mathieu Salzmann

We introduce an approach that accurately reconstructs 3D human poses and detailed 3D full-body geometric models from single images in realtime. The key idea of our approach is a novel end-to-end multi-task deep learning framework that uses…

Computer Vision and Pattern Recognition · Computer Science 2021-06-23 Liguo Jiang , Miaopeng Li , Jianjie Zhang , Congyi Wang , Juntao Ye , Xinguo Liu , Jinxiang Chai

Human motion prediction and understanding is a challenging problem. Due to the complex dynamic of human motion and the non-deterministic aspect of future prediction. We propose a novel sequence-to-sequence model for human motion prediction…

Computer Vision and Pattern Recognition · Computer Science 2021-01-01 Emad Barsoum , John Kender , Zicheng Liu

Recovering the 3D geometry of a scene from a sparse set of uncalibrated images is a long-standing problem in computer vision. While recent learning-based approaches such as DUSt3R and MASt3R have demonstrated impressive results by directly…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Sara Rojas , Matthieu Armando , Bernard Ghamen , Philippe Weinzaepfel , Vincent Leroy , Gregory Rogez

Recently, deep learning approach has achieved promising results in various fields of computer vision. In this paper, a new framework called Hierarchical Depth Motion Maps (HDMM) + 3 Channel Deep Convolutional Neural Networks (3ConvNets) is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-21 Pichao Wang , Wanqing Li , Zhimin Gao , Jing Zhang , Chang Tang , Philip Ogunbona