English
Related papers

Related papers: Expressive Body Capture: 3D Hands, Face, and Body …

200 papers

We present the first method for real-time full body capture that estimates shape and motion of body and hands together with a dynamic 3D face model from a single color image. Our approach uses a new neural network architecture that exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Yuxiao Zhou , Marc Habermann , Ikhsanul Habibie , Ayush Tewari , Christian Theobalt , Feng Xu

We present a new solution to egocentric 3D body pose estimation from monocular images captured from a downward looking fish-eye camera installed on the rim of a head mounted virtual reality device. This unusual viewpoint, just 2 cm. away…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Denis Tome , Patrick Peluse , Lourdes Agapito , Hernan Badino

This paper presents a novel 3D human pose estimation approach using a single stream of asynchronous events as input. Most of the state-of-the-art approaches solve this task with RGB cameras, however struggling when subjects are moving fast.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Gianluca Scarpellini , Pietro Morerio , Alessio Del Bue

We propose a new single-shot method for multi-person 3D pose estimation in general scenes from a monocular RGB camera. Our approach uses novel occlusion-robust pose-maps (ORPM) which enable full body pose inference even under strong partial…

Computer Vision and Pattern Recognition · Computer Science 2018-08-29 Dushyant Mehta , Oleksandr Sotnychenko , Franziska Mueller , Weipeng Xu , Srinath Sridhar , Gerard Pons-Moll , Christian Theobalt

This paper addresses the problem of 3D human body shape and pose estimation from RGB images. Some recent approaches to this task predict probability distributions over human body model parameters conditioned on the input images. This is…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Akash Sengupta , Ignas Budvytis , Roberto Cipolla

We present a novel method for temporal coherent reconstruction and tracking of clothed humans. Given a monocular RGB-D sequence, we learn a person-specific body model which is based on a dynamic surface function network. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Andrei Burov , Matthias Nießner , Justus Thies

Multi-person pose estimation generally follows top-down and bottom-up paradigms. Both of them use an extra stage ($\boldsymbol{e.g.,}$ human detection in top-down paradigm or grouping process in bottom-up paradigm) to build the relationship…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Yabo Xiao , Xiaojuan Wang , Dongdong Yu , Kai Su , Lei Jin , Mei Song , Shuicheng Yan , Jian Zhao

We present Multi-HMR, a strong sigle-shot model for multi-person 3D human mesh recovery from a single RGB image. Predictions encompass the whole body, i.e., including hands and facial expressions, using the SMPL-X parametric model and 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Fabien Baradel , Matthieu Armando , Salma Galaaoui , Romain Brégier , Philippe Weinzaepfel , Grégory Rogez , Thomas Lucas

Current human pose estimation systems focus on retrieving an accurate 3D global estimate of a single person. Therefore, this paper presents one of the first 3D multi-person human pose estimation systems that is able to work in real-time and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Pawel Knap , Peter Hardy , Alberto Tamajo , Hwasup Lim , Hansung Kim

Marker-less monocular 3D human motion capture (MoCap) with scene interactions is a challenging research topic relevant for extended reality, robotics and virtual avatar generation. Due to the inherent depth ambiguity of monocular settings,…

Computer Vision and Pattern Recognition · Computer Science 2022-07-27 Soshi Shimada , Vladislav Golyanik , Zhi Li , Patrick Pérez , Weipeng Xu , Christian Theobalt

Generating high-quality, photorealistic textures for 3D human avatars remains a fundamental yet challenging task in computer vision and multimedia field. However, real paired front and back images of human subjects are rarely available with…

Graphics · Computer Science 2026-04-10 Mingxiao Tu , Shuchang Ye , Hoijoon Jung , Jinman Kim

Monocular facial performance capture in-the-wild is challenging due to varied capture conditions, face shapes, and expressions. Most current methods rely on linear 3D Morphable Models, which represent facial expressions independently of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Arthur Josi , Luiz Gustavo Hafemann , Abdallah Dib , Emeline Got , Rafael M. O. Cruz , Marc-Andre Carbonneau

In this paper we contribute a simple yet effective approach for estimating 3D poses of multiple people from multi-view images. Our proposed coarse-to-fine pipeline first aggregates noisy 2D observations from multiple camera views into 3D…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Zijian Dong , Jie Song , Xu Chen , Chen Guo , Otmar Hilliges

Estimating 3D humans from images often produces implausible bodies that lean, float, or penetrate the floor. Such methods ignore the fact that bodies are typically supported by the scene. A physics engine can be used to enforce physical…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Shashank Tripathi , Lea Müller , Chun-Hao P. Huang , Omid Taheri , Michael J. Black , Dimitrios Tzionas

Estimating human and camera trajectories with accurate scale in the world coordinate system from a monocular video is a highly desirable yet challenging and ill-posed problem. In this study, we aim to recover expressive parametric human…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Wanqi Yin , Zhongang Cai , Ruisi Wang , Fanzhou Wang , Chen Wei , Haiyi Mei , Weiye Xiao , Zhitao Yang , Qingping Sun , Atsushi Yamashita , Ziwei Liu , Lei Yang

Reconstructing posed 3D human models from monocular images has important applications in the sports industry, including performance tracking, injury prevention and virtual training. In this work, we combine 3D human pose and shape…

Computer Vision and Pattern Recognition · Computer Science 2025-04-17 Lorenza Prospero , Abdullah Hamdi , Joao F. Henriques , Christian Rupprecht

Existing marker-less motion capture methods often assume known backgrounds, static cameras, and sequence specific motion priors, which narrows its application scenarios. Here we propose a fully automatic method that given multi-view video,…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Yinghao Huang , Federica Bogo , Christoph Lassner , Angjoo Kanazawa , Peter V. Gehler , Ijaz Akhter , Michael J. Black

3D pose estimation is an invaluable task in computer vision with various practical applications. Especially, 3D pose estimation for multi-person from a monocular video (3DMPPE) is particularly challenging and is still largely uncharted, far…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Sungchan Park , Eunyi You , Inhoe Lee , Joonseok Lee

We propose a CNN-based approach for 3D human body pose estimation from single RGB images that addresses the issue of limited generalizability of models trained solely on the starkly limited publicly available 3D pose data. Using only the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-05 Dushyant Mehta , Helge Rhodin , Dan Casas , Pascal Fua , Oleksandr Sotnychenko , Weipeng Xu , Christian Theobalt

Nuanced expressiveness, particularly through fine-grained hand and facial expressions, is pivotal for enhancing the realism and vitality of digital human representations. In this work, we focus on investigating the expressiveness of human…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Hezhen Hu , Zhiwen Fan , Tianhao Wu , Yihan Xi , Seoyoung Lee , Georgios Pavlakos , Zhangyang Wang