English
Related papers

Related papers: General Automatic Human Shape and Motion Capture U…

200 papers

Markerless motion capture has become an active field of research in computer vision in recent years. Its extensive applications are known in a great variety of fields, including computer animation, human motion analysis, biomedical…

Computer Vision and Pattern Recognition · Computer Science 2022-01-10 Doan Duy Vo , Russell Butler

The appearance of a human in clothing is driven not only by the pose but also by its temporal context, i.e., motion. However, such context has been largely neglected by existing monocular human modeling methods whose neural networks often…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Hansol Lee , Junuk Cha , Yunhoe Ku , Jae Shin Yoon , Seungryul Baek

Marker-less 3D human motion capture from a single colour camera has seen significant progress. However, it is a very challenging and severely ill-posed problem. In consequence, even the most accurate state-of-the-art approaches have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Soshi Shimada , Vladislav Golyanik , Weipeng Xu , Christian Theobalt

In this paper we present a novel approach for bottom-up multi-person 3D human pose estimation from monocular RGB images. We propose to use high resolution volumetric heatmaps to model joint locations, devising a simple and effective…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Matteo Fabbri , Fabio Lanzi , Simone Calderara , Stefano Alletto , Rita Cucchiara

We propose an unsupervised vision-based system to estimate the joint configurations of the robot arm from a sequence of RGB or RGB-D images without knowing the model a priori, and then adapt it to the task of category-independent…

Computer Vision and Pattern Recognition · Computer Science 2020-12-02 Qihao Liu , Weichao Qiu , Weiyao Wang , Gregory D. Hager , Alan L. Yuille

We present a novel paradigm of building an animatable 3D human representation from a monocular video input, such that it can be rendered in any unseen poses and views. Our method is based on a dynamic Neural Radiance Field (NeRF) rigged by…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Gusi Te , Xiu Li , Xiao Li , Jinglu Wang , Wei Hu , Yan Lu

Human pose estimation is a very active research field, stimulated by its important applications in robotics, entertainment or health and sports sciences, among others. Advances in convolutional networks triggered noticeable improvements in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yann Desmarais , Denis Mottet , Pierre Slangen , Philippe Montesinos

We introduce a novel task of reconstructing a time series of second-person 3D human body meshes from monocular egocentric videos. The unique viewpoint and rapid embodied camera motion of egocentric videos raise additional technical barriers…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Miao Liu , Dexin Yang , Yan Zhang , Zhaopeng Cui , James M. Rehg , Siyu Tang

We present a novel approach for the reconstruction of dynamic geometric shapes using a single hand-held consumer-grade RGB-D sensor at real-time rates. Our method does not require a pre-defined shape template to start with and builds up the…

Computer Vision and Pattern Recognition · Computer Science 2016-08-02 Matthias Innmann , Michael Zollhöfer , Matthias Nießner , Christian Theobalt , Marc Stamminger

Physically-based simulation is a powerful approach for 3D facial animation as the resulting deformations are governed by physical constraints, allowing to easily resolve self-collisions, respond to external forces and perform realistic…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Lingchen Yang , Gaspard Zoss , Prashanth Chandran , Markus Gross , Barbara Solenthaler , Eftychios Sifakis , Derek Bradley

Advancements in neural implicit representations and differentiable rendering have markedly improved the ability to learn animatable 3D avatars from sparse multi-view RGB videos. However, current methods that map observation space to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Zichen Tang , Hongyu Yang , Hanchen Zhang , Jiaxin Chen , Di Huang

In this paper, we present a solution for arbitrary 3D character deformation by investigating rotation angle of decomposition and preserving the mesh topology structure. In computer graphics, skeleton extraction and skeleton-driven animation…

Computer Vision and Pattern Recognition · Computer Science 2016-08-18 Hugo Martin , Raphael Fernandez , Yong Khoo

In this work, we enhance a professional end-to-end volumetric video production pipeline to achieve high-fidelity human body reconstruction using only passive cameras. While current volumetric video approaches estimate depth maps using…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Decai Chen , Markus Worchel , Ingo Feldmann , Oliver Schreer , Peter Eisert

Unsupervised generation of clothed virtual humans with various appearance and animatable poses is important for creating 3D human avatars and other AR/VR applications. Existing methods are either limited to rigid object modeling, or not…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Jianfeng Zhang , Zihang Jiang , Dingdong Yang , Hongyi Xu , Yichun Shi , Guoxian Song , Zhongcong Xu , Xinchao Wang , Jiashi Feng

We present a novel method for recovering the absolute pose and shape of a human in a pre-scanned scene given a single image. Unlike previous methods that perform sceneaware mesh optimization, we propose to first estimate absolute position…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Zehong Shen , Zhi Cen , Sida Peng , Qing Shuai , Hujun Bao , Xiaowei Zhou

Human motion synthesis is an important problem with applications in graphics, gaming and simulation environments for robotics. Existing methods require accurate motion capture data for training, which is costly to obtain. Instead, we…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Kevin Xie , Tingwu Wang , Umar Iqbal , Yunrong Guo , Sanja Fidler , Florian Shkurti

We present the first method for real-time full body capture that estimates shape and motion of body and hands together with a dynamic 3D face model from a single color image. Our approach uses a new neural network architecture that exploits…

Computer Vision and Pattern Recognition · Computer Science 2021-04-16 Yuxiao Zhou , Marc Habermann , Ikhsanul Habibie , Ayush Tewari , Christian Theobalt , Feng Xu

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

This paper presents an automated method for 3D character skeleton extraction that can be applied for generic 3D shapes. Our work is motivated by the skeleton-based prior work on automatic rigging focused on skeleton extraction and can…

Graphics · Computer Science 2017-05-17 Yong Khoo , Sang Chung

We propose a novel sparse constrained formulation and from it derive a real-time optimization method for 3D human pose and shape estimation. Our optimization method, SCOPE (Sparse Constrained Optimization for 3D human Pose and shapE…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Taosha Fan , Kalyan Vasudev Alwala , Donglai Xiang , Weipeng Xu , Todd Murphey , Mustafa Mukadam