English
Related papers

Related papers: Markerless Body Motion Capturing for 3D Character …

200 papers

We introduce SkelFormer, a novel markerless motion capture pipeline for multi-view human pose and shape estimation. Our method first uses off-the-shelf 2D keypoint estimators, pre-trained on large-scale in-the-wild data, to obtain 3D joint…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Vandad Davoodnia , Saeed Ghorbani , Alexandre Messier , Ali Etemad

Accurate 3D kinematics estimation of human body is crucial in various applications for human health and mobility, such as rehabilitation, injury prevention, and diagnosis, as it helps to understand the biomechanical loading experienced…

Computer Vision and Pattern Recognition · Computer Science 2024-03-06 Zhi-Yi Lin , Bofan Lyu , Judith Cueto Fernandez , Eline van der Kruk , Ajay Seth , Xucong Zhang

We present a method and application for animating a human subject from a single photo. E.g., the character can walk out, run, sit, or jump in 3D. The key contributions of this paper are: 1) an application of viewing and animating humans in…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 Chung-Yi Weng , Brian Curless , Ira Kemelmacher-Shlizerman

Human pose estimation is a very active research field, stimulated by its important applications in robotics, entertainment or health and sports sciences, among others. Advances in convolutional networks triggered noticeable improvements in…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Yann Desmarais , Denis Mottet , Pierre Slangen , Philippe Montesinos

In multi-view human body capture systems, the recovered 3D geometry or even the acquired imagery data can be heavily corrupted due to occlusions, noise, limited field of- view, etc. Direct estimation of 3D pose, body shape or motion on…

Computer Vision and Pattern Recognition · Computer Science 2018-02-02 Zhong Li , Yu Ji , Wei Yang , Jinwei Ye , Jingyi Yu

3D multi-person motion prediction is a challenging task that involves modeling individual behaviors and interactions between people. Despite the emergence of approaches for this task, comparing them is difficult due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Xiaogang Peng , Xiao Zhou , Yikai Luo , Hao Wen , Yu Ding , Zizhao Wu

Reconstructing animatable 3D humans from casually captured images of articulated subjects without camera or pose information is highly practical but remains challenging due to view misalignment, occlusions, and the absence of structural…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Lingteng Qiu , Peihao Li , Heyuan Li , Qi Zuo , Xiaodong Gu , Yuan Dong , Weihao Yuan , Rui Peng , Siyu Zhu , Xiaoguang Han , Guanying Chen , Zilong Dong

Inspired by the success of volumetric 3D pose estimation, some recent human mesh estimators propose to estimate 3D skeletons as intermediate representations, from which, the dense 3D meshes are regressed by exploiting the mesh topology.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Xiaoxuan Ma , Jiajun Su , Chunyu Wang , Wentao Zhu , Yizhou Wang

We propose the first approach to automatically and jointly synthesize both the synchronous 3D conversational body and hand gestures, as well as 3D face and head animations, of a virtual character from speech input. Our algorithm uses a CNN…

Computer Vision and Pattern Recognition · Computer Science 2021-02-16 Ikhsanul Habibie , Weipeng Xu , Dushyant Mehta , Lingjie Liu , Hans-Peter Seidel , Gerard Pons-Moll , Mohamed Elgharib , Christian Theobalt

We tackle the problem of highly-accurate, holistic performance capture for the face, body and hands simultaneously. Motion-capture technologies used in film and game production typically focus only on face, body or hand capture…

This paper discusses video motion capture, namely, 3D reconstruction of human motion from multi-camera images. After the Part Confidence Maps are computed from each camera image, the proposed spatiotemporal filter is applied to deliver the…

Robotics · Computer Science 2019-12-11 Takuya Ohashi , Yosuke Ikegami , Kazuki Yamamoto , Wataru Takano , Yoshihiko Nakamura

This paper describes how to obtain accurate 3D body models and texture of arbitrary people from a single, monocular video in which a person is moving. Based on a parametric body model, we present a robust processing pipeline achieving 3D…

Computer Vision and Pattern Recognition · Computer Science 2018-04-17 Thiemo Alldieck , Marcus Magnor , Weipeng Xu , Christian Theobalt , Gerard Pons-Moll

Motions of virtual characters in movies or video games are typically generated by recording actors using motion capturing methods. Animations generated this way often need postprocessing, such as improving the periodicity of cyclic…

Computer Vision and Pattern Recognition · Computer Science 2015-02-27 Martin Bauer , Markus Eslitzbichler , Markus Grasmair

This thesis is devoted to marker-less 3D human motion tracking in calibrated and synchronized multicamera systems. Pose estimation is based on a 3D model, which is transformed into the image plane and then rendered. Owing to elaborated…

Computer Vision and Pattern Recognition · Computer Science 2017-07-07 Bogusław Rymut

Capturing the dynamically deforming 3D shape of clothed human is essential for numerous applications, including VR/AR, autonomous driving, and human-computer interaction. Existing methods either require a highly specialized capturing setup,…

Computer Vision and Pattern Recognition · Computer Science 2021-12-01 Chen Guo , Xu Chen , Jie Song , Otmar Hilliges

Human action recognition has been one of the most active fields of research in computer vision for last years. Two dimensional action recognition methods are facing serious challenges such as occlusion and missing the third dimension of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-26 Mozhgan Mokari , Hoda Mohammadzade , Benyamin Ghojogh

This work make the first attempt to generate articulated human motion sequence from a single image. On the one hand, we utilize paired inputs including human skeleton information as motion embedding and a single human image as appearance…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Yichao Yan , Jingwei Xu , Bingbing Ni , Xiaokang Yang

Action recognition from well-segmented 3D skeleton video has been intensively studied. However, due to the difficulty in representing the 3D skeleton video and the lack of training data, action detection from streaming 3D skeleton video…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Bo Li , Huahui Chen , Yucheng Chen , Yuchao Dai , Mingyi He

We propose a method for generating video-realistic animations of real humans under user control. In contrast to conventional human character rendering, we do not require the availability of a production-quality photo-realistic 3D model of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-13 Lingjie Liu , Weipeng Xu , Michael Zollhoefer , Hyeongwoo Kim , Florian Bernard , Marc Habermann , Wenping Wang , Christian Theobalt

This paper presents a novel method for generating diverse 3D human poses in scenes with semantic control. Existing methods heavily rely on the human-scene interaction dataset, resulting in a limited diversity of the generated human poses.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Bowen Dang , Xi Zhao