English
Related papers

Related papers: Look Ma, no markers: holistic performance capture …

200 papers

Multi-view human mesh recovery (HMR) is broadly deployed in diverse domains where high accuracy and strong generalization are essential. Existing approaches can be broadly grouped into geometry-based and learning-based methods. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Haoyu Xie , Shengkai Xu , Cheng Guo , Muhammad Usama Saleem , Wenhan Wu , Chen Chen , Ahmed Helmy , Pu Wang , Hongfei Xue

Markerless motion capture is an active research in 3D virtualization. In proposed work we presented a system for markerless motion capture for 3D human character animation, paper presents a survey on motion and skeleton tracking techniques…

Graphics · Computer Science 2014-02-12 Ashish Shingade , Archana Ghotkar

Optical motion capture systems have become a widely used technology in various fields, such as augmented reality, robotics, movie production, etc. Such systems use a large number of cameras to triangulate the position of optical markers.The…

Machine Learning · Computer Science 2018-09-26 Taras Kucherenko , Jonas Beskow , Hedvig Kjellström

We propose a generative approach to physics-based motion capture. Unlike prior attempts to incorporate physics into tracking that assume the subject and scene geometry are calibrated and known a priori, our approach is automatic and online.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-05 Micha Livne , Leonid Sigal , Marcus A. Brubaker , David J. Fleet

Tracking 3D human motion in real-time is crucial for numerous applications across many fields. Traditional approaches involve attaching artificial fiducial objects or sensors to the body, limiting their usability and comfort-of-use and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Luca Fortini , Mattia Leonori , Juan M. Gandarias , Elena de Momi , Arash Ajoudani

We present the first real-time human performance capture approach that reconstructs dense, space-time coherent deforming geometry of entire humans in general everyday clothing from just a single RGB video. We propose a novel two-stage…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Marc Habermann , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt

Monocular 3D human performance capture is indispensable for many applications in computer graphics and vision for enabling immersive experiences. However, detailed capture of humans requires tracking of multiple aspects, including the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Yue Jiang , Marc Habermann , Vladislav Golyanik , Christian Theobalt

Marker-based and marker-less optical skeletal motion-capture methods use an outside-in arrangement of cameras placed around a scene, with viewpoints converging on the center. They often create discomfort by possibly needed marker suits, and…

Computer Vision and Pattern Recognition · Computer Science 2016-09-26 Helge Rhodin , Christian Richardt , Dan Casas , Eldar Insafutdinov , Mohammad Shafiei , Hans-Peter Seidel , Bernt Schiele , Christian Theobalt

Although many studies have investigated markerless motion capture, the technology has not been applied to real sports or concerts. In this paper, we propose a markerless motion capture method with spatiotemporal accuracy and smoothness from…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Takuya Ohashi , Yosuke Ikegami , Yoshihiko Nakamura

We present a method to combine markerless motion capture and dense pose feature estimation into a single framework. We demonstrate that dense pose information can help for multiview/single-view motion capture, and multiview motion capture…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Xiu Li , Yebin Liu , Hanbyul Joo , Qionghai Dai , Yaser Sheikh

The aim of our study is to detect balance disorders and a tendency towards the falls in the elderly, knowing gait parameters. In this paper we present a new tool for gait analysis based on markerless human motion capture, from camera feeds.…

Artificial Intelligence · Computer Science 2007-05-23 Jamal Saboune , François Charpillet

Marker-based motion capture (MoCap) systems have long been the gold standard for accurate 4D human modeling, yet their reliance on specialized hardware and markers limits scalability and real-world deployment. Advancing reliable markerless…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Yeeun Park , Miqdad Naduthodi , Suryansh Kumar

Synthesizing 3D human avatars interacting realistically with a scene is an important problem with applications in AR/VR, video games and robotics. Towards this goal, we address the task of generating a virtual human -- hands and full body…

Robotics · Computer Science 2023-03-30 Purva Tendulkar , Dídac Surís , Carl Vondrick

We present the first approach to volumetric performance capture and novel-view rendering at real-time speed from monocular video, eliminating the need for expensive multi-view systems or cumbersome pre-acquisition of a personalized template…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Ruilong Li , Yuliang Xiu , Shunsuke Saito , Zeng Huang , Kyle Olszewski , Hao Li

We present a new online approach to track human whole-body motion from motion capture data, i.e., positions of labeled markers attached to the human body. Tracking in noisy data can be effectively performed with the aid of well-established…

Systems and Control · Computer Science 2015-11-16 Jannik Steinbring , Christian Mandery , Nikolaus Vahrenkamp , Tamim Asfour , Uwe D. Hanebeck

We present the first single-network approach for 2D~whole-body pose estimation, which entails simultaneous localization of body, face, hands, and feet keypoints. Due to the bottom-up formulation, our method maintains constant real-time…

Computer Vision and Pattern Recognition · Computer Science 2019-10-01 Gines Hidalgo , Yaadhav Raaj , Haroon Idrees , Donglai Xiang , Hanbyul Joo , Tomas Simon , Yaser Sheikh

Markerless motion capture using computer vision and human pose estimation (HPE) has the potential to expand access to precise movement analysis. This could greatly benefit rehabilitation by enabling more accurate tracking of outcomes and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 R. James Cotton , Allison DeLillo , Anthony Cimorelli , Kunal Shah , J. D. Peiffer , Shawana Anarwala , Kayan Abdou , Tasos Karakostas

We introduce MulayCap, a novel human performance capture method using a monocular video camera without the need for pre-scanning. The method uses "multi-layer" representations for geometry reconstruction and texture rendering, respectively.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Zhaoqi Su , Weilin Wan , Tao Yu , Lingjie Liu , Lu Fang , Wenping Wang , Yebin Liu

We present a unified deformation model for the markerless capture of multiple scales of human movement, including facial expressions, body motion, and hand gestures. An initial model is generated by locally stitching together models of the…

Computer Vision and Pattern Recognition · Computer Science 2018-01-08 Hanbyul Joo , Tomas Simon , Yaser Sheikh

Human performance capture is a highly important computer vision problem with many applications in movie production and virtual/augmented reality. Many previous performance capture approaches either required expensive multi-view setups or…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Marc Habermann , Weipeng Xu , Michael Zollhoefer , Gerard Pons-Moll , Christian Theobalt