English
Related papers

Related papers: Gravity-Aware Monocular 3D Human-Object Reconstruc…

200 papers

We present the first marker-less approach for temporally coherent 3D performance capture of a human with general clothing from monocular video. Our approach reconstructs articulated human skeleton motion as well as medium-scale non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Weipeng Xu , Avishek Chatterjee , Michael Zollhöfer , Helge Rhodin , Dushyant Mehta , Hans-Peter Seidel , Christian Theobalt

3D human motion capture from monocular RGB images respecting interactions of a subject with complex and possibly deformable environments is a very challenging, ill-posed and under-explored problem. Existing methods address it only weakly…

Computer Vision and Pattern Recognition · Computer Science 2022-08-18 Zhi Li , Soshi Shimada , Bernt Schiele , Christian Theobalt , Vladislav Golyanik

In this paper, we introduce a method to automatically reconstruct the 3D motion of a person interacting with an object from a single RGB video. Our method estimates the 3D poses of the person and the object, contact positions, and forces…

Computer Vision and Pattern Recognition · Computer Science 2019-06-18 Zongmian Li , Jiri Sedlar , Justin Carpentier , Ivan Laptev , Nicolas Mansard , Josef Sivic

Recovering 3D full-body human pose is a challenging problem with many applications. It has been successfully addressed by motion capture systems with body worn markers and multiple cameras. In this paper, we address the more challenging…

Computer Vision and Pattern Recognition · Computer Science 2018-03-12 Xiaowei Zhou , Menglong Zhu , Georgios Pavlakos , Spyridon Leonardos , Kostantinos G. Derpanis , Kostas Daniilidis

Marker-less 3D human motion capture from a single colour camera has seen significant progress. However, it is a very challenging and severely ill-posed problem. In consequence, even the most accurate state-of-the-art approaches have…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Soshi Shimada , Vladislav Golyanik , Weipeng Xu , Christian Theobalt

Markerless motion capture and understanding of professional non-daily human movements is an important yet unsolved task, which suffers from complex motion patterns and severe self-occlusion, especially for the monocular setting. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Xin Chen , Anqi Pang , Wei Yang , Yuexin Ma , Lan Xu , Jingyi Yu

Current motion capture (MoCap) systems generally require markers and multiple calibrated cameras, which can be used only in constrained environments. In this work we introduce a drone-based system for 3D human MoCap. The system only needs…

Computer Vision and Pattern Recognition · Computer Science 2018-04-18 Xiaowei Zhou , Sikang Liu , Georgios Pavlakos , Vijay Kumar , Kostas Daniilidis

Monocular 3D motion capture (mocap) is beneficial to many applications. The use of a single camera, however, often fails to handle occlusions of different body parts and hence it is limited to capture relatively simple movements. We present…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Han Liang , Yannan He , Chengfeng Zhao , Mutian Li , Jingya Wang , Jingyi Yu , Lan Xu

We present a novel method for recovering world-grounded human motion from monocular video. The main challenge lies in the ambiguity of defining the world coordinate system, which varies between sequences. Previous approaches attempt to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Zehong Shen , Huaijin Pi , Yan Xia , Zhi Cen , Sida Peng , Zechen Hu , Hujun Bao , Ruizhen Hu , Xiaowei Zhou

Human motion recovery for real-world interaction demands both precise action details and metric-scale trajectories. Recovering absolute human pose from monocular input presents a viable solution, but faces two main challenges: (1) models'…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Zhumei Wang , Zechen Hu , Ruoxi Guo , Huaijin Pi , Ziyong Feng , Liang Zhang , Mingtao Pei , Siyuan Huang

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches depend on templates, are effective only in quasi-static scenes, or fail to model 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Qianqian Wang , Vickie Ye , Hang Gao , Weijia Zeng , Jake Austin , Zhengqi Li , Angjoo Kanazawa

Existing methods for 3D tracking from monocular RGB videos predominantly consider articulated and rigid objects. Modelling dense non-rigid object deformations in this setting remained largely unaddressed so far, although such effects can…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Soshi Shimada , Vladislav Golyanik , Patrick Pérez , Christian Theobalt

We propose an approach for reconstructing free-moving object from a monocular RGB video. Most existing methods either assume scene prior, hand pose prior, object category pose prior, or rely on local optimization with multiple sequence…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Haixin Shi , Yinlin Hu , Daniel Koguciuk , Juan-Ting Lin , Mathieu Salzmann , David Ferstl

We present Grasp in Gaussians (GraG), a fast and robust method for reconstructing dynamic 3D hand-object interactions from a single monocular video. Unlike recent approaches that optimize heavy neural representations, our method focuses on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Ayce Idil Aytekin , Xu Chen , Zhengyang Shen , Thabo Beeler , Helge Rhodin , Rishabh Dabral , Christian Theobalt

To address the ill-posed problem caused by partial observations in monocular human volumetric capture, we present AvatarCap, a novel framework that introduces animatable avatars into the capture pipeline for high-fidelity reconstruction in…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Zhe Li , Zerong Zheng , Hongwen Zhang , Chaonan Ji , Yebin Liu

We present a new trainable system for physically plausible markerless 3D human motion capture, which achieves state-of-the-art results in a broad range of challenging scenarios. Unlike most neural methods for human motion capture, our…

Computer Vision and Pattern Recognition · Computer Science 2021-05-04 Soshi Shimada , Vladislav Golyanik , Weipeng Xu , Patrick Pérez , Christian Theobalt

Our work aims to obtain 3D reconstruction of hands and manipulated objects from monocular videos. Reconstructing hand-object manipulations holds a great potential for robotics and learning from human demonstrations. The supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yana Hasson , Gül Varol , Ivan Laptev , Cordelia Schmid

Capturing the interactions between humans and their environment in 3D is important for many applications in robotics, graphics, and vision. Recent works to reconstruct the 3D human and object from a single RGB image do not have consistent…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Xianghui Xie , Bharat Lal Bhatnagar , Gerard Pons-Moll

We present a novel framework to reconstruct complete 3D human shapes from a given target image by leveraging monocular unconstrained images. The objective of this work is to reproduce high-quality details in regions of the reconstructed…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Marco Pesavento , Marco Volino , Adrian Hilton

Capturing challenging human motions is critical for numerous applications, but it suffers from complex motion patterns and severe self-occlusion under the monocular setting. In this paper, we propose ChallenCap -- a template-based approach…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Yannan He , Anqi Pang , Xin Chen , Han Liang , Minye Wu , Yuexin Ma , Lan Xu
‹ Prev 1 2 3 10 Next ›