English
Related papers

Related papers: Learning Complex 3D Human Self-Contact

200 papers

Monocular depth reconstruction of complex and dynamic scenes is a highly challenging problem. While for rigid scenes learning-based methods have been offering promising results even in unsupervised cases, there exists little to no…

Computer Vision and Pattern Recognition · Computer Science 2021-10-29 Ayça Takmaz , Danda Pani Paudel , Thomas Probst , Ajad Chhatkuli , Martin R. Oswald , Luc Van Gool

This paper proposes GraviCap, i.e., a new approach for joint markerless 3D human motion capture and object trajectory estimation from monocular RGB videos. We focus on scenes with objects partially observed during a free flight. In contrast…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Rishabh Dabral , Soshi Shimada , Arjun Jain , Christian Theobalt , Vladislav Golyanik

Our work aims to obtain 3D reconstruction of hands and manipulated objects from monocular videos. Reconstructing hand-object manipulations holds a great potential for robotics and learning from human demonstrations. The supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Yana Hasson , Gül Varol , Ivan Laptev , Cordelia Schmid

Recovering textured 3D models of non-rigid human body shapes is challenging due to self-occlusions caused by complex body poses and shapes, clothing obstructions, lack of surface texture, background clutter, sparse set of cameras with…

Computer Vision and Pattern Recognition · Computer Science 2018-09-19 Abbhinav Venkat , Sai Sagar Jinka , Avinash Sharma

Monocular 3D face reconstruction is a wide-spread topic, and existing approaches tackle the problem either through fast neural network inference or offline iterative reconstruction of face geometry. In either case carefully-designed energy…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Christopher Otto , Prashanth Chandran , Gaspard Zoss , Markus Gross , Paulo Gotardo , Derek Bradley

We present a self-supervised learning algorithm for 3D human pose estimation of a single person based on a multiple-view camera system and 2D body pose estimates for each view. To train our model, represented by a deep neural network, we…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Arij Bouazizi , Julian Wiederer , Ulrich Kressel , Vasileios Belagiannis

High fidelity digital 3D environments have been proposed in recent years, however, it remains extremely challenging to automatically equip such environment with realistic human bodies. Existing work utilizes images, depth or semantic maps…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Siwei Zhang , Yan Zhang , Qianli Ma , Michael J. Black , Siyu Tang

Reconstructing textured 3D human models from a single image is fundamental for AR/VR and digital human applications. However, existing methods mostly focus on single individuals and thus fail in multi-human scenes, where naive composition…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Gwanghyun Kim , Junghun James Kim , Suh Yoon Jeon , Jason Park , Se Young Chun

We present To The Point (TTP), a method for reconstructing 3D objects from a single image using 2D to 3D correspondences learned from weak supervision. We recover a 3D shape from a 2D image by first regressing the 2D positions corresponding…

Computer Vision and Pattern Recognition · Computer Science 2021-06-11 Filippos Kokkinos , Iasonas Kokkinos

Reconstructing accurate 3D scenes from images is a long-standing vision task. Due to the ill-posedness of the single-image reconstruction problem, most well-established methods are built upon multi-view geometry. State-of-the-art (SOTA)…

Computer Vision and Pattern Recognition · Computer Science 2023-07-21 Wei Yin , Chi Zhang , Hao Chen , Zhipeng Cai , Gang Yu , Kaixuan Wang , Xiaozhi Chen , Chunhua Shen

Monocular dynamic reconstruction is a challenging and long-standing vision problem due to the highly ill-posed nature of the task. Existing approaches depend on templates, are effective only in quasi-static scenes, or fail to model 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Qianqian Wang , Vickie Ye , Hang Gao , Weijia Zeng , Jake Austin , Zhengqi Li , Angjoo Kanazawa

Monocular 3D object detection task aims to predict the 3D bounding boxes of objects based on monocular RGB images. Since the location recovery in 3D space is quite difficult on account of absence of depth information, this paper proposes a…

Computer Vision and Pattern Recognition · Computer Science 2021-06-10 Yingjie Cai , Buyu Li , Zeyu Jiao , Hongsheng Li , Xingyu Zeng , Xiaogang Wang

The task of 3D semantic scene completion using monocular cameras is gaining significant attention in the field of autonomous driving. This task aims to predict the occupancy status and semantic labels of each voxel in a 3D scene from…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jiawei Yao , Jusheng Zhang , Xiaochao Pan , Tong Wu , Canran Xiao

Object localization in 3D space is a challenging aspect in monocular 3D object detection. Recent advances in 6DoF pose estimation have shown that predicting dense 2D-3D correspondence maps between image and object 3D model and then…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Hansheng Chen , Yuyao Huang , Wei Tian , Zhong Gao , Lu Xiong

Across a plethora of social situations, we touch others in natural and intuitive ways to share thoughts and emotions, such as tapping to get one's attention or caressing to soothe one's anxiety. A deeper understanding of these…

Human-Computer Interaction · Computer Science 2022-10-11 Shan Xu , Chang Xu , Sarah McIntyre , Håkan Olausson , Gregory J. Gerling

Egocentric 3D human pose estimation with a single head-mounted fisheye camera has recently attracted attention due to its numerous applications in virtual and augmented reality. Existing methods still struggle in challenging poses where the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Jian Wang , Lingjie Liu , Weipeng Xu , Kripasindhu Sarkar , Diogo Luvizon , Christian Theobalt

The accuracy of monocular 3D human pose estimation depends on the viewpoint from which the image is captured. While freely moving cameras, such as on drones, provide control over this viewpoint, automatically positioning them at the…

Computer Vision and Pattern Recognition · Computer Science 2020-06-19 Sena Kiciroglu , Helge Rhodin , Sudipta N. Sinha , Mathieu Salzmann , Pascal Fua

In the realm of computer vision, the perception and reconstruction of the 3D world through vision signals heavily rely on camera intrinsic parameters, which have long been a subject of intense research within the community. In practical…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Xinyue Zhang , Jiaqi Yang , Xiangting Meng , Abdelrahman Mohamed , Laurent Kneip

The reconstruction of dense 3D models of face geometry and appearance from a single image is highly challenging and ill-posed. To constrain the problem, many approaches rely on strong priors, such as parametric face models learned from…

Computer Vision and Pattern Recognition · Computer Science 2018-04-02 Ayush Tewari , Michael Zollhöfer , Pablo Garrido , Florian Bernard , Hyeongwoo Kim , Patrick Pérez , Christian Theobalt

Monocular 3D object detection aims to localize 3D bounding boxes in an input single 2D image. It is a highly challenging problem and remains open, especially when no extra information (e.g., depth, lidar and/or multi-frames) can be…

Computer Vision and Pattern Recognition · Computer Science 2021-12-10 Xianpeng Liu , Nan Xue , Tianfu Wu