English
Related papers

Related papers: MonoNHR: Monocular Neural Human Renderer

200 papers

Human re-rendering from a single image is a starkly under-constrained problem, and state-of-the-art algorithms often exhibit undesired artefacts, such as over-smoothing, unrealistic distortions of the body parts and garments, or implausible…

Computer Vision and Pattern Recognition · Computer Science 2021-01-12 Kripasindhu Sarkar , Dushyant Mehta , Weipeng Xu , Vladislav Golyanik , Christian Theobalt

Convenient 4D modeling of human-object interactions is essential for numerous applications. However, monocular tracking and rendering of complex interaction scenarios remain challenging. In this paper, we propose Instant-NVR, a neural…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Yuheng Jiang , Kaixin Yao , Zhuo Su , Zhehao Shen , Haimin Luo , Lan Xu

We present the first marker-less approach for temporally coherent 3D performance capture of a human with general clothing from monocular video. Our approach reconstructs articulated human skeleton motion as well as medium-scale non-rigid…

Computer Vision and Pattern Recognition · Computer Science 2018-02-26 Weipeng Xu , Avishek Chatterjee , Michael Zollhöfer , Helge Rhodin , Dushyant Mehta , Hans-Peter Seidel , Christian Theobalt

We present an approach that learns to synthesize high-quality, novel views of 3D objects or scenes, while providing fine-grained and precise control over the 6-DOF viewpoint. The approach is self-supervised and only requires 2D images and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Xu Chen , Jie Song , Otmar Hilliges

In the field of monocular 3D detection, it is common practice to utilize scene geometric clues to enhance the detector's performance. However, many existing works adopt these clues explicitly such as estimating a depth map and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Junkai Xu , Liang Peng , Haoran Cheng , Hao Li , Wei Qian , Ke Li , Wenxiao Wang , Deng Cai

High-fidelity 3D scene reconstruction from monocular videos continues to be challenging, especially for complete and fine-grained geometry reconstruction. The previous 3D reconstruction approaches with neural implicit representations have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Zi-Xin Zou , Shi-Sheng Huang , Yan-Pei Cao , Tai-Jiang Mu , Ying Shan , Hongbo Fu

The neural rendering of humans is a topic of great research significance. However, previous works mostly focus on achieving photorealistic details, neglecting the exploration of human parsing. Additionally, classical semantic work are all…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jie Zhang , Pengcheng Shi , Zaiwang Gu , Yiyang Zhou , Zhi Wang

Rendering 3D human appearance from a single image in real-time is crucial for achieving holographic communication and immersive VR/AR. Existing methods either rely on multi-camera setups or are constrained to offline operations. In this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Yuanwang Yang , Qiao Feng , Yu-Kun Lai , Kun Li

Recent neural rendering approaches for human activities achieve remarkable view synthesis results, but still rely on dense input views or dense training with all the capture frames, leading to deployment difficulty and inefficient training…

Computer Vision and Pattern Recognition · Computer Science 2021-10-04 Anqi Pang , Xin Chen , Haimin Luo , Minye Wu , Jingyi Yu , Lan Xu

Undoubtedly, high-fidelity 3D hair is crucial for achieving realism, artistic expression, and immersion in computer graphics. While existing 3D hair modeling methods have achieved impressive performance, the challenge of achieving…

Computer Vision and Pattern Recognition · Computer Science 2024-03-28 Keyu Wu , Lingchen Yang , Zhiyi Kuang , Yao Feng , Xutao Han , Yuefan Shen , Hongbo Fu , Kun Zhou , Youyi Zheng

Monocular 3D clothed human reconstruction aims to generate a complete and realistic textured 3D avatar from a single image. Existing methods are commonly trained under multi-view supervision with annotated geometric priors, and during…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Nanjie Yao , Gangjian Zhang , Wenhao Shen , Jian Shu , Yu Feng , Hao Wang

Monocular 3D human reconstruction in real-world scenarios remains highly challenging due to frequent occlusions from surrounding objects, people, or image truncation. Such occlusions lead to missing geometry and unreliable appearance cues,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yuanwang Yang , Hongliang Liu , Muxin Zhang , Nan Ma , Jingyu Yang , Yu-Kun Lai , Kun Li

Vision-based monocular human pose estimation, as one of the most fundamental and challenging problems in computer vision, aims to obtain posture of the human body from input images or video sequences. The recent developments of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Yucheng Chen , Yingli Tian , Mingyi He

Recent years have witnessed tremendous progress in the 3D reconstruction of dynamic humans from a monocular video with the advent of neural rendering techniques. This task has a wide range of applications, including the creation of virtual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Kanghao Chen , Zeyu Wang , Lin Wang

This work targets at using a general deep learning framework to synthesize free-viewpoint images of arbitrary human performers, only requiring a sparse number of camera views as inputs and skirting per-case fine-tuning. The large variation…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Wei Cheng , Su Xu , Jingtan Piao , Chen Qian , Wayne Wu , Kwan-Yee Lin , Hongsheng Li

Rendering moving human bodies at free viewpoints only from a monocular video is quite a challenging problem. The information is too sparse to model complicated human body structures and motions from both view and pose dimensions. Neural…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Taoran Yi , Jiemin Fang , Xinggang Wang , Wenyu Liu

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Yating Tian , Hongwen Zhang , Yebin Liu , Limin Wang

Detecting and localizing objects in the real 3D space, which plays a crucial role in scene understanding, is particularly challenging given only a monocular image due to the geometric information loss during imagery projection. We propose…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zengyi Qin , Jinglu Wang , Yan Lu

In this paper, we tackle the problem of 3D human shape estimation from single RGB images. While the recent progress in convolutional neural networks has allowed impressive results for 3D human pose estimation, estimating the full 3D shape…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Valentin Gabeur , Jean-Sebastien Franco , Xavier Martin , Cordelia Schmid , Gregory Rogez

We propose a method for in-hand 3D scanning of an unknown object with a monocular camera. Our method relies on a neural implicit surface representation that captures both the geometry and the appearance of the object, however, by contrast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-23 Shreyas Hampali , Tomas Hodan , Luan Tran , Lingni Ma , Cem Keskin , Vincent Lepetit