中文
相关论文

相关论文: Generalizable Neural Voxels for Fast Human Radianc…

200 篇论文

In this work we develop a generalizable and efficient Neural Radiance Field (NeRF) pipeline for high-fidelity free-viewpoint human body synthesis under settings with sparse camera views. Though existing NeRF-based methods can synthesize…

计算机视觉与模式识别 · 计算机科学 2022-03-31 Mingfei Chen , Jianfeng Zhang , Xiangyu Xu , Lijuan Liu , Yujun Cai , Jiashi Feng , Shuicheng Yan

Neural Radiance Field (NeRF) is a popular method in data-driven 3D reconstruction. Given its simplicity and high quality rendering, many NeRF applications are being developed. However, NeRF's big limitation is its slow speed. Many attempts…

计算机视觉与模式识别 · 计算机科学 2021-11-29 Naruya Kondo , Yuya Ikeda , Andrea Tagliasacchi , Yutaka Matsuo , Yoichi Ochiai , Shixiang Shane Gu

We introduce a novel framework that learns a dynamic neural radiance field (NeRF) for full-body talking humans from monocular videos. Prior work represents only the body pose or the face. However, humans communicate with their full body,…

计算机视觉与模式识别 · 计算机科学 2024-09-26 Aggelina Chatziagapi , Bindita Chaudhuri , Amit Kumar , Rakesh Ranjan , Dimitris Samaras , Nikolaos Sarafianos

Neural radiance fields (NeRF) have shown great success in modeling 3D scenes and synthesizing novel-view images. However, most previous NeRF methods take much time to optimize one single scene. Explicit data structures, e.g. voxel features,…

计算机视觉与模式识别 · 计算机科学 2022-09-27 Jiemin Fang , Taoran Yi , Xinggang Wang , Lingxi Xie , Xiaopeng Zhang , Wenyu Liu , Matthias Nießner , Qi Tian

In this paper, we target at the problem of learning a generalizable dynamic radiance field from monocular videos. Different from most existing NeRF methods that are based on multiple views, monocular videos only contain one view at each…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Fengrui Tian , Shaoyi Du , Yueqi Duan

We introduce HOSNeRF, a novel 360{\deg} free-viewpoint rendering method that reconstructs neural radiance fields for dynamic human-object-scene from a single monocular in-the-wild video. Our method enables pausing the video at any frame and…

计算机视觉与模式识别 · 计算机科学 2023-04-25 Jia-Wei Liu , Yan-Pei Cao , Tianyuan Yang , Eric Zhongcong Xu , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou

In this work, we focus on synthesizing high-fidelity novel view images for arbitrary human performers, given a set of sparse multi-view images. It is a challenging task due to the large variation among articulated body poses and heavy…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Jianchuan Chen , Wentao Yi , Liqian Ma , Xu Jia , Huchuan Lu

Photo-realistic free-viewpoint rendering of real-world scenes using classical computer graphics techniques is challenging, because it requires the difficult step of capturing detailed appearance and geometry models. Recent studies have…

计算机视觉与模式识别 · 计算机科学 2021-01-08 Lingjie Liu , Jiatao Gu , Kyaw Zaw Lin , Tat-Seng Chua , Christian Theobalt

Neural Radiance Fields (NeRF) has demonstrated its superior capability to represent 3D geometry but require accurately precomputed camera poses during training. To mitigate this requirement, existing methods jointly optimize camera poses…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Hoang Chuong Nguyen , Wei Mao , Jose M. Alvarez , Miaomiao Liu

We present a novel semantic model for human head defined with neural radiance field. The 3D-consistent head model consist of a set of disentangled and interpretable bases, and can be driven by low-dimensional expression coefficients. Thanks…

图形学 · 计算机科学 2022-10-13 Xuan Gao , Chenglai Zhong , Jun Xiang , Yang Hong , Yudong Guo , Juyong Zhang

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Recent advances in Neural Radiance Fields (NeRF) have demonstrated promising results in 3D scene representations, including 3D human representations. However, these representations often lack crucial information on the underlying human pose…

计算机视觉与模式识别 · 计算机科学 2024-04-10 Arnab Dey , Di Yang , Rohith Agaram , Antitza Dantcheva , Andrew I. Comport , Srinath Sridhar , Jean Martinet

We introduce a new method that generates photo-realistic humans under novel views and poses given a monocular video as input. Despite the significant progress recently on this topic, with several methods exploring shared canonical neural…

计算机视觉与模式识别 · 计算机科学 2023-04-21 Tiantian Wang , Nikolaos Sarafianos , Ming-Hsuan Yang , Tony Tung

Recent neural human representations can produce high-quality multi-view rendering but require using dense multi-view inputs and costly training. They are hence largely limited to static models as training each frame is infeasible. We…

计算机视觉与模式识别 · 计算机科学 2022-03-28 Fuqiang Zhao , Wei Yang , Jiakai Zhang , Pei Lin , Yingliang Zhang , Jingyi Yu , Lan Xu

We present a method for fast 3D reconstruction and real-time rendering of dynamic humans from monocular videos with accompanying parametric body fits. Our method can reconstruct a dynamic human in less than 3h using a single GPU, compared…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Ignacio Rocco , Iurii Makarov , Filippos Kokkinos , David Novotny , Benjamin Graham , Natalia Neverova , Andrea Vedaldi

We present FlexNeRF, a method for photorealistic freeviewpoint rendering of humans in motion from monocular videos. Our approach works well with sparse views, which is a challenging scenario when the subject is exhibiting fast/complex…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Vinoj Jayasundara , Amit Agrawal , Nicolas Heron , Abhinav Shrivastava , Larry S. Davis

We present a super-fast convergence approach to reconstructing the per-scene radiance field from a set of images that capture the scene with known poses. This task, which is often applied to novel view synthesis, is recently revolutionized…

计算机视觉与模式识别 · 计算机科学 2022-06-06 Cheng Sun , Min Sun , Hwann-Tzong Chen

We present TimeNeRF, a generalizable neural rendering approach for rendering novel views at arbitrary viewpoints and at arbitrary times, even with few input views. For real-world applications, it is expensive to collect multiple views and…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Hsiang-Hui Hung , Huu-Phu Do , Yung-Hui Li , Ching-Chun Huang

3D understanding and rendering of moving humans from monocular videos is a challenging task. Despite recent progress, the task remains difficult in real-world scenarios, where obstacles may block the camera view and cause partial occlusions…

计算机视觉与模式识别 · 计算机科学 2023-08-10 Tiange Xiang , Adam Sun , Jiajun Wu , Ehsan Adeli , Li Fei-Fei

Modeling dynamic scenes is important for many applications such as virtual reality and telepresence. Despite achieving unprecedented fidelity for novel view synthesis in dynamic scenes, existing methods based on Neural Radiance Fields…

计算机视觉与模式识别 · 计算机科学 2022-06-07 Jia-Wei Liu , Yan-Pei Cao , Weijia Mao , Wenqiao Zhang , David Junhao Zhang , Jussi Keppo , Ying Shan , Xiaohu Qie , Mike Zheng Shou